00000001:02000400:3.0F:1789402193.853974:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789402217.009431:0:3190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789402219.621141:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 407 MB/s 00000001:01000000:0.0:1789402219.875639:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 337 MB/s 00000001:01000000:2.0F:1789402220.130404:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3066 MB/s 00000020:02000000:0.0:1789402221.347560:0:3281:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gb3cb314 00000400:02000000:0.0:1789402222.916671:0:3297:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.108@tcp [8/256/0/180] 00008000:02000000:2.0:1789402226.691404:0:3446:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789402278.156596:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789402289.449408:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789402289.449418:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789402289.449679:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ac58b35b 00000080:02000400:0.0:1789402289.449695:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789402289.464766:0:5825:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789402289.464786:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0F:1789402289.464896:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000385b48db) 00000020:00000080:1.0:1789402289.464930:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789402289.498476:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789402289.499716:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789402289.552445:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789402289.552489:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789402289.552660:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789402289.552717:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789402289.552748:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789402289.553215:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789402289.553225:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789402289.553239:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f7845 00000020:01000004:2.0:1789402289.553249:0:5825:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789402289.553254:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789402289.553260:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ac58b35b from MGS 00000020:01000004:2.0:1789402289.553266:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789402289.553298:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000039630b72) 00000020:00000080:2.0:1789402289.553319:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789402289.553685:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ac58b35b from MGS, refs=2 00080000:01000000:2.0:1789402289.553692:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789402289.553699:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f7853 00000100:00100000:2.0:1789402289.553835:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789402289.553978:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789402289.553986:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789402289.558524:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789402289.558542:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789402289.563617:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789402289.567746:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789402289.567766:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789402289.571722:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789402289.571747:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789402289.576581:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789402289.576610:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789402289.579782:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402289.579790:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402289.579792:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402289.580685:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402289.580689:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402289.580691:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402289.581267:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789402289.585304:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789402289.830620:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1515 MB/s 00000001:01000000:1.0:1789402290.080693:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2375 MB/s 00000001:01000000:2.0:1789402290.330423:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 491 MB/s 00000001:01000000:0.0:1789402290.581070:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 495 MB/s 00010000:00010000:1.0:1789402290.599686:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789402290.619417:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789402290.647451:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789402290.647477:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789402290.647480:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789402290.651224:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789402290.653277:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789402290.653424:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789402290.654658:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789402290.654715:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789402290.655521:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789402290.655872:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789402290.655879:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789402290.663206:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789402290.663228:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789402290.671633:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789402290.671658:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789402290.672927:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789402290.672958:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.108@tcp' 00000020:01000004:0.0:1789402290.672960:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789402290.673025:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.108@tcp (typ=mgc) 00000020:00000080:0.0:1789402290.673049:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.108@tcp (00000000991c22f1) 00000100:00080000:2.0:1789402290.673196:0:5840:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1789402290.673220:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789402290.674225:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cb88e773@MGC192.168.203.108@tcp: add connection 192.168.203.108@tcp at head 00010000:00010000:0.0:1789402290.675964:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.108@tcp-0 is initialized 00000040:01000000:0.0:1789402290.675977:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.108@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789402290.684386:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789402290.688416:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.108@tcp (uuid 8612d911-d8bf-490d-b22c-35e85a3b4473) 00000020:00000080:3.0:1789402290.688459:0:5825:0:(genops.c:1384:class_connect()) connect: client 8612d911-d8bf-490d-b22c-35e85a3b4473, cookie 0x9403f4af875f7861 00000100:00080000:3.0:1789402290.688475:0:5825:0:(import.c:545:import_select_connection()) MGC192.168.203.108@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789402290.688489:0:5825:0:(import.c:666:import_select_connection()) MGC192.168.203.108@tcp: import 00000000cb88e773 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:3.0:1789402290.688571:0:5825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000611cc3c x1876324224336000/t0(0) o250->MGC192.168.203.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789402290.688599:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS 00000020:01000004:3.0:1789402290.688624:0:5825:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789402290.688630:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789402290.688652:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003946ce36) 00000020:00000080:3.0:1789402290.688670:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789402290.689636:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000611cc3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8612d911-d8bf-490d-b22c-35e85a3b4473:3312:1876324224336000:0@lo:250: 00000100:00100000:1.0:1789402290.689757:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402290.689863:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224336000 00000100:00100000:1.0:1789402290.689874:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224336000 00000100:00100000:1.0:1789402290.689910:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402290.689918:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e67fd273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1876324224336000:12345-0@lo:250: 00010000:00080000:1.0:1789402290.689947:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8612d911-d8bf-490d-b22c-35e85a3b4473@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1789402290.689982:0:5836:0:(genops.c:1384:class_connect()) connect: client 8612d911-d8bf-490d-b22c-35e85a3b4473, cookie 0x9403f4af875f786f 00000100:00080000:1.0:1789402290.690137:0:5836:0:(import.c:65:import_set_state_nolock()) 00000000ecf1606f : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402290.690194:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e67fd273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+5:3312:x1876324224336000:12345-0@lo:250: Request processed in 275us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402290.690212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402290.690265:0:3312:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.108@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789402290.690282:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.108@tcp: connect to target with instance 0 00000100:00080000:1.0:1789402290.690291:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.108@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789402290.690296:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789402290.690300:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000cb88e773 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789402290.690302:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789402290.690312:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789402290.690317:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000611cc3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8612d911-d8bf-490d-b22c-35e85a3b4473:3312:1876324224336000:0@lo:250: 00000100:00100000:3.0:1789402290.715488:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789402290.715725:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789402290.715732:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789402290.717521:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789402290.717533:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789402290.724184:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789402290.724216:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789402290.725430:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789402290.725646:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789402290.725652:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789402290.727478:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789402290.727490:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789402290.799041:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789402290.799262:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789402290.799268:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789402290.813676:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789402290.813688:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789402290.820231:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402290.820895:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789402290.820903:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789402290.830498:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789402290.830519:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789402290.831633:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789402290.832475:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789402290.832483:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789402290.837849:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789402290.840011:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789402290.842046:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789402290.842240:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789402290.842245:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789402290.842998:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789402290.843006:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789402290.880898:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789402290.881116:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789402290.881123:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789402290.883042:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789402290.883056:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789402290.883798:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789402290.883806:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789402290.885282:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789402290.885307:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789402290.885313:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.108@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789402290.885600:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.108@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789402290.885633:0:5825:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.108@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789402290.885638:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789402290.885639:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789402290.885640:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789402290.885642:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789402290.885643:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789402290.885644:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789402290.885645:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789402290.885647:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789402290.885648:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789402290.885649:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789402290.885650:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789402290.885652:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789402290.885654:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789402290.885656:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789402290.885657:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789402290.885658:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789402290.885659:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789402290.885660:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789402290.885661:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789402290.885662:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789402290.885663:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789402290.885664:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789402290.885665:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789402290.885665:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789402290.885666:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789402290.885700:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789402290.885717:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003630e484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336128:0@lo:253: 00000100:00100000:1.0:1789402290.885807:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402290.885942:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a68118e4 going to sleep for 11 seconds 00000100:00100000:2.0:1789402290.885994:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224336128 00000100:00100000:2.0:1789402290.886003:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224336128 00000100:00100000:2.0:1789402290.886046:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789402290.886054:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024118408 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+5:5825:x1876324224336128:12345-0@lo:253: 20000000:01000000:2.0:1789402290.886100:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789402290.886103:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789402290.890015:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789402290.890080:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789402290.890513:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789402290.891682:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789402290.891953:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789402290.891957:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789402290.891963:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789402290.891966:0:5839:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789402290.891981:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789402290.892155:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789402290.896104:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789402290.896132:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789402290.896200:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789402290.896252:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789402290.896293:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789402290.896863:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789402290.896875:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789402290.896923:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789402290.896931:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789402290.896964:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789402290.896971:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789402290.896999:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789402290.897082:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789402290.897120:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789402290.897126:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789402290.897139:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789402290.898611:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789402290.898635:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789402290.898706:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789402290.898745:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789402290.898819:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789402290.898836:0:5839:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789402290.898937:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789402290.898947:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789402290.898991:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789402290.899044:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789402290.899080:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789402290.899090:0:5839:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789402290.899176:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789402290.899185:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789402290.899217:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789402290.899254:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789402290.900609:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789402290.900692:0:5839:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789402290.900700:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789402290.904014:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789402290.904724:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789402290.904754:0:5839:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.108@tcp for mdt 20000000:01000000:2.0:1789402290.904756:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.108@tcp (null) (null) (null) 00000040:00080000:2.0:1789402290.904799:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789402290.904808:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789402290.904838:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789402290.904845:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.108@tcp (null) (null) 00000040:00080000:2.0:1789402290.904901:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789402290.904912:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789402290.904947:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789402290.904982:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789402290.905044:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789402290.905048:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789402290.905053:0:5839:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789402290.905059:0:5839:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789402290.905606:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789402290.905730:0:5839:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789402290.912608:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789402290.912664:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1789402290.912764:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1789402290.912785:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789402290.912799:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789402290.912802:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789402290.912816:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789402290.912818:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789402290.912850:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789402290.912853:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789402290.913827:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789402290.914100:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789402290.914143:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789402290.914221:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1789402290.914237:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789402290.914239:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789402290.914904:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789402290.915227:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789402290.915270:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789402290.915305:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789402290.915570:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789402290.915573:0:5839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789402290.915581:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789402290.915600:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915615:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915623:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915629:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915635:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915653:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915660:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c5f8a14d already unused, calling callback (000000001cfb8b17) 00010000:00010000:2.0:1789402290.915663:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915670:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915683:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915690:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402290.915695:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7876 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789402290.915710:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789402291.197743:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024118408 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+5:5825:x1876324224336128:12345-0@lo:253: Request processed in 311683us (311930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402291.197762:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402291.197853:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003630e484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336128:0@lo:253: 10000000:01000000:1.0:1789402291.197868:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789402291.197872:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789402291.197886:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789402291.197887:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789402291.197888:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789402291.197890:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789402291.197891:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789402291.197892:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789402291.197893:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789402291.197894:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789402291.197896:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789402291.197897:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789402291.197916:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ac58b35b from lustre-MDT0000 10000000:01000000:1.0:1789402291.197941:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789402291.197944:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789402291.197948:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93c6c99019c0 10000000:01000000:1.0:1789402291.197951:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789402291.197958:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c6c99019c0 from 1 10000000:01000000:1.0:1789402291.197961:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789402291.197998:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: 0000000004a2c38c/0x9403f4af875f787d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.198008:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: 0000000004a2c38c/0x9403f4af875f787d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.198016:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: 0000000004a2c38c/0x9403f4af875f787d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402291.198031:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003630e484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336256:0@lo:101: 00000100:00100000:1.0:1789402291.198065:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402291.198313:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020a9754a going to sleep for 11 seconds 00000100:00100000:2.0:1789402291.198492:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224336256 00000100:00100000:2.0:1789402291.198499:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224336256 00000100:00100000:2.0:1789402291.198565:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789402291.198572:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000049d61b94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+5:5825:x1876324224336256:12345-0@lo:101: 00010000:00010000:2.0:1789402291.198584:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402291.198596:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f787d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.198616:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f787d expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.198631:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5f8a14d/0x9403f4af875f7884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f787d expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.198639:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5f8a14d, rc 0) 00000100:00100000:2.0:1789402291.198693:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000049d61b94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+6:5825:x1876324224336256:12345-0@lo:101: Request processed in 121us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402291.198700:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789402291.198759:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003630e484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336256:0@lo:101: 00010000:00010000:3.0:1789402291.198771:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: 0000000004a2c38c/0x9403f4af875f787d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.198779:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: 0000000004a2c38c/0x9403f4af875f787d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402291.198831:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336384:0@lo:501: 00000100:00100000:3.0:1789402291.198853:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402291.198950:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000003296acca going to sleep for 11 seconds 00000100:00100000:1.0:1789402291.199014:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224336384 00000100:00100000:1.0:1789402291.199018:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224336384 00000100:00100000:1.0:1789402291.199035:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789402291.199040:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a650f862 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+6:5825:x1876324224336384:12345-0@lo:501: 00000100:00100000:1.0:1789402291.199309:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a650f862 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+6:5825:x1876324224336384:12345-0@lo:501: Request processed in 268us (455us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789402291.199406:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336384:0@lo:501: 10000000:01000000:3.0:1789402291.199431:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789402291.199443:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: 0000000004a2c38c/0x9403f4af875f787d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.199451:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: 0000000004a2c38c/0x9403f4af875f787d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402291.199457:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c6e31a1800 10000000:01000000:3.0:1789402291.199461:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789402291.199464:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93c6e31a1800 10000000:01000000:3.0:1789402291.199466:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789402291.199468:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93c6e31a1800 from 1 10000000:01000000:3.0:1789402291.199470:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789402291.199486:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: 00000000cfceda62/0x9403f4af875f788b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.199492:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: 00000000cfceda62/0x9403f4af875f788b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.199499:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: 00000000cfceda62/0x9403f4af875f788b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402291.199508:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336512:0@lo:101: 00000100:00100000:3.0:1789402291.199530:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402291.199542:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000003296acca going to sleep for 11 seconds 00000100:00100000:1.0:1789402291.199601:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789402291.199620:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224336512 00000100:00100000:1.0:1789402291.199623:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224336512 00000100:00100000:1.0:1789402291.199636:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789402291.199640:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006dc75462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+6:5825:x1876324224336512:12345-0@lo:101: 00010000:00010000:1.0:1789402291.199646:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402291.199654:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e67c6379/0x9403f4af875f7892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f788b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.199666:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e67c6379/0x9403f4af875f7892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f788b expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.199673:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e67c6379/0x9403f4af875f7892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f788b expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.199679:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e67c6379, rc 0) 00000100:00100000:1.0:1789402291.199702:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006dc75462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+7:5825:x1876324224336512:12345-0@lo:101: Request processed in 61us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402291.199707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789402291.199770:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336512:0@lo:101: 00010000:00010000:3.0:1789402291.199779:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: 00000000cfceda62/0x9403f4af875f788b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.199817:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: 00000000cfceda62/0x9403f4af875f788b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402291.199827:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789402291.199840:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: 00000000cfceda62/0x9403f4af875f788b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.199845:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: 00000000cfceda62/0x9403f4af875f788b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402291.199850:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789402291.199853:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789402291.199857:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93c6e31a1800 10000000:01000000:3.0:1789402291.199859:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789402291.199861:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789402291.199863:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789402291.199876:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: 000000009f442316/0x9403f4af875f7899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.199881:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: 000000009f442316/0x9403f4af875f7899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.199888:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: 000000009f442316/0x9403f4af875f7899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402291.199897:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336640:0@lo:101: 00000100:00100000:3.0:1789402291.199922:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402291.199933:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000003296acca going to sleep for 11 seconds 00000100:00100000:1.0:1789402291.199996:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224336640 00000100:00100000:1.0:1789402291.200000:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224336640 00000100:00100000:1.0:1789402291.200015:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789402291.200019:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000268d0002 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+7:5825:x1876324224336640:12345-0@lo:101: 00010000:00010000:1.0:1789402291.200025:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402291.200031:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058d3a61a/0x9403f4af875f78a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7899 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.200050:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058d3a61a/0x9403f4af875f78a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7899 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.200057:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058d3a61a/0x9403f4af875f78a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7899 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.200062:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058d3a61a, rc 0) 00000100:00100000:1.0:1789402291.200132:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000268d0002 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+8:5825:x1876324224336640:12345-0@lo:101: Request processed in 112us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402291.200147:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789402291.200483:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336640:0@lo:101: 00010000:00010000:3.0:1789402291.200494:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: 000000009f442316/0x9403f4af875f7899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.200501:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: 000000009f442316/0x9403f4af875f7899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402291.200539:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336768:0@lo:501: 00000100:00100000:3.0:1789402291.200564:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402291.200627:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000003296acca going to sleep for 11 seconds 00000100:00100000:1.0:1789402291.200662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224336768 00000100:00100000:1.0:1789402291.200667:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224336768 00000100:00100000:1.0:1789402291.200730:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789402291.200737:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047652d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+8:5825:x1876324224336768:12345-0@lo:501: 00000100:00100000:1.0:1789402291.200927:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047652d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+9:5825:x1876324224336768:12345-0@lo:501: Request processed in 191us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402291.200934:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789402291.200988:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336768:0@lo:501: 00000100:00100000:3.0:1789402291.201012:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336896:0@lo:503: 00000100:00100000:3.0:1789402291.201046:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402291.201106:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000003296acca going to sleep for 11 seconds 00000100:00100000:2.0:1789402291.201179:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224336896 00000100:00100000:2.0:1789402291.201184:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224336896 00000100:00100000:2.0:1789402291.201205:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789402291.201210:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9ee6d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+9:5825:x1876324224336896:12345-0@lo:503: 00000100:00100000:2.0:1789402291.201397:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9ee6d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+9:5825:x1876324224336896:12345-0@lo:503: Request processed in 186us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402291.201404:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789402291.201547:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224336896:0@lo:503: 00000100:00100000:3.0:1789402291.201961:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:5867:1876324224337024:0@lo:502: 00000100:00100000:3.0:1789402291.202003:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402291.202063:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 000000002df2f57e going to sleep for 11 seconds 00000100:00100000:1.0:1789402291.202108:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224337024 00000100:00100000:1.0:1789402291.202112:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224337024 00000100:00100000:0.0:1789402291.202176:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789402291.202185:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cfbcd076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+9:5867:x1876324224337024:12345-0@lo:502: 00000100:00100000:0.0:1789402291.202386:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cfbcd076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+9:5867:x1876324224337024:12345-0@lo:502: Request processed in 203us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402291.202393:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789402291.202463:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:5867:1876324224337024:0@lo:502: 00000020:01000000:3.0:1789402291.202485:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402291.202495:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402291.202498:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789402291.202502:0:5867:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789402291.202505:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789402291.202516:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007408ae0a) 00000020:00000080:3.0:1789402291.202531:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789402291.202541:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789402291.202605:0:5867:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789402291.202621:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f78ae 00000020:00000080:3.0:1789402291.202858:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789402291.202862:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402291.202865:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402291.202867:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789402291.202869:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402291.202872:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402291.202873:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789402291.202876:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789402291.202883:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b1474bd3) 00000020:00000080:3.0:1789402291.202893:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789402291.202897:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789402291.202899:0:5867:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789402291.202901:0:5867:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789402291.202907:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789402291.202948:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ac58b35b from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789402291.202960:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007ebdfb06) 00000020:00000080:3.0:1789402291.202967:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789402291.203010:0:5867:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789402291.203015:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f78c3 00000020:00000080:3.0:1789402291.203124:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789402291.203131:0:5867:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789402291.203136:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9403f4af875f78ca 00080000:01000000:3.0:1789402291.203141:0:5867:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789402291.203144:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f78d1 00080000:10000000:3.0:1789402291.203581:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789402291.203777:0:5867:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789402291.209811:0:5867:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789402291.302405:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789402291.302765:0:5867:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789402291.305766:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789402291.306081:0:5867:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789402291.337022:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006c296848) 00000020:00000080:2.0:1789402291.337043:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789402291.337116:0:5867:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789402291.337123:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f78df 00000020:00000080:3.0:1789402291.337691:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789402291.340712:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789402291.380778:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402291.412831:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402291.451545:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402291.503167:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402291.556689:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1789402291.623599:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789402291.638760:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9403f4af875f78e6 00000020:00000080:1.0:1789402291.644725:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789402291.644740:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402291.645478:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402291.645483:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789402291.645490:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402291.645497:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402291.645499:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789402291.645504:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789402291.645578:0:5867:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789402291.645599:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402291.645603:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402291.645604:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789402291.645607:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402291.645609:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402291.645610:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789402291.645613:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789402291.645614:0:5867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789402291.645671:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:5867:1876324224337152:0@lo:502: 00000100:00100000:0.0:1789402291.645749:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402291.645828:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f59121bc going to sleep for 11 seconds 00000100:00100000:1.0:1789402291.647069:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224337152 00000100:00100000:1.0:1789402291.647094:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224337152 00000100:00100000:1.0:1789402291.647149:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789402291.647159:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004612de0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+9:5867:x1876324224337152:12345-0@lo:502: 00000100:00100000:1.0:1789402291.648770:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004612de0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+9:5867:x1876324224337152:12345-0@lo:502: Request processed in 1607us (3015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402291.648793:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789402291.649256:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:5867:1876324224337152:0@lo:502: 00000020:01000000:0.0:1789402291.649293:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402291.649301:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402291.649303:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789402291.649308:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789402291.649706:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789402291.649724:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789402291.649736:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: 000000009f442316/0x9403f4af875f7899 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.649747:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: 000000009f442316/0x9403f4af875f7899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402291.649755:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6e31a1800 from 1 10000000:01000000:3.0:1789402291.649758:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789402291.649804:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.649812:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.649820:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402291.649839:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337280:0@lo:101: 00000100:00100000:3.0:1789402291.649893:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402291.649932:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025402298 going to sleep for 11 seconds 00000100:00100000:0.0:1789402291.658538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224337280 00000100:00100000:0.0:1789402291.658558:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224337280 00000100:00100000:0.0:1789402291.658634:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789402291.658644:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f607ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+9:5825:x1876324224337280:12345-0@lo:101: 00010000:00010000:0.0:1789402291.658663:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402291.658687:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f78ed expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.658742:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f78ed expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.658754:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f78ed expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.658762:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a10aeabf, rc 0) 00000100:00100000:0.0:1789402291.658863:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f607ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+10:5825:x1876324224337280:12345-0@lo:101: Request processed in 220us (8969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402291.658870:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789402291.658951:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000405763f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337280:0@lo:101: 00010000:00010000:0.0:1789402291.658970:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.658980:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402291.659587:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337408:0@lo:256: 00000100:00100000:0.0:1789402291.659632:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402291.659681:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bda990a7 going to sleep for 11 seconds 00000100:00100000:0.0:1789402291.659706:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224337408 00000100:00100000:0.0:1789402291.659711:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224337408 00000100:00100000:0.0:1789402291.659739:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789402291.659745:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009301971f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+10:5825:x1876324224337408:12345-0@lo:256: 20000000:01000000:0.0:1789402291.659761:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789402291.659766:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789402291.659850:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009301971f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+10:5825:x1876324224337408:12345-0@lo:256: Request processed in 105us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402291.659865:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789402291.659906:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337408:0@lo:256: 10000000:01000000:0.0:1789402291.660567:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789402291.660584:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.660594:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402291.660601:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6e31a1800 from 1 10000000:01000000:0.0:1789402291.660604:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789402291.660632:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.660639:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.660646:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402291.660661:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337536:0@lo:101: 00000100:00100000:0.0:1789402291.660694:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402291.660718:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bda990a7 going to sleep for 11 seconds 00000100:00100000:0.0:1789402291.660738:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224337536 00000100:00100000:0.0:1789402291.660743:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224337536 00000100:00100000:0.0:1789402291.660770:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789402291.660776:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029663833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+10:5825:x1876324224337536:12345-0@lo:101: 00010000:00010000:0.0:1789402291.660800:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402291.660818:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.660837:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f78fb expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.660846:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f78fb expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.660854:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000088de64ad, rc 0) 00000100:00100000:0.0:1789402291.660883:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029663833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+11:5825:x1876324224337536:12345-0@lo:101: Request processed in 108us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402291.660888:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789402291.660925:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337536:0@lo:101: 00010000:00010000:0.0:1789402291.660935:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.660942:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402291.660987:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337664:0@lo:501: 00000100:00100000:0.0:1789402291.661011:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402291.661024:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bda990a7 going to sleep for 11 seconds 00000100:00100000:0.0:1789402291.661036:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224337664 00000100:00100000:0.0:1789402291.661039:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224337664 00000100:00100000:0.0:1789402291.661059:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789402291.661063:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ccfc56eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+11:5825:x1876324224337664:12345-0@lo:501: 00000100:00100000:0.0:1789402291.661638:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ccfc56eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+11:5825:x1876324224337664:12345-0@lo:501: Request processed in 573us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402291.661656:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789402291.661724:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337664:0@lo:501: 00000100:00100000:0.0:1789402291.661754:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337792:0@lo:503: 00000100:00100000:0.0:1789402291.666618:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402291.666691:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bda990a7 going to sleep for 11 seconds 00000100:00100000:1.0:1789402291.667014:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224337792 00000100:00100000:1.0:1789402291.667025:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224337792 00000100:00100000:1.0:1789402291.667078:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789402291.667086:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a76fb3f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+11:5825:x1876324224337792:12345-0@lo:503: 00000040:00080000:1.0:1789402291.667151:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789402291.667229:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a76fb3f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+11:5825:x1876324224337792:12345-0@lo:503: Request processed in 144us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402291.667237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789402291.667373:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b823cea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337792:0@lo:503: 00000040:00080000:3.0:1789402291.668427:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789402291.668583:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789402291.668608:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789402291.668632:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.668643:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402291.668679:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789402291.668682:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c6e31a1800 10000000:01000000:1.0:1789402291.668685:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c6e31a1800 10000000:01000000:1.0:1789402291.668688:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789402291.668693:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6e31a1800 from 1 10000000:01000000:1.0:1789402291.668696:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789402291.668728:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: 0000000027e47394/0x9403f4af875f7909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.668743:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: 0000000027e47394/0x9403f4af875f7909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.668753:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: 0000000027e47394/0x9403f4af875f7909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402291.668773:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001316fdc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337920:0@lo:101: 00000100:00100000:1.0:1789402291.668835:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402291.668870:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dbeebb00 going to sleep for 11 seconds 00000100:00100000:3.0:1789402291.669035:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224337920 00000100:00100000:3.0:1789402291.669042:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224337920 00000100:00100000:3.0:1789402291.669083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789402291.669090:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007161205d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:5825:x1876324224337920:12345-0@lo:101: 00010000:00010000:3.0:1789402291.669102:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402291.669119:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d036a76f/0x9403f4af875f7910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7909 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.669139:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d036a76f/0x9403f4af875f7910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7909 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.669150:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d036a76f/0x9403f4af875f7910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7909 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402291.669157:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d036a76f, rc 0) 00000100:00100000:3.0:1789402291.669202:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007161205d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5825:x1876324224337920:12345-0@lo:101: Request processed in 113us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402291.669208:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789402291.669282:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001316fdc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224337920:0@lo:101: 00010000:00010000:2.0:1789402291.669297:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: 0000000027e47394/0x9403f4af875f7909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.669305:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: 0000000027e47394/0x9403f4af875f7909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402291.669410:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064fcbefd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224338048:0@lo:501: 00000100:00100000:2.0:1789402291.669438:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402291.669457:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5c75057 going to sleep for 11 seconds 00000100:00100000:3.0:1789402291.669568:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224338048 00000100:00100000:3.0:1789402291.669573:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224338048 00000100:00100000:3.0:1789402291.669603:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789402291.669609:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001e111dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5825:x1876324224338048:12345-0@lo:501: 00000100:00100000:3.0:1789402291.669860:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001e111dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5825:x1876324224338048:12345-0@lo:501: Request processed in 251us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402291.669867:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789402291.669897:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064fcbefd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224338048:0@lo:501: 00000100:00100000:3.0:1789402291.669923:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058ccbac0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224338176:0@lo:503: 00000100:00100000:3.0:1789402291.669958:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402291.669971:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000005fd83448 going to sleep for 11 seconds 00000100:00100000:3.0:1789402291.669984:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224338176 00000100:00100000:3.0:1789402291.669987:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224338176 00000100:00100000:3.0:1789402291.670004:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789402291.670009:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d85fd21a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5825:x1876324224338176:12345-0@lo:503: 00000100:00100000:3.0:1789402291.670301:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d85fd21a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5825:x1876324224338176:12345-0@lo:503: Request processed in 292us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402291.670307:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789402291.670500:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058ccbac0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224338176:0@lo:503: 00000100:00100000:3.0:1789402291.676226:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080ee9a50 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:5872:1876324224338304:0@lo:502: 00000100:00100000:3.0:1789402291.676316:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402291.676396:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c8c2020 going to sleep for 11 seconds 00000100:00100000:2.0:1789402291.676485:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224338304 00000100:00100000:2.0:1789402291.676492:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224338304 00000100:00100000:2.0:1789402291.676539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789402291.676547:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed96e2d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5872:x1876324224338304:12345-0@lo:502: 00000100:00100000:2.0:1789402291.676848:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed96e2d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5872:x1876324224338304:12345-0@lo:502: Request processed in 301us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402291.676855:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789402291.676959:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080ee9a50 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:5872:1876324224338304:0@lo:502: 00000020:01000004:0.0:1789402291.677026:0:5872:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789402291.677040:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000fb4e106b) 00000020:00000080:0.0:1789402291.677058:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789402291.677124:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ac58b35b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789402291.677128:0:5872:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ac58b35b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789402291.677131:0:5872:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ac58b35b 4 00010000:00080000:0.0:1789402291.677158:0:5872:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004948c8bd@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.108@tcp at head 00010000:00010000:0.0:1789402291.678803:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789402291.678989:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789402291.679019:0:5872:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789402291.679031:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9403f4af875f791e 00000100:00080000:0.0:1789402291.679040:0:5872:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789402291.679049:0:5872:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004948c8bd using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402291.679082:0:5872:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000047385859 x1876324224338432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789402291.679122:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224338432:0@lo:38: 00000100:00100000:0.0:1789402291.679192:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402291.679258:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224338432 00000100:00100000:0.0:1789402291.679265:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224338432 00000100:00100000:0.0:1789402291.679296:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402291.679309:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f11125df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876324224338432:12345-0@lo:38: 00000100:00100000:0.0:1789402291.679387:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f11125df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876324224338432:12345-0@lo:38: Request processed in 78us (196us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789402291.679393:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402291.679428:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789402291.679435:0:3312:0:(import.c:65:import_set_state_nolock()) 000000004948c8bd lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789402291.679450:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789402291.679453:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224338432:0@lo:38: 00000100:00080000:0.0:1789402291.679484:0:5872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789402291.693026:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:5872:1876324224338560:0@lo:502: 00000100:00100000:0.0:1789402291.693114:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402291.693166:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b365b966 going to sleep for 11 seconds 00000100:00100000:1.0:1789402291.693629:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224338560 00000100:00100000:1.0:1789402291.693639:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224338560 00000100:00100000:1.0:1789402291.693695:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789402291.693706:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000066f62a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5872:x1876324224338560:12345-0@lo:502: 00000100:00100000:1.0:1789402291.694043:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000066f62a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5872:x1876324224338560:12345-0@lo:502: Request processed in 339us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402291.694051:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789402291.704907:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:5872:1876324224338560:0@lo:502: 00000040:00080000:1.0:1789402291.705042:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789402291.705302:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789402291.705323:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789402291.705367:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: 0000000027e47394/0x9403f4af875f7909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402291.705378:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: 0000000027e47394/0x9403f4af875f7909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789402291.705429:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789402291.705431:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789402291.705433:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402291.705434:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402291.705435:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402291.705436:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402291.705438:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789402291.705439:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789402291.705447:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789402291.705448:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789402291.705449:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402291.705450:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789402291.705453:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789402291.705456:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789402291.705457:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789402291.705457:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402291.705458:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402291.705459:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402291.705460:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402291.705461:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789402291.705461:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789402291.705462:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789402291.705463:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789402291.705463:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402291.705464:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789402291.705486:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789402291.705501:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224338688:0@lo:253: 00000100:00100000:0.0:1789402291.705575:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402291.705614:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b365b966 going to sleep for 11 seconds 00000100:00100000:3.0:1789402291.705697:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224338688 00000100:00100000:3.0:1789402291.705705:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224338688 00000100:00100000:3.0:1789402291.705749:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789402291.705757:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8a94253 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5825:x1876324224338688:12345-0@lo:253: 20000000:01000000:3.0:1789402291.705791:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789402291.705804:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789402291.746135:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789402291.746153:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789402291.746308:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789402291.746323:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789402291.746366:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.746386:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f78ed expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.746394:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.746434:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f78ed expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.746448:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f78ed expref: 12 pid: 5839 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402291.746478:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007413ce57 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876324224338816:0@lo:104: 00000100:00100000:2.0:1789402291.746535:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402291.746592:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000533d91d7 going to sleep for 11 seconds 00000100:00100000:1.0:1789402291.746817:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224338816 00000100:00100000:1.0:1789402291.746826:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224338816 00000100:00100000:1.0:1789402291.746959:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402291.746970:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bdba0e91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5860:x1876324224338816:12345-0@lo:104: 00010000:00010000:1.0:1789402291.746982:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.747036:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789402291.747042:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bdba0e91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5860:x1876324224338816:12345-0@lo:104: Request processed in 75us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402291.747058:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789402291.747124:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007413ce57 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876324224338816:0@lo:104: 00010000:00010000:2.0:1789402291.747141:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.751051:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402291.751063:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.751075:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6e5fb89 already unused, calling callback (00000000875b593a) 10000000:00010000:1.0:1789402291.751078:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.751086:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402291.751092:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402291.751096:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789402291.751149:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.751154:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789402291.751177:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.751183:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: 00000000f6e5fb89/0x9403f4af875f78ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f78f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.751200:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402291.751202:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402291.751204:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402291.751279:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402291.751307:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e47d8a07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224338944:0@lo:103: 00000100:00100000:1.0:1789402291.751413:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402291.752693:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224338944 00000100:00100000:2.0:1789402291.752705:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224338944 00010000:00010000:2.0:1789402291.752734:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f78ed expref: 13 pid: 5839 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402291.752813:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789402291.752822:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091413b18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:3313:x1876324224338944:12345-0@lo:103: 00010000:00010000:2.0:1789402291.752835:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402291.752840:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f78ed expref: 13 pid: 5839 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.752850:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f78ed expref: 13 pid: 5839 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.752864:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a10aeabf/0x9403f4af875f78f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f78ed expref: 13 pid: 5839 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.752889:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.752896:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789402291.752921:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006599356s 00010000:00010000:2.0:1789402291.752925:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.752930:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.752935:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.752940:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.752944:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000342df0aa already unused, calling callback (000000001cfb8b17) 00010000:00010000:2.0:1789402291.752947:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.752954:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.753151:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402291.753160:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.753187:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.753194:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000342df0aa/0x9403f4af875f7925 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402291.753209:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402291.753651:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091413b18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:3313:x1876324224338944:12345-0@lo:103: Request processed in 828us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402291.753660:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789402291.757245:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8a94253 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+11:5825:x1876324224338688:12345-0@lo:253: Request processed in 51482us (51664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402291.757260:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789402291.757392:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:5825:1876324224338688:0@lo:253: 10000000:01000000:0.0:1789402291.757409:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789402291.757412:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789402291.757413:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789402291.757415:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402291.757416:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402291.757417:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402291.757418:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402291.757419:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789402291.757421:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789402291.757422:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789402291.757423:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789402291.757424:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402291.757425:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789402291.757438:0:5825:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789402291.761159:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e47d8a07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224338944:0@lo:103: 00080000:10000000:0.0:1789402291.767712:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789402291.772555:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789402291.772920:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789402291.773107:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789402291.774677:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789402291.774867:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789402291.778076:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402291.778263:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789402291.778539:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402291.778707:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789402291.778934:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402291.779110:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789402291.843967:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789402291.901479:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789402291.901735:0:5878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1789402291.908250:0:5877:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789402291.908260:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789402291.915033:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789402291.915494:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789402291.916222:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789402291.916232:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789402291.917563:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789402291.919629:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789402291.920220:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789402291.920250:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789402291.920560:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789402291.920740:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1789402291.921982:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789402291.922123:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789402291.922265:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789402291.922433:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789402291.922593:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789402291.922759:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789402291.924715:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789402291.924900:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789402291.925080:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789402291.925448:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789402291.925604:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789402291.925754:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789402291.925922:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789402291.926082:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789402291.931528:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789402291.931766:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789402291.932066:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789402291.934306:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789402291.934531:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789402291.934709:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789402291.935092:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789402291.935255:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789402291.935437:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789402291.935592:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789402291.935742:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789402291.935918:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789402291.936058:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789402291.936201:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789402291.936368:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789402291.936516:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789402291.936672:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789402291.936835:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789402291.937012:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789402291.946486:0:5878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789402292.013455:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789402292.013492:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f6201d6f988 00100000:10000000:3.0:1789402292.013500:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789402292.014420:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789402292.014436:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789402292.014451:0:5825:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789402292.014473:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789402292.080737:0:5878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789402292.080819:0:5878:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789402292.080823:0:5878:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789402292.643657:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402293.671113:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402294.693490:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402295.715905:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402296.738641:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789402297.058558:0:1377:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789402297.058568:0:1377:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789402297.058571:0:1377:0:(import.c:65:import_set_state_nolock()) 000000004948c8bd lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789402297.058588:0:1377:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004948c8bd using connection 192.168.203.108@tcp/0@lo 00000100:00100000:3.0:1789402297.058609:0:1377:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e05d1540 x1876324224339200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789402297.058644:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e05d1540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224339200:0@lo:38: 00000100:00100000:3.0:1789402297.058718:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402297.058803:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224339200 00000100:00100000:3.0:1789402297.058819:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224339200 00000100:00100000:3.0:1789402297.058854:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789402297.058859:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fba8e8db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876324224339200:12345-0@lo:38: 00010000:00080000:3.0:1789402297.058884:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1789402297.058916:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9403f4af875f792c 00000004:00100000:3.0:1789402297.058953:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789402297.059046:0:5846:0:(import.c:65:import_set_state_nolock()) 000000001b22f9bc : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789402297.059087:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fba8e8db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876324224339200:12345-0@lo:38: Request processed in 227us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402297.059094:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789402297.059132:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e05d1540 x1876324224339200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789402307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789402297.059145:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789402297.059152:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789402297.059156:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789402297.059157:0:3312:0:(import.c:65:import_set_state_nolock()) 000000004948c8bd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789402297.059162:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e05d1540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224339200:0@lo:38: 00000100:00100000:1.0:1789402297.059266:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3eaab96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224339072:0@lo:400: 00000100:00100000:1.0:1789402297.059298:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402297.059424:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224339072 00000100:00100000:3.0:1789402297.059428:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224339072 00000100:00100000:3.0:1789402297.059459:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789402297.059464:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003201dc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:3315:x1876324224339072:12345-0@lo:400: 00000100:00100000:3.0:1789402297.059493:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003201dc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:3315:x1876324224339072:12345-0@lo:400: Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402297.059499:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789402297.059565:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3eaab96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224339072:0@lo:400: 00000001:02000400:1.0:1789402297.562250:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789402297.766846:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402298.786675:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402299.810566:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789402300.130517:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789402300.130524:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6e31a1800 from 3 10000000:01000000:0.0:1789402300.130529:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789402300.130580:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: 000000008a6273c0/0x9403f4af875f7933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402300.130592:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: 000000008a6273c0/0x9403f4af875f7933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402300.130604:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: 000000008a6273c0/0x9403f4af875f7933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402300.130628:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224339328:0@lo:101: 00000100:00100000:0.0:1789402300.130694:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402300.130771:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084fb5972 going to sleep for 11 seconds 00000100:00100000:2.0:1789402300.130952:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224339328 00000100:00100000:2.0:1789402300.130961:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224339328 00000100:00100000:2.0:1789402300.131016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789402300.131024:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e7322e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+11:5841:x1876324224339328:12345-0@lo:101: 00010000:00010000:2.0:1789402300.131038:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402300.131050:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efb306af/0x9403f4af875f793a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7933 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402300.131070:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efb306af/0x9403f4af875f793a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7933 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402300.131080:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efb306af/0x9403f4af875f793a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7933 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402300.131088:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efb306af, rc 0) 00000100:00100000:2.0:1789402300.131134:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e7322e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224339328:12345-0@lo:101: Request processed in 110us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402300.131141:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789402300.131754:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224339328:0@lo:101: 00010000:00010000:0.0:1789402300.131772:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: 000000008a6273c0/0x9403f4af875f7933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402300.131798:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: 000000008a6273c0/0x9403f4af875f7933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402300.131849:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224339456:0@lo:256: 00000100:00100000:0.0:1789402300.131890:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402300.131959:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084fb5972 going to sleep for 11 seconds 00000100:00100000:1.0:1789402300.135620:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224339456 00000100:00100000:1.0:1789402300.135636:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224339456 00000100:00100000:1.0:1789402300.135699:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789402300.135709:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fbbad226 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224339456:12345-0@lo:256: 20000000:01000000:1.0:1789402300.135744:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789402300.135765:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789402300.135767:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789402300.135891:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fbbad226 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224339456:12345-0@lo:256: Request processed in 183us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402300.135899:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789402300.136013:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047385859 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224339456:0@lo:256: 10000000:01000000:0.0:1789402300.136063:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789402300.136071:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: 000000008a6273c0/0x9403f4af875f7933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402300.136082:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: 000000008a6273c0/0x9403f4af875f7933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402300.844369:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402301.858529:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402302.178725:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402302.178759:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e47d8a07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224339584:0@lo:400: 00000100:00100000:3.0:1789402302.178855:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402302.180820:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a260c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224339712:0@lo:400: 00000100:00100000:0.0:1789402302.180914:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402302.181072:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224339712 00000100:00100000:3.0:1789402302.181084:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224339712 00000100:00100000:3.0:1789402302.181147:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789402302.181157:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047385859 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224339712:12345-0@lo:400: 00000100:00100000:3.0:1789402302.181225:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047385859 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224339712:12345-0@lo:400: Request processed in 70us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402302.181232:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789402302.181278:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008a260c14 x1876324224339712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402302.181295:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a260c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224339712:0@lo:400: 00000100:00100000:1.0:1789402302.183528:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224339584 00000100:00100000:1.0:1789402302.183551:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224339584 00000100:00100000:1.0:1789402302.183663:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789402302.183673:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce89c178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:3315:x1876324224339584:12345-0@lo:400: 00000100:00100000:1.0:1789402302.183799:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce89c178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:3315:x1876324224339584:12345-0@lo:400: Request processed in 128us (4944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402302.183807:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789402302.183909:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e47d8a07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224339584:0@lo:400: 00000020:00000080:3.0:1789402302.714662:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec9a6ed30 20000000:00000080:3.0:1789402302.714689:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c6fc17e400 uarg=0000000000000000 20000000:01000000:3.0:1789402302.714746:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789402302.714755:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789402302.714761:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789402302.715019:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789402302.715035:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789402302.722794:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789402302.724030:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789402302.724210:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789402302.724690:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789402302.724734:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789402302.724759:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402302.724783:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f78fb expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402302.724791:0:6323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402302.724842:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f78fb expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402302.724861:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f78fb expref: 11 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402302.724879:0:6323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e05d1540 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1876324224339840:0@lo:104: 00000100:00100000:3.0:1789402302.724965:0:6323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402302.725044:0:6323:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ce2088a going to sleep for 11 seconds 00000100:00100000:1.0:1789402302.725171:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224339840 00000100:00100000:1.0:1789402302.725181:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224339840 00000100:00100000:1.0:1789402302.725316:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402302.725327:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fcdb21ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:6323:x1876324224339840:12345-0@lo:104: 00010000:00010000:1.0:1789402302.725382:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.725750:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789402302.725757:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fcdb21ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:6323:x1876324224339840:12345-0@lo:104: Request processed in 432us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402302.725765:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789402302.725875:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402302.725882:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402302.725890:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002db9425f already unused, calling callback (00000000875b593a) 10000000:00010000:2.0:1789402302.725894:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402302.725918:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402302.725926:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402302.725931:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789402302.725976:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402302.725983:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789402302.726034:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007413ce57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224339968:0@lo:103: 00000100:00100000:1.0:1789402302.727174:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789402302.727326:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402302.727407:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: 000000002db9425f/0x9403f4af875f78fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7902 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402302.727929:0:6323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e05d1540 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1876324224339840:0@lo:104: 00000100:00100000:1.0:1789402302.728066:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224339968 00000100:00100000:1.0:1789402302.728146:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224339968 00010000:00010000:1.0:1789402302.728188:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f78fb expref: 12 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402302.728242:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402302.728251:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a52ad0de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:3314:x1876324224339968:12345-0@lo:103: 00010000:00010000:1.0:1789402302.728268:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402302.728285:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f78fb expref: 12 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.728297:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f78fb expref: 12 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.728314:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088de64ad/0x9403f4af875f7902 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f78fb expref: 12 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.728329:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402302.728433:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402302.728438:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402302.728440:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402302.728836:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402302.728878:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.728920:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.728929:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.728935:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.728942:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.729018:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c8d7a9eb already unused, calling callback (000000001cfb8b17) 00010000:00010000:1.0:1789402302.729023:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.729032:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402302.729821:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402302.729833:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.732063:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.732161:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c8d7a9eb/0x9403f4af875f7941 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402302.732187:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402302.737922:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a52ad0de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+11:3314:x1876324224339968:12345-0@lo:103: Request processed in 9657us (10737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402302.737959:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789402302.738201:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007413ce57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224339968:0@lo:103: 00010000:00010000:3.0:1789402302.882893:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402303.907106:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402304.934597:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789402305.765575:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789402305.765583:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6e31a1800 from 1 10000000:01000000:1.0:1789402305.765587:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789402305.765633:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: 000000000398577a/0x9403f4af875f7948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402305.765646:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: 000000000398577a/0x9403f4af875f7948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402305.765657:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: 000000000398577a/0x9403f4af875f7948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402305.765688:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b652183 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224340096:0@lo:101: 00000100:00100000:1.0:1789402305.765754:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402305.765804:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a754c162 going to sleep for 11 seconds 00000100:00100000:0.0:1789402305.765884:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224340096 00000100:00100000:0.0:1789402305.765893:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224340096 00000100:00100000:0.0:1789402305.765943:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789402305.765950:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000450581c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+11:5841:x1876324224340096:12345-0@lo:101: 00010000:00010000:0.0:1789402305.765963:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402305.765973:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c74e588/0x9403f4af875f794f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7948 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402305.766006:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c74e588/0x9403f4af875f794f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7948 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402305.766016:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c74e588/0x9403f4af875f794f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7948 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402305.766026:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c74e588, rc 0) 00000100:00100000:0.0:1789402305.766071:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000450581c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224340096:12345-0@lo:101: Request processed in 121us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402305.766078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789402305.766164:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b652183 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224340096:0@lo:101: 00010000:00010000:3.0:1789402305.766185:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: 000000000398577a/0x9403f4af875f7948 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402305.766193:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: 000000000398577a/0x9403f4af875f7948 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402305.766244:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e05d1540 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224340224:0@lo:501: 00000100:00100000:3.0:1789402305.766271:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402305.766309:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ecc1b3ed going to sleep for 11 seconds 00000100:00100000:1.0:1789402305.766489:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224340224 00000100:00100000:1.0:1789402305.766494:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224340224 00000100:00100000:1.0:1789402305.766527:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789402305.766533:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4b3fb95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224340224:12345-0@lo:501: 00000100:00100000:1.0:1789402305.766777:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4b3fb95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224340224:12345-0@lo:501: Request processed in 244us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402305.766784:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789402305.766821:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e05d1540 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224340224:0@lo:501: 00000100:00100000:1.0:1789402305.766849:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010c8bb96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224340352:0@lo:503: 00000100:00100000:1.0:1789402305.766882:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402305.766894:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8f5ec37 going to sleep for 11 seconds 00000100:00100000:1.0:1789402305.766905:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224340352 00000100:00100000:1.0:1789402305.766908:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224340352 00000100:00100000:1.0:1789402305.766923:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789402305.766928:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000542cce46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224340352:12345-0@lo:503: 00000100:00100000:1.0:1789402305.767030:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000542cce46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224340352:12345-0@lo:503: Request processed in 101us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402305.767037:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789402305.767065:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010c8bb96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224340352:0@lo:503: 00000100:00100000:0.0:1789402305.767626:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097294112 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6541:1876324224340480:0@lo:502: 00000100:00100000:0.0:1789402305.767661:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402305.767698:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8b23ecc going to sleep for 11 seconds 00000100:00100000:3.0:1789402305.767746:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224340480 00000100:00100000:3.0:1789402305.767752:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224340480 00000100:00100000:3.0:1789402305.767786:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789402305.767792:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006495e742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6541:x1876324224340480:12345-0@lo:502: 00000100:00100000:3.0:1789402305.767904:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006495e742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6541:x1876324224340480:12345-0@lo:502: Request processed in 113us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402305.767911:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789402305.768285:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097294112 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6541:1876324224340480:0@lo:502: 00000020:01000000:0.0:1789402305.768308:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402305.768328:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402305.768331:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789402305.768338:0:6541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6e31a1800 00000020:00000080:0.0:1789402305.768365:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789402305.768404:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6541:1876324224340608:0@lo:502: 00000100:00100000:0.0:1789402305.768436:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402305.768454:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e61b3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789402305.768520:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224340608 00000100:00100000:3.0:1789402305.768525:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224340608 00000100:00100000:3.0:1789402305.768546:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789402305.768553:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6541:x1876324224340608:12345-0@lo:502: 00000100:00100000:3.0:1789402305.768647:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6541:x1876324224340608:12345-0@lo:502: Request processed in 94us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402305.768654:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789402305.769523:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6541:1876324224340608:0@lo:502: 00000020:01000000:0.0:1789402305.769550:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402305.769556:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402305.769558:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789402305.769563:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789402305.769728:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789402305.769748:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789402305.769758:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402305.769779:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402305.956414:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402306.978536:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402307.300202:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224340864:0@lo:400: 00000100:00100000:0.0:1789402307.300288:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402307.300370:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789402307.300377:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224340736:0@lo:400: 00000100:00100000:0.0:1789402307.300405:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402307.300437:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224340736 00000100:00100000:0.0:1789402307.300443:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224340736 00000100:00100000:0.0:1789402307.300483:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789402307.300491:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:3316:x1876324224340736:12345-0@lo:400: 00000100:00100000:0.0:1789402307.300538:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:3316:x1876324224340736:12345-0@lo:400: Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402307.300545:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789402307.300596:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224340736:0@lo:400: 00000100:00100000:2.0:1789402307.301956:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224340864 00000100:00100000:2.0:1789402307.301967:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224340864 00000100:00100000:2.0:1789402307.302019:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789402307.302029:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224340864:12345-0@lo:400: 00000100:00100000:2.0:1789402307.302112:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224340864:12345-0@lo:400: Request processed in 84us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402307.302126:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789402307.302172:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c6da97e300 x1876324224340864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402307.302184:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224340864:0@lo:400: 00010000:00010000:2.0:1789402308.002735:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402309.028202:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789402309.624111:0:6687:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789402309.624115:0:6687:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789402309.624251:0:6687:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c6e61ce000 00000020:01000004:1.0:1789402309.624265:0:6687:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789402309.624276:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789402309.624288:0:6687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93c6f1f44d40) 00000020:00000080:1.0:1789402309.624304:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789402309.693917:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789402309.695743:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789402309.738924:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789402309.749990:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789402309.750110:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789402309.750172:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789402309.750282:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789402309.752667:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789402309.752679:0:6687:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789402309.752694:0:6687:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9403f4af875f795d 00000020:01000004:2.0:1789402309.752702:0:6687:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789402309.752725:0:6687:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.108@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789402309.752728:0:6687:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789402309.752739:0:6687:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789402309.752744:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789402309.752755:0:6687:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93c6e3344d40) 00000020:00000080:2.0:1789402309.752769:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789402309.758590:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402309.758786:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789402309.758792:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789402309.765561:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789402309.765575:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789402309.768439:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789402309.768461:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789402309.770271:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789402309.770544:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789402309.770551:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789402309.779083:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789402309.781990:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789402309.817290:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789402309.817949:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789402309.817955:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789402309.823610:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789402309.823625:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789402309.824549:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789402309.824558:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789402309.828116:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402309.831751:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789402309.831760:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789402309.837897:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789402309.837913:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789402309.926661:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402309.926870:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789402309.926877:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789402309.929121:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789402309.929133:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789402309.932071:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789402309.932097:0:6687:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789402309.932104:0:6687:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.108@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789402309.989864:0:6687:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.108@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789402309.989906:0:6687:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.108@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789402309.989909:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789402309.989911:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789402309.989913:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402309.989914:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402309.989915:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402309.989917:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402309.989918:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789402309.989920:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789402309.989921:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789402309.989927:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402309.989929:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789402309.989931:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789402309.989934:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789402309.989935:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789402309.989936:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402309.989937:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402309.989938:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402309.989939:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402309.989940:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789402309.989941:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789402309.989942:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789402309.989943:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402309.989944:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789402309.989972:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789402309.989990:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224340992:0@lo:253: 00000100:00100000:0.0:1789402309.990080:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402309.990485:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402309.995336:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224340992 00000100:00100000:3.0:1789402309.995364:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224340992 00000100:00100000:3.0:1789402309.995430:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789402309.995441:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224340992:12345-0@lo:253: 20000000:01000000:3.0:1789402309.995495:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789402309.995500:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789402309.995505:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789402309.995513:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789402310.008161:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789402310.009009:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789402310.009029:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789402310.009077:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789402310.009085:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789402310.009112:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789402310.009160:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789402310.011331:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789402310.011499:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.108@tcp 20000000:01000000:3.0:1789402310.011501:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.108@tcp (null) (null) (null) 00000040:00080000:3.0:1789402310.011551:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789402310.011559:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789402310.011604:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789402310.011611:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.108@tcp (null) (null) 00000040:00080000:3.0:1789402310.012105:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789402310.012116:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789402310.012145:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789402310.012266:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789402310.015136:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789402310.015284:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.108@tcp 20000000:01000000:2.0:1789402310.015295:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.108@tcp (null) (null) (null) 00000040:00080000:2.0:1789402310.015374:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789402310.015385:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789402310.015420:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789402310.015428:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.108@tcp (null) (null) 00000040:00080000:2.0:1789402310.015575:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789402310.015586:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789402310.015639:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789402310.015808:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789402310.015834:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789402310.015837:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789402310.015841:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789402310.015853:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789402310.015856:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789402310.015889:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789402310.015892:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789402310.017096:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789402310.017546:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789402310.017591:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789402310.017818:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789402310.017835:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789402310.017838:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789402310.020052:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789402310.020153:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789402310.020271:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789402310.020803:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789402310.020843:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789402310.020896:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789402310.020909:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789402310.020911:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789402310.024445:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1789402310.024534:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1789402310.024588:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789402310.025249:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1789402310.025301:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1789402310.025337:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1789402310.025556:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789402310.025559:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789402310.025568:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789402310.025588:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.025611:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c70215f600/0x9403f4af875f7884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f787d expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.025618:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6cb83e400/0x9403f4af875f78a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7899 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.025702:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7909 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.025712:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.025751:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7909 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.025764:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7909 expref: 12 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.025778:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224341120:0@lo:104: 00000100:00100000:2.0:1789402310.025838:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789402310.025949:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6cb83e400/0x9403f4af875f78a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7899 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.025958:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6cb83e400/0x9403f4af875f78a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7899 expref: 12 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.025966:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224341248:0@lo:104: 00000100:00100000:2.0:1789402310.025988:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789402310.026162:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c70215f600/0x9403f4af875f7884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f787d expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.026282:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c70215f600/0x9403f4af875f7884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f787d expref: 12 pid: 5838 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.026291:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224341376:0@lo:104: 00000100:00100000:2.0:1789402310.026315:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.026339:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224341120 00000100:00100000:0.0:1789402310.026365:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224341120 00000100:00100000:0.0:1789402310.026403:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224341248 00000100:00100000:0.0:1789402310.026406:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224341248 00000100:00100000:0.0:1789402310.026419:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789402310.026428:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+4:5838:x1876324224341120:12345-0@lo:104: 00010000:00010000:0.0:1789402310.026441:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e800/0x9403f4af875f7909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026495:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789402310.026502:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+4:5838:x1876324224341120:12345-0@lo:104: Request processed in 75us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.026509:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789402310.026526:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789402310.026532:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5838:x1876324224341248:12345-0@lo:104: 00010000:00010000:0.0:1789402310.026547:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026582:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789402310.026588:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5838:x1876324224341248:12345-0@lo:104: Request processed in 57us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.026593:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789402310.026610:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789402310.026616:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e800/0x9403f4af875f7909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026623:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e800 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402310.026638:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e800/0x9403f4af875f7909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026655:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e800/0x9403f4af875f7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402310.026662:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e800/0x9403f4af875f7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402310.026668:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789402310.026695:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e800/0x9403f4af875f7909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026702:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402310.026725:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e800/0x9403f4af875f7909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026733:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e800/0x9403f4af875f7909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026750:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402310.026753:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026759:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1507200 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402310.026762:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026769:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402310.026776:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402310.026781:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789402310.026794:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026799:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402310.026804:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7899 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026811:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f78a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.026820:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402310.026822:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402310.026823:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402310.026835:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224341504:0@lo:103: 00000100:00100000:0.0:1789402310.026866:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.026887:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402310.026892:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224341632:0@lo:103: 00000100:00100000:0.0:1789402310.026907:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.026941:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224341504 00000100:00100000:0.0:1789402310.026945:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224341504 00010000:00010000:0.0:1789402310.026962:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7909 expref: 13 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402310.026979:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224341632 00000100:00100000:0.0:1789402310.026982:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224341632 00010000:00010000:0.0:1789402310.026990:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6cb83e400/0x9403f4af875f78a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7899 expref: 14 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402310.027011:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789402310.027018:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:3313:x1876324224341504:12345-0@lo:103: 00010000:00010000:0.0:1789402310.027027:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402310.027032:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7909 expref: 14 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.027040:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7909 expref: 14 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.027054:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402310.027078:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:3313:x1876324224341504:12345-0@lo:103: Request processed in 61us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.027084:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789402310.027094:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789402310.027099:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:3313:x1876324224341632:12345-0@lo:103: 00010000:00010000:0.0:1789402310.027113:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402310.027118:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6cb83e400/0x9403f4af875f78a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7899 expref: 13 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.027126:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6cb83e400/0x9403f4af875f78a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7899 expref: 13 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.027134:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402310.027153:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:3313:x1876324224341632:12345-0@lo:103: Request processed in 54us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.027158:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789402310.027205:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224341632:0@lo:103: 00000100:00100000:0.0:1789402310.027213:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224341504:0@lo:103: 00010000:00010000:3.0:1789402310.028114:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402310.028495:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2300 going to sleep for 11 seconds 00010000:00010000:2.0:1789402310.028519:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7909 expref: 12 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.028533:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224341120:0@lo:104: 00010000:00010000:2.0:1789402310.028542:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83e400/0x9403f4af875f78a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7899 expref: 11 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.028550:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224341248:0@lo:104: 00000100:00100000:0.0:1789402310.028608:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224341376 00000100:00100000:0.0:1789402310.028614:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224341376 00000100:00100000:0.0:1789402310.028720:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789402310.028728:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5838:x1876324224341376:12345-0@lo:104: 00010000:00010000:0.0:1789402310.028740:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f787d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.028839:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789402310.028845:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5838:x1876324224341376:12345-0@lo:104: Request processed in 119us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.028851:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789402310.028900:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402310.028907:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f787d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.028914:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83fc00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:3.0:1789402310.028918:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f787d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.028926:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f787d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789402310.028933:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f787d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402310.028950:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789402310.028985:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f787d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.028993:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789402310.029110:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f787d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029118:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f787d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029134:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402310.029135:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402310.029137:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402310.029143:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789402310.029155:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224341760:0@lo:103: 00000100:00100000:3.0:1789402310.029198:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402310.029230:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224341760 00000100:00100000:3.0:1789402310.029234:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224341760 00010000:00010000:3.0:1789402310.029252:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c70215f600/0x9403f4af875f7884 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f787d expref: 11 pid: 5838 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402310.029272:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789402310.029278:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:3316:x1876324224341760:12345-0@lo:103: 00010000:00010000:3.0:1789402310.029287:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402310.029291:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c70215f600/0x9403f4af875f7884 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f787d expref: 11 pid: 5838 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029300:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c70215f600/0x9403f4af875f7884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f787d expref: 11 pid: 5838 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029321:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029329:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029367:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029375:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029382:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029389:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029395:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c70215f000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402310.029399:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029407:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029416:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.029426:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402310.029452:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:3316:x1876324224341760:12345-0@lo:103: Request processed in 174us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402310.029467:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789402310.029495:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224341760:0@lo:103: 00010000:00010000:2.0:1789402310.029776:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215f600/0x9403f4af875f7884 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f787d expref: 10 pid: 5838 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.029788:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224341376:0@lo:104: 00010000:00010000:2.0:1789402310.029806:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.029814:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.029820:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.029826:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215f000/0x9403f4af875f796b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789402310.029846:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1789402310.053284:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402310.097019:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+9:6687:x1876324224340992:12345-0@lo:253: Request processed in 101569us (106929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402310.097034:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789402310.097205:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224340992:0@lo:253: 10000000:01000000:0.0:1789402310.097223:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789402310.097226:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789402310.097242:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789402310.097244:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402310.097245:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789402310.097246:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402310.097247:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402310.097249:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789402310.097250:0:6687:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789402310.097251:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402310.097253:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789402310.097274:0:6687:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c6e61ce000 from lustre-OST0000 10000000:01000000:0.0:1789402310.097301:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789402310.097305:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789402310.097312:0:6687:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c6c99019c0 local copy 10000000:01000000:0.0:1789402310.097316:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789402310.097377:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.097388:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.097398:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402310.097417:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224341888:0@lo:101: 00000100:00100000:0.0:1789402310.097454:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.097549:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789402310.097778:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224341888 00000100:00100000:1.0:1789402310.097785:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224341888 00000100:00100000:1.0:1789402310.097829:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789402310.097838:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+9:6687:x1876324224341888:12345-0@lo:101: 00010000:00010000:1.0:1789402310.097851:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402310.097865:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7972 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.097888:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7972 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.097898:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7972 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.097907:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83ec00, rc 0) 00000100:00100000:1.0:1789402310.097940:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+10:6687:x1876324224341888:12345-0@lo:101: Request processed in 103us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402310.097946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789402310.098207:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224341888:0@lo:101: 00010000:00010000:2.0:1789402310.098219:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.098229:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.098322:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342016:0@lo:501: 00000100:00100000:2.0:1789402310.098369:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402310.098441:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2300 going to sleep for 11 seconds 00000100:00100000:1.0:1789402310.098598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224342016 00000100:00100000:1.0:1789402310.098603:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224342016 00000100:00100000:1.0:1789402310.098734:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789402310.098743:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+10:6687:x1876324224342016:12345-0@lo:501: 00000100:00100000:1.0:1789402310.098962:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+10:6687:x1876324224342016:12345-0@lo:501: Request processed in 219us (591us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789402310.098969:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789402310.099034:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342016:0@lo:501: 10000000:01000000:2.0:1789402310.099047:0:6687:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789402310.099071:0:6687:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789402310.099077:0:6687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.099085:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.099093:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.099116:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789402310.099140:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c6e61ce000 10000000:01000000:2.0:1789402310.099145:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789402310.099149:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93c6c99019c0 10000000:01000000:2.0:1789402310.099152:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789402310.099155:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93c6c99019c0 from 1 10000000:01000000:2.0:1789402310.099157:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789402310.099192:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.099201:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.099208:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.099223:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342144:0@lo:101: 00000100:00100000:2.0:1789402310.099248:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789402310.099387:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402310.099394:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.099402:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402310.099405:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.099425:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402310.099432:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402310.099437:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789402310.099457:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.099463:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402310.099484:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.099490:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9403f4af875f7979 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.099505:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402310.099506:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402310.099508:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402310.099515:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402310.099525:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224342272:0@lo:103: 00000100:00100000:0.0:1789402310.099552:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.099587:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224342272 00000100:00100000:0.0:1789402310.099592:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224342272 00000100:00100000:0.0:1789402310.099654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402310.099663:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+10:3315:x1876324224342272:12345-0@lo:103: 00010000:00010000:0.0:1789402310.099674:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402310.099688:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7972 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.099710:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402310.099743:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+9:3315:x1876324224342272:12345-0@lo:103: Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.099750:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402310.099780:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224342272:0@lo:103: 00000100:00100000:2.0:1789402310.100560:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789402310.103340:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224342144 00000100:00100000:3.0:1789402310.103383:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224342144 00000100:00100000:3.0:1789402310.103439:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789402310.103448:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+9:6687:x1876324224342144:12345-0@lo:101: 00010000:00010000:3.0:1789402310.103465:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402310.103485:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1506a00/0x9403f4af875f7987 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7980 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.103513:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506a00/0x9403f4af875f7987 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7980 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.103523:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1506a00/0x9403f4af875f7987 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7980 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.103531:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1506a00, rc 0) 00000100:00100000:3.0:1789402310.103598:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+10:6687:x1876324224342144:12345-0@lo:101: Request processed in 150us (4348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402310.103605:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789402310.103781:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342144:0@lo:101: 00010000:00010000:2.0:1789402310.103799:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7987 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.103810:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7987 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402310.103832:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789402310.103850:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7987 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.103859:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7987 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402310.103879:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789402310.103883:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789402310.103889:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789402310.103892:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789402310.103918:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.103926:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.103935:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.103954:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342400:0@lo:101: 00000100:00100000:2.0:1789402310.103988:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402310.104013:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789402310.104068:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224342400 00000100:00100000:3.0:1789402310.104073:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224342400 00000100:00100000:3.0:1789402310.104090:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789402310.104097:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+10:6687:x1876324224342400:12345-0@lo:101: 00010000:00010000:3.0:1789402310.104104:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402310.104113:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f798e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.104132:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f798e expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.104141:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f798e expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.104147:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1506200, rc 0) 00000100:00100000:3.0:1789402310.104312:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224342400:12345-0@lo:101: Request processed in 215us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402310.104318:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789402310.104441:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342400:0@lo:101: 00010000:00010000:2.0:1789402310.104452:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.104460:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.104549:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342528:0@lo:501: 00000100:00100000:2.0:1789402310.104576:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402310.104600:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789402310.104721:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224342528 00000100:00100000:3.0:1789402310.104726:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224342528 00000100:00100000:3.0:1789402310.104744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789402310.104750:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224342528:12345-0@lo:501: 00000100:00100000:3.0:1789402310.105590:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224342528:12345-0@lo:501: Request processed in 836us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402310.105599:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789402310.106738:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342528:0@lo:501: 00000100:00100000:0.0:1789402310.106874:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342656:0@lo:503: 00000100:00100000:0.0:1789402310.106940:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.106977:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789402310.107034:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224342656 00000100:00100000:3.0:1789402310.107040:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224342656 00000100:00100000:3.0:1789402310.107107:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789402310.107117:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224342656:12345-0@lo:503: 00000100:00100000:3.0:1789402310.107442:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224342656:12345-0@lo:503: Request processed in 326us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402310.107460:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789402310.107546:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342656:0@lo:503: 00000040:00080000:1.0:1789402310.107863:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789402310.107922:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342784:0@lo:502: 00000100:00100000:1.0:1789402310.107966:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402310.108391:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d11d83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402310.108928:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224342784 00000100:00100000:0.0:1789402310.108936:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224342784 00000100:00100000:0.0:1789402310.108971:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789402310.108979:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224342784:12345-0@lo:502: 00000100:00100000:0.0:1789402310.109287:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224342784:12345-0@lo:502: Request processed in 308us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.109295:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789402310.109704:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342784:0@lo:502: 00000040:00080000:1.0:1789402310.110120:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789402310.110309:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789402310.110603:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789402310.110753:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789402310.110789:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789402310.110822:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789402310.110862:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342912:0@lo:502: 00000100:00100000:0.0:1789402310.110923:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.111020:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75f180 going to sleep for 11 seconds 00000100:00100000:2.0:1789402310.111067:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224342912 00000100:00100000:2.0:1789402310.111075:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224342912 00000100:00100000:2.0:1789402310.111289:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789402310.111300:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224342912:12345-0@lo:502: 00000100:00100000:2.0:1789402310.111882:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224342912:12345-0@lo:502: Request processed in 583us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402310.111891:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789402310.111983:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224342912:0@lo:502: 00000040:00080000:0.0:1789402310.112101:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789402310.112115:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1789402310.112842:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789402310.112857:0:6704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789402310.112863:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402310.112866:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789402310.112871:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789402310.112884:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93c6c9903380) 00000020:00000080:0.0:1789402310.112904:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789402310.112908:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789402310.112976:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6e61ce000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789402310.112984:0:6704:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789402310.112991:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9403f4af875f79a3 00010000:00010000:0.0:1789402310.121795:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1789402310.122125:0:6704:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789402310.126798:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789402310.127100:0:6704:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789402310.137987:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789402310.138923:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789402310.140409:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789402310.140422:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402310.140428:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402310.140436:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789402310.140441:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402310.140444:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402310.140446:0:6704:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789402310.140449:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789402310.140737:0:6704:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789402310.140794:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402310.140798:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402310.140799:0:6704:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789402310.140802:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789402310.140943:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789402310.140967:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789402310.140989:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.141002:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402310.141011:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6e61ce000 from 1 10000000:01000000:1.0:1789402310.141014:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789402310.141050:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.141058:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.141068:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402310.141090:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343040:0@lo:101: 00000100:00100000:1.0:1789402310.141163:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402310.141220:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c4de4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789402310.141244:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224343040 00000100:00100000:1.0:1789402310.141250:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224343040 00000100:00100000:1.0:1789402310.141293:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789402310.141302:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+11:6687:x1876324224343040:12345-0@lo:101: 00010000:00010000:1.0:1789402310.141315:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402310.141326:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f79aa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.141382:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f79aa expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.141393:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79aa expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.141401:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e600, rc 0) 00000100:00100000:1.0:1789402310.141438:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343040:12345-0@lo:101: Request processed in 137us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402310.141444:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789402310.141493:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343040:0@lo:101: 00010000:00010000:1.0:1789402310.141508:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.141517:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402310.141596:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343168:0@lo:501: 00000100:00100000:1.0:1789402310.141923:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402310.141944:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c4de4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789402310.141959:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224343168 00000100:00100000:1.0:1789402310.141963:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224343168 00000100:00100000:1.0:1789402310.141999:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789402310.142006:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343168:12345-0@lo:501: 00000100:00100000:1.0:1789402310.143987:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343168:12345-0@lo:501: Request processed in 1972us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402310.143999:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789402310.144070:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343168:0@lo:501: 00000100:00100000:1.0:1789402310.144121:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343296:0@lo:503: 00000100:00100000:1.0:1789402310.145491:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402310.146707:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c4de4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789402310.146743:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224343296 00000100:00100000:1.0:1789402310.146752:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224343296 00000100:00100000:3.0:1789402310.147447:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789402310.147461:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343296:12345-0@lo:503: 00000100:00100000:3.0:1789402310.147802:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343296:12345-0@lo:503: Request processed in 345us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402310.147811:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789402310.148680:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343296:0@lo:503: 00000040:00080000:0.0:1789402310.149004:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789402310.149081:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343424:0@lo:502: 00000100:00100000:0.0:1789402310.149138:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.149179:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c4de4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402310.149433:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224343424 00000100:00100000:0.0:1789402310.149440:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224343424 00000100:00100000:0.0:1789402310.149494:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789402310.149503:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343424:12345-0@lo:502: 00000100:00100000:0.0:1789402310.149721:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343424:12345-0@lo:502: Request processed in 218us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.149729:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789402310.149782:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343424:0@lo:502: 00000040:00080000:0.0:1789402310.150119:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789402310.153810:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789402310.153882:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343552:0@lo:502: 00000100:00100000:0.0:1789402310.153967:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.154016:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402310.154072:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224343552 00000100:00100000:1.0:1789402310.154080:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224343552 00000100:00100000:1.0:1789402310.154129:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789402310.154138:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343552:12345-0@lo:502: 00000100:00100000:1.0:1789402310.154808:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343552:12345-0@lo:502: Request processed in 669us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402310.154817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789402310.154896:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343552:0@lo:502: 00000040:00080000:0.0:1789402310.155017:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789402310.155029:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789402310.157974:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789402310.157987:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402310.157989:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789402310.157996:0:6708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6e61ce000 00000020:00000080:1.0:1789402310.157998:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789402310.158019:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789402310.158035:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402310.158036:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789402310.158040:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789402310.158301:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789402310.158327:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789402310.158453:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.158467:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402310.158505:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789402310.158508:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c6e61ce000 10000000:01000000:0.0:1789402310.158511:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c6e61ce000 10000000:01000000:0.0:1789402310.158514:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789402310.158519:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6e61ce000 from 1 10000000:01000000:0.0:1789402310.158521:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789402310.158555:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.158560:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402310.158569:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402310.158585:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343680:0@lo:101: 00000100:00100000:0.0:1789402310.158633:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.158688:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e10000 going to sleep for 11 seconds 00000100:00100000:1.0:1789402310.158778:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224343680 00000100:00100000:1.0:1789402310.158786:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224343680 00000100:00100000:1.0:1789402310.158881:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789402310.158892:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224343680:12345-0@lo:101: 00010000:00010000:1.0:1789402310.158904:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402310.158915:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f79b8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.158937:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f79b8 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.158946:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79b8 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402310.158953:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83f400, rc 0) 00000100:00100000:1.0:1789402310.159072:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224343680:12345-0@lo:101: Request processed in 182us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402310.159078:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789402310.159132:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343680:0@lo:101: 00010000:00010000:2.0:1789402310.159145:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.159152:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.159240:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343808:0@lo:501: 00000100:00100000:2.0:1789402310.159268:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402310.159294:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402310.159325:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224343808 00000100:00100000:0.0:1789402310.159329:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224343808 00000100:00100000:0.0:1789402310.159395:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789402310.159402:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224343808:12345-0@lo:501: 00000100:00100000:0.0:1789402310.159657:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224343808:12345-0@lo:501: Request processed in 254us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.159668:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789402310.159739:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343808:0@lo:501: 00000100:00100000:2.0:1789402310.159768:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343936:0@lo:503: 00000100:00100000:2.0:1789402310.159804:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402310.159859:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402310.159898:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224343936 00000100:00100000:3.0:1789402310.159903:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224343936 00000100:00100000:3.0:1789402310.159933:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789402310.159940:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224343936:12345-0@lo:503: 00000100:00100000:3.0:1789402310.160414:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224343936:12345-0@lo:503: Request processed in 473us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402310.160422:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789402310.160449:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224343936:0@lo:503: 00000040:00080000:2.0:1789402310.160782:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789402310.160850:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224344064:0@lo:502: 00000100:00100000:2.0:1789402310.160877:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402310.160980:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402310.161062:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224344064 00000100:00100000:0.0:1789402310.161066:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224344064 00000100:00100000:0.0:1789402310.161116:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789402310.161121:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224344064:12345-0@lo:502: 00000100:00100000:0.0:1789402310.161439:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224344064:12345-0@lo:502: Request processed in 316us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.161447:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789402310.161457:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224344064:0@lo:502: 00000040:00080000:2.0:1789402310.161671:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789402310.161783:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789402310.161801:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789402310.161826:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789402310.161844:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789402310.161866:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789402310.161882:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789402310.161898:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789402310.161919:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789402310.161936:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789402310.161951:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789402310.161981:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789402310.162069:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789402310.162101:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789402310.162133:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789402310.162151:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789402310.162170:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789402310.162277:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789402310.162316:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789402310.162405:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789402310.162458:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789402310.162495:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789402310.162529:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789402310.162575:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789402310.162610:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789402310.162655:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789402310.167662:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789402310.167739:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789402310.167789:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224344192:0@lo:502: 00000100:00100000:3.0:1789402310.167864:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402310.167911:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e31480 going to sleep for 11 seconds 00000100:00100000:0.0:1789402310.168156:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224344192 00000100:00100000:0.0:1789402310.168165:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224344192 00000100:00100000:0.0:1789402310.168230:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789402310.168240:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224344192:12345-0@lo:502: 00000100:00100000:0.0:1789402310.168482:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224344192:12345-0@lo:502: Request processed in 242us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.168490:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789402310.170853:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224344192:0@lo:502: 00000040:00080000:3.0:1789402310.171010:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789402310.171036:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789402310.173900:0:6709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789402310.173918:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93c6f1f43380) 00000020:00000080:1.0:1789402310.173939:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1789402310.174017:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6e61ce000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789402310.174020:0:6709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6e61ce000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789402310.174023:0:6709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6e61ce000 3 00010000:00080000:1.0:1789402310.174054:0:6709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c6e0b14000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.108@tcp at head 00010000:00010000:1.0:1789402310.176837:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789402310.180843:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789402310.180914:0:6709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789402310.180929:0:6709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9403f4af875f79cd 00000100:00080000:1.0:1789402310.180940:0:6709:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789402310.180952:0:6709:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93c6e0b14000 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:1.0:1789402310.180987:0:6709:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6fa974a80 x1876324224344320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789402310.184760:0:6709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789402310.184834:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876324224344320:0@lo:38: 00000100:00100000:2.0:1789402310.184909:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402310.185050:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224344320 00000100:00100000:1.0:1789402310.185058:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224344320 00000100:00100000:1.0:1789402310.185098:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789402310.185105:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876324224344320:12345-0@lo:38: 00010000:00080000:1.0:1789402310.185132:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1789402310.185188:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9403f4af875f79d4 00000004:00100000:1.0:1789402310.185204:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789402310.185236:0:5846:0:(import.c:65:import_set_state_nolock()) ffff93c6ffa20800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402310.185291:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876324224344320:12345-0@lo:38: Request processed in 184us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402310.185298:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789402310.185366:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c6fa974a80 x1876324224344320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789402320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402310.185376:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789402310.185383:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789402310.185390:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789402310.185394:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789402310.185396:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6e0b14000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789402310.185402:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876324224344320:0@lo:38: 00000100:00100000:2.0:1789402310.187088:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789402310.187113:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224344448:0@lo:400: 00000100:00100000:2.0:1789402310.187164:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402310.187696:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224344448 00000100:00100000:0.0:1789402310.187704:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224344448 00000100:00100000:0.0:1789402310.187751:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789402310.187756:0:5846:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789402310.187760:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224344448:12345-0@lo:400: 00000100:00100000:2.0:1789402310.187764:0:5846:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789402310.187822:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224344448:12345-0@lo:400: Request processed in 62us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402310.187830:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789402310.188105:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c6f7ee1880 x1876324224344448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402310.188120:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224344448:0@lo:400: 00000040:00080000:1.0:1789402310.191228:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1789402310.193326:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789402310.193430:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789402310.193453:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.193466:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789402310.193510:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789402310.193512:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789402310.193513:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402310.193515:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402310.193516:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402310.193517:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402310.193519:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402310.193520:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789402310.193522:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789402310.193523:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402310.193525:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789402310.193528:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789402310.193531:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789402310.193532:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789402310.193533:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402310.193534:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402310.193535:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402310.193537:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402310.193538:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402310.193539:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789402310.193591:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789402310.193592:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402310.193593:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789402310.193620:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789402310.193636:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224344576:0@lo:253: 00000100:00100000:3.0:1789402310.193763:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402310.193808:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402310.193892:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224344576 00000100:00100000:0.0:1789402310.193899:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224344576 00000100:00100000:0.0:1789402310.193952:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789402310.193962:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6687:x1876324224344576:12345-0@lo:253: 20000000:01000000:0.0:1789402310.193989:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789402310.194147:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789402310.246756:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789402310.246778:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789402310.246825:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789402310.246830:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789402310.246852:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.246869:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c70215f200/0x9403f4af875f793a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7933 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.246878:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.246918:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c70215f200/0x9403f4af875f793a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7933 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402310.246932:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c70215f200/0x9403f4af875f793a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7933 expref: 13 pid: 5839 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402310.246947:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876324224344704:0@lo:104: 00000100:00100000:3.0:1789402310.247002:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402310.247150:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e31d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789402310.248362:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224344704 00000100:00100000:2.0:1789402310.248373:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224344704 00000100:00100000:2.0:1789402310.248424:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789402310.248433:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5860:x1876324224344704:12345-0@lo:104: 00010000:00010000:2.0:1789402310.248448:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82200/0x9403f4af875f7933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.248513:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789402310.248519:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5860:x1876324224344704:12345-0@lo:104: Request processed in 87us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402310.248525:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789402310.248613:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402310.248619:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82200/0x9403f4af875f7933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.248627:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82200 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402310.248631:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82200/0x9403f4af875f7933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.248648:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82200/0x9403f4af875f7933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402310.248670:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82200/0x9403f4af875f7933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402310.248676:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789402310.257043:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876324224344704:0@lo:104: 00010000:00010000:0.0:1789402310.257075:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.257595:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82200/0x9403f4af875f7933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.257605:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402310.257625:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82200/0x9403f4af875f7933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.257634:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82200/0x9403f4af875f7933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f793a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.257663:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402310.257666:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402310.257668:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402310.257730:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402310.257748:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224344832:0@lo:103: 00000100:00100000:1.0:1789402310.257814:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402310.259484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224344832 00000100:00100000:2.0:1789402310.259496:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224344832 00010000:00010000:2.0:1789402310.259528:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c70215f200/0x9403f4af875f793a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7933 expref: 14 pid: 5839 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402310.259560:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789402310.259568:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:3313:x1876324224344832:12345-0@lo:103: 00010000:00010000:2.0:1789402310.259582:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402310.259587:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c70215f200/0x9403f4af875f793a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7933 expref: 14 pid: 5839 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259598:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c70215f200/0x9403f4af875f793a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7933 expref: 14 pid: 5839 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259627:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215f200/0x9403f4af875f793a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7933 expref: 14 pid: 5839 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259654:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259663:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789402310.259677:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012847911s 00010000:00010000:2.0:1789402310.259682:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259690:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259697:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259705:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259711:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1506400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402310.259715:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259723:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259737:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259757:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402310.259820:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:3313:x1876324224344832:12345-0@lo:103: Request processed in 252us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402310.259827:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789402310.259899:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224344832:0@lo:103: 00010000:00010000:2.0:1789402310.259921:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259930:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402310.259937:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506400/0x9403f4af875f79db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402310.263104:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:6687:x1876324224344576:12345-0@lo:253: Request processed in 69136us (69333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402310.263119:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789402310.263218:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:6687:1876324224344576:0@lo:253: 10000000:01000000:3.0:1789402310.263235:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789402310.263238:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789402310.263240:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789402310.263242:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402310.263243:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402310.263244:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402310.263246:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402310.263248:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402310.263250:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789402310.263251:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789402310.263253:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402310.263254:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789402310.263282:0:6687:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789402310.268149:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402310.268479:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789402310.268693:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402310.268902:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789402310.269148:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402310.269493:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789402310.275822:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789402310.467776:0:6687:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789402310.467782:0:6687:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789402310.467815:0:6687:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789402310.467872:0:6687:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.108@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789402310.467886:0:6687:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789402310.467912:0:6687:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789402311.075141:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402312.101054:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789402313.060825:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789402313.060833:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6e31a1800 from 21 10000000:01000000:0.0:1789402313.060839:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789402313.060883:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402313.060893:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402313.060904:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402313.060928:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224344960:0@lo:101: 00000100:00100000:0.0:1789402313.061157:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402313.061327:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402313.064140:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224344960 00000100:00100000:2.0:1789402313.064154:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224344960 00000100:00100000:2.0:1789402313.064222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789402313.064233:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224344960:12345-0@lo:101: 00010000:00010000:2.0:1789402313.064250:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402313.064281:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f79e2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402313.064309:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f79e2 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402313.064321:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79e2 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402313.064330:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215f800, rc 0) 00000100:00100000:2.0:1789402313.064646:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224344960:12345-0@lo:101: Request processed in 413us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402313.064653:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789402313.064746:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224344960:0@lo:101: 00010000:00010000:0.0:1789402313.064765:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402313.064786:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402313.064852:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345088:0@lo:501: 00000100:00100000:0.0:1789402313.064883:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402313.064922:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402313.065038:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224345088 00000100:00100000:2.0:1789402313.065043:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224345088 00000100:00100000:2.0:1789402313.065072:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789402313.065079:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224345088:12345-0@lo:501: 00000100:00100000:2.0:1789402313.066057:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224345088:12345-0@lo:501: Request processed in 972us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402313.066068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789402313.066569:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345088:0@lo:501: 00000100:00100000:3.0:1789402313.066616:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345216:0@lo:503: 00000100:00100000:3.0:1789402313.066678:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402313.066702:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402313.066750:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224345216 00000100:00100000:2.0:1789402313.066757:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224345216 00000100:00100000:2.0:1789402313.068794:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789402313.068815:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224345216:12345-0@lo:503: 00000100:00100000:2.0:1789402313.069218:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224345216:12345-0@lo:503: Request processed in 410us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402313.069227:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789402313.069439:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345216:0@lo:503: 00000100:00100000:1.0:1789402313.092557:0:6833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6833:1876324224345344:0@lo:502: 00000100:00100000:1.0:1789402313.092658:0:6833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402313.092741:0:6833:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402313.098565:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224345344 00000100:00100000:3.0:1789402313.098579:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224345344 00000100:00100000:3.0:1789402313.098644:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789402313.098655:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6833:x1876324224345344:12345-0@lo:502: 00000100:00100000:3.0:1789402313.099479:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6833:x1876324224345344:12345-0@lo:502: Request processed in 823us (6817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402313.099489:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789402313.111543:0:6833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6833:1876324224345344:0@lo:502: 00000100:00100000:2.0:1789402313.111652:0:6833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6833:1876324224345472:0@lo:502: 00000100:00100000:2.0:1789402313.111719:0:6833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402313.111767:0:6833:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d8318780 going to sleep for 11 seconds 00000100:00100000:3.0:1789402313.111867:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224345472 00000100:00100000:3.0:1789402313.111875:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224345472 00000100:00100000:3.0:1789402313.111925:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789402313.111934:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6833:x1876324224345472:12345-0@lo:502: 00000100:00100000:3.0:1789402313.112414:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:6833:x1876324224345472:12345-0@lo:502: Request processed in 479us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402313.112424:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789402313.114298:0:6833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6833:1876324224345472:0@lo:502: 00000040:00080000:2.0:1789402313.115054:0:6833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789402313.115238:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789402313.115263:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789402313.115274:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402313.115290:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402313.115300:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789402313.115302:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6e31a1800 from 4 10000000:01000000:1.0:1789402313.115305:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789402313.115367:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402313.115376:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402313.115385:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402313.115415:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345600:0@lo:101: 00000100:00100000:1.0:1789402313.115469:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402313.115510:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a42480 going to sleep for 11 seconds 00000100:00100000:3.0:1789402313.115574:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224345600 00000100:00100000:3.0:1789402313.115583:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224345600 00000100:00100000:3.0:1789402313.115636:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789402313.115645:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224345600:12345-0@lo:101: 00010000:00010000:3.0:1789402313.115663:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402313.115675:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.115697:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f79f0 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.115707:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79f0 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.115715:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1506600, rc 0) 00000100:00100000:3.0:1789402313.115753:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224345600:12345-0@lo:101: Request processed in 109us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402313.115759:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789402313.115794:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345600:0@lo:101: 00010000:00010000:3.0:1789402313.115806:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.115814:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402313.115859:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345728:0@lo:256: 00000100:00100000:3.0:1789402313.115886:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402313.115898:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789402313.115910:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224345728 00000100:00100000:3.0:1789402313.115913:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224345728 00000100:00100000:3.0:1789402313.115932:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789402313.115938:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224345728:12345-0@lo:256: 20000000:01000000:3.0:1789402313.115958:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789402313.115984:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789402313.115988:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789402313.116055:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224345728:12345-0@lo:256: Request processed in 116us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402313.116062:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789402313.116090:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345728:0@lo:256: 10000000:01000000:3.0:1789402313.116127:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789402313.116132:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.116139:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402313.116145:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789402313.116147:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789402313.116271:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789402313.116288:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.116295:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.116302:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402313.116313:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345856:0@lo:101: 00000100:00100000:3.0:1789402313.116336:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402313.116372:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789402313.116389:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224345856 00000100:00100000:3.0:1789402313.116393:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224345856 00000100:00100000:3.0:1789402313.116408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789402313.116413:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224345856:12345-0@lo:101: 00010000:00010000:3.0:1789402313.116420:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402313.116427:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f79fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.116440:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f79fe expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.116448:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79fe expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.116455:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1507e00, rc 0) 00000100:00100000:3.0:1789402313.116479:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224345856:12345-0@lo:101: Request processed in 66us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402313.116485:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789402313.116510:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345856:0@lo:101: 00010000:00010000:3.0:1789402313.116520:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.116528:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402313.116564:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345984:0@lo:501: 00000100:00100000:3.0:1789402313.116584:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402313.116596:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789402313.116605:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224345984 00000100:00100000:3.0:1789402313.116614:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224345984 00000100:00100000:3.0:1789402313.116642:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789402313.116648:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224345984:12345-0@lo:501: 00000100:00100000:3.0:1789402313.116861:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224345984:12345-0@lo:501: Request processed in 212us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402313.116868:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789402313.116891:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224345984:0@lo:501: 00000100:00100000:3.0:1789402313.116913:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224346112:0@lo:503: 00000100:00100000:3.0:1789402313.116952:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402313.117036:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789402313.117049:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224346112 00000100:00100000:3.0:1789402313.117052:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224346112 00000100:00100000:3.0:1789402313.117068:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789402313.117073:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224346112:12345-0@lo:503: 00000100:00100000:3.0:1789402313.117538:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224346112:12345-0@lo:503: Request processed in 463us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402313.117547:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789402313.117715:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224346112:0@lo:503: 00000100:00100000:2.0:1789402313.125613:0:6836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6836:1876324224346240:0@lo:502: 00000100:00100000:2.0:1789402313.125704:0:6836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402313.125747:0:6836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d8318240 going to sleep for 11 seconds 00000100:00100000:0.0:1789402313.127175:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224346240 00000100:00100000:0.0:1789402313.127187:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224346240 00000100:00100000:0.0:1789402313.127233:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789402313.127242:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:6836:x1876324224346240:12345-0@lo:502: 00000100:00100000:0.0:1789402313.127558:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:6836:x1876324224346240:12345-0@lo:502: Request processed in 316us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402313.127566:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789402313.129698:0:6836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6836:1876324224346240:0@lo:502: 00000020:01000000:3.0:1789402313.129741:0:6836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789402313.129749:0:6836:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789402313.129757:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402313.129760:0:6836:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789402313.129765:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789402313.129770:0:6836:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.108@tcp to nid 0x20000c0a8cb6c (192.168.203.108@tcp) 00000020:01000000:3.0:1789402313.129793:0:6836:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789402313.129796:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789402313.129824:0:6836:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93c6d8b1cd40) 00000020:00000080:3.0:1789402313.129848:0:6836:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789402313.129855:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789402313.129933:0:6836:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789402313.129939:0:6836:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789402313.129945:0:6836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f7a13 00010000:00080000:3.0:1789402313.129986:0:6836:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c6d16c6800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.108@tcp at head 00010000:00010000:3.0:1789402313.130327:0:6836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:2.0:1789402313.148983:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789402313.205092:0:6836:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789402313.205115:0:6836:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789402313.206639:0:6836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789402313.206806:0:6836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789402313.206857:0:6836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789402313.206912:0:6836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789402313.208649:0:6841:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789402313.208655:0:6841:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789402313.209736:0:6836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789402313.209748:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789402313.209779:0:6836:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789402313.209799:0:6836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f7a1a 00000100:00080000:3.0:1789402313.209810:0:6836:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789402313.209822:0:6836:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c6d16c6800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:3.0:1789402313.209859:0:6836:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6c998a300 x1876324224346368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789402313.209879:0:6836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789402313.209931:0:6836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402313.209935:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402313.209937:0:6836:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789402313.209940:0:6836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402313.209944:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402313.209945:0:6836:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789402313.209948:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789402313.209950:0:6836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789402313.210146:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224346624:0@lo:400: 00000100:00100000:0.0:1789402313.210218:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402313.210265:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402313.210271:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224346752:0@lo:400: 00000100:00100000:0.0:1789402313.210293:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402313.210322:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224346624 00000100:00100000:0.0:1789402313.210328:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224346624 00000100:00100000:0.0:1789402313.210382:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224346752 00000100:00100000:0.0:1789402313.210385:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224346752 00000100:00100000:0.0:1789402313.210413:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789402313.210422:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224346624:12345-0@lo:400: 00000100:00100000:0.0:1789402313.210471:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224346624:12345-0@lo:400: Request processed in 48us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402313.210488:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789402313.210502:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789402313.210508:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224346752:12345-0@lo:400: 00000100:00100000:0.0:1789402313.210535:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224346752:12345-0@lo:400: Request processed in 27us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402313.210541:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789402313.210573:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee3800 x1876324224346752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402313.210586:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224346752:0@lo:400: 00010000:00080000:0.0:1789402313.210595:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee2300 x1876324224346624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402313.210602:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224346624:0@lo:400: 00000100:00100000:3.0:1789402313.210749:0:6836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6836:1876324224346496:0@lo:502: 00000100:00100000:3.0:1789402313.210795:0:6836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402313.210826:0:6836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ffa0a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789402313.210920:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224346368:0@lo:8: 00000100:00100000:1.0:1789402313.210953:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402313.211128:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224346496 00000100:00100000:0.0:1789402313.211134:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224346496 00000100:00100000:0.0:1789402313.211172:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789402313.211179:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+15:6836:x1876324224346496:12345-0@lo:502: 00000100:00100000:0.0:1789402313.211399:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+15:6836:x1876324224346496:12345-0@lo:502: Request processed in 220us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402313.211406:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789402313.211572:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224346368 00000100:00100000:3.0:1789402313.211577:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224346368 00000100:00100000:3.0:1789402313.211602:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789402313.211606:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1876324224346368:12345-0@lo:8: 00010000:00080000:3.0:1789402313.211636:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:3.0:1789402313.211663:0:6689:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f7a21 00002000:00100000:3.0:1789402313.211696:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93c6fa966800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789402313.211700:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789402313.211704:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789402313.211807:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789402313.211938:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789402313.211977:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93c6fc621000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789402313.212229:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876324224346368:12345-0@lo:8: Request processed in 621us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402313.212237:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789402313.212271:0:6836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:6836:1876324224346496:0@lo:502: 00000020:01000000:3.0:1789402313.212306:0:6836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402313.212312:0:6836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402313.212315:0:6836:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789402313.212319:0:6836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00010000:00080000:1.0:1789402313.212526:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6c998a300 x1876324224346368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789402323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402313.212536:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789402313.212542:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789402313.212549:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789402313.212554:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789402313.212556:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6d16c6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789402313.212568:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789402313.212572:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224346368:0@lo:8: 00000020:01000000:0.0:1789402313.212689:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789402313.212708:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789402313.212718:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402313.212728:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402313.212744:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789402313.212747:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c6c99019c0 from 1 10000000:01000000:0.0:1789402313.212749:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789402313.212778:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402313.212786:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402313.212795:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402313.212811:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224346880:0@lo:101: 00000100:00100000:0.0:1789402313.212848:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402313.212878:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789402313.213087:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224346880 00000100:00100000:3.0:1789402313.213093:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224346880 00000100:00100000:3.0:1789402313.213168:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789402313.213176:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224346880:12345-0@lo:101: 00010000:00010000:3.0:1789402313.213186:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402313.213204:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7a28 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.213227:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7a28 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.213237:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7a28 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402313.213245:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1506000, rc 0) 00000100:00100000:3.0:1789402313.213280:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224346880:12345-0@lo:101: Request processed in 106us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402313.213287:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789402313.213421:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789402313.213601:0:6841:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789402313.213719:0:6841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 218362374860ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789402313.220358:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224346880:0@lo:101: 00010000:00010000:2.0:1789402313.220392:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402313.220406:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402313.220485:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224347008:0@lo:501: 00000100:00100000:2.0:1789402313.220544:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402313.220579:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1789402313.221312:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224347008 00000100:00100000:1.0:1789402313.221321:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224347008 00000100:00100000:1.0:1789402313.221389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789402313.221400:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224347008:12345-0@lo:501: 00000100:00100000:1.0:1789402313.223904:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224347008:12345-0@lo:501: Request processed in 219us (1072us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789402313.223925:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789402313.224123:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224347008:0@lo:501: 10000000:01000000:1.0:1789402313.224217:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789402313.224227:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402313.224247:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789402313.282528:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789402313.282707:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402313.282724:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224347136:0@lo:13: 00000100:00100000:3.0:1789402313.282788:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789402313.282840:0:6842:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789402313.282860:0:6842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6842:1876324224347264:0@lo:7: 00000100:00100000:3.0:1789402313.282884:0:6842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402313.282901:0:6842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ffa0a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402313.282986:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224347136 00000100:00100000:1.0:1789402313.282994:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224347136 00000100:00100000:1.0:1789402313.283203:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402313.283215:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224347136:12345-0@lo:13: 00002000:00000024:1.0:1789402313.283246:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:2.0:1789402313.283265:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402313.283338:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224347136:12345-0@lo:13: Request processed in 127us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402313.283419:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224347264 00000100:00100000:0.0:1789402313.283423:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224347264 00000100:00100000:0.0:1789402313.283463:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789402313.283471:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6842:x1876324224347264:12345-0@lo:7: 00000100:00100000:1.0:1789402313.286829:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789402313.287684:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6c998b800 x1876324224347136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402313.287711:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224347136:0@lo:13: 00002000:00080000:1.0:1789402313.288314:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789402313.288320:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789402313.288531:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6842:x1876324224347264:12345-0@lo:7: Request processed in 5057us (5642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402313.288543:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789402313.288610:0:6842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6c998a680 x1876324224347264/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789402329 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402313.288632:0:6842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6842:1876324224347264:0@lo:7: 00000004:00080000:3.0:1789402313.288644:0:6842:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789402313.290603:0:6842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6842:1876324224347392:0@lo:5: 00000100:00100000:3.0:1789402313.290680:0:6842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402313.290751:0:6842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ffa0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402313.291464:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224347392 00000100:00100000:0.0:1789402313.291474:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224347392 00000100:00100000:0.0:1789402313.291533:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789402313.291543:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6842:x1876324224347392:12345-0@lo:5: 00002000:00080000:0.0:1789402313.291570:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789402313.291574:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789402313.291962:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6842:x1876324224347392:12345-0@lo:5: Request processed in 418us (1280us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789402313.291969:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789402313.292075:0:6842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6c998a680 x1876324224347392/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789402329 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402313.292093:0:6842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6842:1876324224347392:0@lo:5: 00000004:00080000:3.0:1789402313.292105:0:6842:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789402313.292137:0:6842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6842:1876324224347520:0@lo:700: 00000100:00100000:3.0:1789402313.292169:0:6842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402313.292199:0:6842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ffa0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402313.292317:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224347520 00000100:00100000:0.0:1789402313.292322:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224347520 00000100:00100000:0.0:1789402313.292389:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402313.292398:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6842:x1876324224347520:12345-0@lo:700: 00000100:00100000:0.0:1789402313.292427:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1876324224347648:0@lo:700: 00000100:00100000:0.0:1789402313.292460:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402313.292483:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789402313.292515:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224347648 00000100:00100000:2.0:1789402313.292519:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224347648 00000100:00100000:2.0:1789402313.292561:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789402313.292569:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1876324224347648:12345-0@lo:700: 40000000:02000000:2.0:1789402313.411099:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789402313.424089:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1876324224347648:12345-0@lo:700: Request processed in 131513us (131620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402313.424102:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789402313.424192:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee3800 x1876324224347648/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789402329 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402313.424207:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1876324224347648:0@lo:700: 40000000:02000000:1.0:1789402313.424219:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1789402313.587168:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789402313.587195:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789402313.587293:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6842:x1876324224347520:12345-0@lo:700: Request processed in 294891us (295118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402313.587320:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789402313.587483:0:6842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6c998a300 x1876324224347520/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789402329 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402313.587493:0:6842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789402313.587508:0:6842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6842:1876324224347520:0@lo:700: 00000004:02000040:1.0:1789402313.635942:0:6842:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789402313.641698:0:6842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6842:1876324224347776:0@lo:5: 00000100:00100000:1.0:1789402313.641763:0:6842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402313.641865:0:6842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e62330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402313.645366:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224347776 00000100:00100000:0.0:1789402313.645380:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224347776 00000100:00100000:0.0:1789402313.645433:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789402313.645442:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6842:x1876324224347776:12345-0@lo:5: 00002000:00080000:1.0:1789402313.657102:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789402313.657122:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789402313.664890:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6842:x1876324224347776:12345-0@lo:5: Request processed in 19442us (23119us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789402313.664901:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789402313.673299:0:6842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6fa975500 x1876324224347776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789402329 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402313.673319:0:6842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6842:1876324224347776:0@lo:5: 00000004:00080000:0.0:1789402313.673336:0:6842:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789402314.218300:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402315.234596:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402316.259916:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402317.292132:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789402317.734449:0:7057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789402318.309068:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402318.563565:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224347904:0@lo:13: 00000100:00100000:3.0:1789402318.563675:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402318.563728:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224347904 00000100:00100000:1.0:1789402318.563739:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224347904 00000100:00100000:1.0:1789402318.563825:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402318.563838:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224347904:12345-0@lo:13: 00002000:00000024:1.0:1789402318.563882:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402318.563953:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224347904:12345-0@lo:13: Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402318.563961:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789402318.564190:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6fa976d80 x1876324224347904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402318.564213:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224347904:0@lo:13: 00000100:00080000:2.0:1789402318.566516:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789402318.584035:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224348032:0@lo:400: 00000100:00100000:0.0:1789402318.584132:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402318.584191:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402318.584197:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224348160:0@lo:400: 00000100:00100000:0.0:1789402318.584226:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402318.584254:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789402318.584263:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224348288:0@lo:400: 00000100:00100000:0.0:1789402318.584288:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402318.584318:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224348032 00000100:00100000:0.0:1789402318.584327:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224348032 00000100:00100000:0.0:1789402318.584414:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789402318.584425:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3315:x1876324224348032:12345-0@lo:400: 00000100:00100000:0.0:1789402318.584488:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3315:x1876324224348032:12345-0@lo:400: Request processed in 66us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402318.584496:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789402318.584533:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224348160 00000100:00100000:0.0:1789402318.584537:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224348160 00000100:00100000:0.0:1789402318.584563:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224348288 00000100:00100000:0.0:1789402318.584566:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224348288 00000100:00100000:0.0:1789402318.586318:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789402318.586334:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224348160:12345-0@lo:400: 00000100:00100000:0.0:1789402318.586438:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224348160:12345-0@lo:400: Request processed in 108us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402318.586445:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789402318.586463:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789402318.586470:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224348288:12345-0@lo:400: 00000100:00100000:0.0:1789402318.586507:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224348288:12345-0@lo:400: Request processed in 37us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402318.586512:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789402318.586574:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee2300 x1876324224348288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402318.586628:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224348288:0@lo:400: 00010000:00080000:0.0:1789402318.586677:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee3800 x1876324224348160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402318.586687:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224348160:0@lo:400: 00000100:00100000:0.0:1789402318.586696:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224348032:0@lo:400: 00000100:00080000:3.0:1789402318.596318:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789402318.672948:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789402319.330657:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402320.354657:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402321.379573:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402322.404403:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402323.430779:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402323.682501:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224348416:0@lo:400: 00000100:00100000:0.0:1789402323.682591:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402323.682624:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224348416 00000100:00100000:3.0:1789402323.682632:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224348416 00000100:00100000:0.0:1789402323.682646:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789402323.682651:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224348800:0@lo:400: 00000100:00100000:3.0:1789402323.682677:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789402323.682677:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402323.682685:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3314:x1876324224348416:12345-0@lo:400: 00000100:00100000:0.0:1789402323.682708:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224348544:0@lo:400: 00000100:00100000:0.0:1789402323.682729:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402323.682739:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3314:x1876324224348416:12345-0@lo:400: Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402323.682744:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402323.682749:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224348672:0@lo:400: 00000100:00100000:3.0:1789402323.682751:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789402323.682766:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402323.682792:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224348800 00000100:00100000:0.0:1789402323.682796:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224348800 00000100:00100000:0.0:1789402323.682848:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402323.682856:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224348800:12345-0@lo:400: 00000100:00100000:0.0:1789402323.682888:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224348800:12345-0@lo:400: Request processed in 34us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402323.682894:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402323.682911:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224348544 00000100:00100000:0.0:1789402323.682914:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224348544 00000100:00100000:3.0:1789402323.682935:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224348416:0@lo:400: 00000100:00100000:0.0:1789402323.682935:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224348672 00000100:00100000:0.0:1789402323.682938:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224348672 00010000:00080000:3.0:1789402323.682962:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee0700 x1876324224348800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402323.682964:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789402323.682970:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224348544:12345-0@lo:400: 00000100:00100000:3.0:1789402323.682973:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789402323.682982:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224348800:0@lo:400: 00000100:00080000:3.0:1789402323.682996:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789402323.683001:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789402323.683012:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224348544:12345-0@lo:400: Request processed in 43us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402323.683018:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789402323.683029:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789402323.683035:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224348672:12345-0@lo:400: 00000100:00100000:0.0:1789402323.683198:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224348672:12345-0@lo:400: Request processed in 34us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402323.683204:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789402323.683241:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee2300 x1876324224348672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402323.683249:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224348672:0@lo:400: 00010000:00080000:0.0:1789402323.683257:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee3800 x1876324224348544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402323.683263:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224348544:0@lo:400: 00000100:00100000:0.0:1789402323.683620:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402323.683629:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224348928:0@lo:13: 00000100:00100000:0.0:1789402323.683658:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402323.685558:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224348928 00000100:00100000:1.0:1789402323.685573:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224348928 00000100:00100000:1.0:1789402323.685638:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789402323.685649:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224348928:12345-0@lo:13: 00002000:00000024:1.0:1789402323.685683:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402323.685752:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224348928:12345-0@lo:13: Request processed in 105us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402323.685759:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789402323.685962:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6fa976300 x1876324224348928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402323.685994:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224348928:0@lo:13: 00010000:00010000:3.0:1789402324.459257:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402325.476323:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402326.500955:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402327.522435:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402328.548103:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402328.804279:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224349056:0@lo:400: 00000100:00100000:0.0:1789402328.804303:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224349184:0@lo:400: 00000100:00100000:2.0:1789402328.804417:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402328.804425:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402328.805211:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224349440:0@lo:400: 00000100:00100000:1.0:1789402328.805275:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402328.805296:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224349568:0@lo:13: 00000100:00100000:1.0:1789402328.805316:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789402328.805328:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224349312:0@lo:400: 00000100:00100000:2.0:1789402328.805392:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402328.805410:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402328.805459:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224349568 00000100:00100000:2.0:1789402328.805468:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224349568 00000100:00100000:2.0:1789402328.805568:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789402328.805578:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224349568:12345-0@lo:13: 00002000:00000024:2.0:1789402328.805619:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402328.805683:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224349568:12345-0@lo:13: Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402328.805684:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224349184 00000100:00100000:1.0:1789402328.805694:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224349184 00000100:00100000:2.0:1789402328.805699:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789402328.805753:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224349312 00000100:00100000:1.0:1789402328.805757:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224349312 00000100:00100000:1.0:1789402328.805786:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789402328.805795:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224349184:12345-0@lo:400: 00000100:00100000:1.0:1789402328.805851:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224349184:12345-0@lo:400: Request processed in 57us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402328.805859:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789402328.805875:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789402328.805881:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224349312:12345-0@lo:400: 00000100:00100000:1.0:1789402328.805908:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224349312:12345-0@lo:400: Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402328.805916:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789402328.805921:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789402328.805929:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402328.805945:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224349056 00000100:00100000:1.0:1789402328.805952:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224349056 00010000:00080000:2.0:1789402328.805978:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6fa977800 x1876324224349568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402328.805991:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789402328.806003:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3315:x1876324224349056:12345-0@lo:400: 00000100:00100000:2.0:1789402328.806005:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224349568:0@lo:13: 00000100:00100000:1.0:1789402328.806056:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3315:x1876324224349056:12345-0@lo:400: Request processed in 55us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402328.806063:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789402328.806255:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee3100 x1876324224349312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402328.806283:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224349312:0@lo:400: 00000100:00100000:2.0:1789402328.806297:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224349056:0@lo:400: 00000100:00100000:1.0:1789402328.806339:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224349440 00000100:00100000:1.0:1789402328.806389:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224349440 00000100:00100000:1.0:1789402328.806435:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402328.806443:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224349440:12345-0@lo:400: 00000100:00100000:1.0:1789402328.806484:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224349440:12345-0@lo:400: Request processed in 43us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402328.806491:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789402328.806531:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee3b80 x1876324224349440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402328.806541:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224349440:0@lo:400: 00010000:00080000:0.0:1789402328.810702:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6f7ee2a00 x1876324224349184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402328.810727:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224349184:0@lo:400: 00010000:00010000:3.0:1789402329.570887:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789402329.910699:0:7627:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789402329.910703:0:7627:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789402329.910851:0:7627:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c6ff7f4000 00000020:01000004:1.0:1789402329.910866:0:7627:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789402329.910878:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789402329.910892:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93c6f1f40000) 00000020:00000080:1.0:1789402329.910911:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789402329.926658:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789402329.926908:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789402329.965211:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789402329.973228:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789402329.973262:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789402329.973319:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789402329.973562:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789402329.973892:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789402329.973903:0:7627:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789402329.973913:0:7627:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9403f4af875f7a3d 00000020:01000004:2.0:1789402329.973921:0:7627:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789402329.973941:0:7627:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.108@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789402329.973945:0:7627:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789402329.973952:0:7627:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789402329.974111:0:7627:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789402329.974116:0:7627:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.108@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789402330.002402:0:7627:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789402330.002439:0:7627:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.108@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789402330.002443:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789402330.002445:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402330.002447:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402330.002448:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402330.002449:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402330.002450:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402330.002451:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402330.002452:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789402330.002453:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789402330.002455:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402330.002457:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789402330.002460:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789402330.002462:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789402330.002463:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402330.002464:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402330.002466:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402330.002467:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402330.002468:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402330.002469:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402330.002475:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789402330.002476:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789402330.002477:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402330.002478:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789402330.002521:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789402330.002541:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224349696:0@lo:253: 00000100:00100000:3.0:1789402330.002611:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.002731:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d8318780 going to sleep for 11 seconds 00000100:00100000:0.0:1789402330.002782:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224349696 00000100:00100000:0.0:1789402330.002790:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224349696 00000100:00100000:0.0:1789402330.002841:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789402330.002859:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:7627:x1876324224349696:12345-0@lo:253: 20000000:01000000:0.0:1789402330.002889:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789402330.002893:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789402330.002898:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789402330.002901:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789402330.004391:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789402330.004803:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789402330.004819:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789402330.004856:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789402330.004863:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789402330.004889:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789402330.004934:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789402330.005408:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789402330.005429:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.108@tcp 20000000:01000000:1.0:1789402330.005431:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.108@tcp (null) (null) (null) 00000040:00080000:1.0:1789402330.005460:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789402330.005465:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789402330.005517:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789402330.005525:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.108@tcp (null) (null) 00000040:00080000:1.0:1789402330.005556:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789402330.005564:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789402330.005595:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789402330.005642:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789402330.006263:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789402330.006275:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.108@tcp 20000000:01000000:1.0:1789402330.006277:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.108@tcp (null) (null) (null) 00000040:00080000:1.0:1789402330.006309:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789402330.006316:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789402330.006411:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789402330.006420:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.108@tcp (null) (null) 00000040:00080000:1.0:1789402330.006450:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789402330.006456:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789402330.006536:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789402330.006586:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789402330.006602:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789402330.006604:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789402330.006610:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789402330.006612:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789402330.006614:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789402330.006627:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789402330.006630:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789402330.006663:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789402330.006665:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789402330.007512:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789402330.007581:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789402330.007630:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789402330.007957:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789402330.008004:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789402330.008142:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1789402330.008157:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789402330.008159:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789402330.008829:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789402330.008877:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789402330.008935:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789402330.009235:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789402330.009445:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789402330.009539:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789402330.009554:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789402330.009557:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789402330.009966:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789402330.010222:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789402330.010260:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789402330.010317:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789402330.010331:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789402330.010333:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789402330.010825:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789402330.010873:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789402330.010928:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789402330.011222:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789402330.011260:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789402330.011293:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:3.0:1789402330.011309:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789402330.011329:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011460:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f798e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011470:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79b8 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011483:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79e2 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011498:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79fe expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011504:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7a28 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011511:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011548:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7a28 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011564:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7a28 expref: 16 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.011578:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224349824:0@lo:104: 00000100:00100000:3.0:1789402330.011638:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789402330.011731:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f79fe expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011740:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f79fe expref: 16 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.011748:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224349952:0@lo:104: 00010000:00010000:3.0:1789402330.011773:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f79e2 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011791:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f79e2 expref: 16 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.011800:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224350080:0@lo:104: 00010000:00010000:3.0:1789402330.011826:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f79b8 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011835:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f79b8 expref: 16 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.011842:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224350208:0@lo:104: 00010000:00010000:3.0:1789402330.011864:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f798e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.011872:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f798e expref: 16 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.011879:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224350336:0@lo:104: 00000100:00100000:3.0:1789402330.011910:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e61b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402330.011956:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789402330.011975:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402330.012038:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402330.012147:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402330.012164:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224349824 00000100:00100000:1.0:1789402330.012170:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224349824 00000100:00100000:1.0:1789402330.012202:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224349952 00000100:00100000:1.0:1789402330.012204:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224349952 00000100:00100000:1.0:1789402330.012215:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224350080 00000100:00100000:1.0:1789402330.012218:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224350080 00000100:00100000:1.0:1789402330.012232:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789402330.012241:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f1f81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+5:5838:x1876324224349824:12345-0@lo:104: 00010000:00010000:1.0:1789402330.012254:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012318:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789402330.012324:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f1f81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+5:5838:x1876324224349824:12345-0@lo:104: Request processed in 85us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.012331:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789402330.012396:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789402330.012404:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+4:5838:x1876324224349952:12345-0@lo:104: 00010000:00010000:1.0:1789402330.012411:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012444:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789402330.012449:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+4:5838:x1876324224349952:12345-0@lo:104: Request processed in 47us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.012461:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789402330.012475:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789402330.012481:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5838:x1876324224350080:12345-0@lo:104: 00010000:00010000:1.0:1789402330.012497:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012524:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789402330.012529:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5838:x1876324224350080:12345-0@lo:104: Request processed in 49us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.012534:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789402330.012573:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789402330.012579:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012587:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82c00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:1.0:1789402330.012591:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012599:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402330.012606:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402330.012610:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789402330.012637:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012643:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789402330.012665:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012673:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012686:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789402330.012689:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012694:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1507c00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:1.0:1789402330.012697:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012704:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402330.012711:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402330.012717:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789402330.012728:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012734:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789402330.012746:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012752:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1507c00/0x9403f4af875f79fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012762:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402330.012770:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012775:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83200 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:1.0:1789402330.012778:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012784:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402330.012790:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402330.012795:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789402330.012808:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012814:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789402330.012819:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012825:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f79e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.012845:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402330.012847:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402330.012848:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402330.012869:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224350464:0@lo:103: 00000100:00100000:1.0:1789402330.012900:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402330.012930:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224350592:0@lo:103: 00000100:00100000:1.0:1789402330.012962:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402330.012981:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402330.012986:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224350720:0@lo:103: 00000100:00100000:1.0:1789402330.013003:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.013150:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224349824:0@lo:104: 00000100:00100000:3.0:1789402330.013160:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224349952:0@lo:104: 00000100:00100000:3.0:1789402330.013167:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224350080:0@lo:104: 00010000:00010000:2.0:1789402330.013223:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402330.013287:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224350464 00000100:00100000:1.0:1789402330.013292:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224350464 00010000:00010000:1.0:1789402330.013314:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7a28 expref: 17 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402330.013329:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224350592 00000100:00100000:1.0:1789402330.013331:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224350592 00010000:00010000:1.0:1789402330.013444:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79fe expref: 18 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402330.013458:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224350720 00000100:00100000:1.0:1789402330.013461:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224350720 00010000:00010000:1.0:1789402330.013473:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79e2 expref: 19 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402330.013485:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789402330.013501:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224350464:12345-0@lo:103: 00010000:00010000:1.0:1789402330.013511:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402330.013515:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7a28 expref: 19 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.013525:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7a28 expref: 19 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.013538:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7a2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7a28 expref: 19 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.013561:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402330.013644:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:3316:x1876324224350464:12345-0@lo:103: Request processed in 143us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.013651:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789402330.013668:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789402330.013674:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:3313:x1876324224350592:12345-0@lo:103: 00010000:00010000:1.0:1789402330.013682:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402330.013687:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79fe expref: 17 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.013696:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f79fe expref: 17 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.013706:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f79fe expref: 17 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.013715:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402330.013752:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3313:x1876324224350592:12345-0@lo:103: Request processed in 79us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.013759:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789402330.013772:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789402330.013778:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:3313:x1876324224350720:12345-0@lo:103: 00010000:00010000:1.0:1789402330.013786:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402330.013790:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79e2 expref: 15 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.013799:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f79e2 expref: 15 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.013819:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215f800/0x9403f4af875f79e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f79e2 expref: 15 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.013829:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402330.013852:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:3313:x1876324224350720:12345-0@lo:103: Request processed in 75us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.013858:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789402330.013924:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224350720:0@lo:103: 00000100:00100000:3.0:1789402330.013932:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224350592:0@lo:103: 00000100:00100000:0.0:1789402330.014037:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402330.014047:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224350208 00000100:00100000:0.0:1789402330.014050:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224350208 00000100:00100000:0.0:1789402330.014068:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224350336 00000100:00100000:0.0:1789402330.014071:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224350336 00000100:00100000:0.0:1789402330.014083:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789402330.014089:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+4:5838:x1876324224350208:12345-0@lo:104: 00010000:00010000:0.0:1789402330.014099:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014146:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789402330.014152:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+4:5838:x1876324224350208:12345-0@lo:104: Request processed in 64us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402330.014158:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789402330.014171:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789402330.014177:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5838:x1876324224350336:12345-0@lo:104: 00010000:00010000:0.0:1789402330.014184:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014215:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789402330.014226:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5838:x1876324224350336:12345-0@lo:104: Request processed in 49us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402330.014232:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789402330.014260:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789402330.014266:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014272:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402330.014276:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014284:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402330.014291:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402330.014297:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789402330.014319:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014326:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402330.014337:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014371:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f79b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014381:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402330.014383:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014400:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c70215f600 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402330.014403:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014411:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402330.014418:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402330.014424:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789402330.014449:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014455:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402330.014462:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014469:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f798e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7995 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.014482:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402330.014484:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402330.014485:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402330.014624:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224350208:0@lo:104: 00000100:00100000:3.0:1789402330.014643:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876324224350336:0@lo:104: 00010000:00010000:3.0:1789402330.014667:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402330.019609:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224350848:0@lo:103: 00000100:00100000:1.0:1789402330.019693:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402330.019758:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789402330.019764:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224350976:0@lo:103: 00000100:00100000:1.0:1789402330.019783:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789402330.019851:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402330.019901:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224350848 00000100:00100000:3.0:1789402330.019910:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224350848 00010000:00010000:3.0:1789402330.019942:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79b8 expref: 14 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.019974:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224350976 00000100:00100000:3.0:1789402330.019977:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224350976 00010000:00010000:3.0:1789402330.019988:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f798e expref: 15 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.020002:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789402330.020009:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:3315:x1876324224350848:12345-0@lo:103: 00010000:00010000:3.0:1789402330.020058:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402330.020065:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79b8 expref: 15 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020078:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f79b8 expref: 15 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020096:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f79bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f79b8 expref: 15 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020113:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402330.020154:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+14:3315:x1876324224350848:12345-0@lo:103: Request processed in 144us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402330.020161:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789402330.020185:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789402330.020191:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:3315:x1876324224350976:12345-0@lo:103: 00010000:00010000:3.0:1789402330.020198:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402330.020203:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f798e expref: 13 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020212:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f798e expref: 13 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020222:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506200/0x9403f4af875f7995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f798e expref: 13 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020234:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020243:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020261:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020269:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020276:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020284:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020291:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1506400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402330.020296:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020310:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020326:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020336:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402330.020394:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:3315:x1876324224350976:12345-0@lo:103: Request processed in 202us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402330.020401:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789402330.020434:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224350976:0@lo:103: 00000100:00100000:3.0:1789402330.020443:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224350848:0@lo:103: 00010000:00010000:3.0:1789402330.020470:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020479:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.020486:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506400/0x9403f4af875f7a44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789402330.020510:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789402330.024328:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224350464:0@lo:103: 00000100:00100000:2.0:1789402330.141649:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+11:7627:x1876324224349696:12345-0@lo:253: Request processed in 138783us (139029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402330.141663:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789402330.141794:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224349696:0@lo:253: 10000000:01000000:3.0:1789402330.141810:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789402330.141814:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789402330.141815:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402330.141816:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402330.141817:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789402330.141831:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402330.141832:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402330.141833:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402330.141834:0:7627:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789402330.141836:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402330.141837:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789402330.141856:0:7627:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c6ff7f4000 from lustre-OST0001 10000000:01000000:3.0:1789402330.141879:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789402330.141882:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789402330.141890:0:7627:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c6c99019c0 local copy 10000000:01000000:3.0:1789402330.141894:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789402330.141927:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.141938:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.141948:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.141966:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351104:0@lo:101: 00000100:00100000:3.0:1789402330.142002:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.142059:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e61b3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402330.142263:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224351104 00000100:00100000:2.0:1789402330.142270:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224351104 00000100:00100000:2.0:1789402330.142315:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789402330.142323:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+11:7627:x1876324224351104:12345-0@lo:101: 00010000:00010000:2.0:1789402330.142335:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402330.142382:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c70215e000/0x9403f4af875f7a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7a4b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402330.142404:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215e000/0x9403f4af875f7a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7a4b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402330.142415:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c70215e000/0x9403f4af875f7a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7a4b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402330.142423:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215e000, rc 0) 00000100:00100000:2.0:1789402330.142452:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351104:12345-0@lo:101: Request processed in 130us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402330.142458:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789402330.142534:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351104:0@lo:101: 00010000:00010000:0.0:1789402330.142546:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.142555:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402330.142675:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351232:0@lo:501: 00000100:00100000:0.0:1789402330.142701:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402330.142729:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402330.142840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224351232 00000100:00100000:3.0:1789402330.142845:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224351232 00000100:00100000:3.0:1789402330.142879:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789402330.142886:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351232:12345-0@lo:501: 00000100:00100000:3.0:1789402330.143206:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351232:12345-0@lo:501: Request processed in 320us (502us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789402330.143214:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789402330.143292:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351232:0@lo:501: 10000000:01000000:0.0:1789402330.143304:0:7627:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789402330.143331:0:7627:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789402330.143337:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143371:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143378:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143395:0:7627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789402330.143414:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c6ff7f4000 10000000:01000000:0.0:1789402330.143419:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789402330.143423:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789402330.143426:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789402330.143430:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789402330.143433:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789402330.143450:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143458:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143476:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402330.143499:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351360:0@lo:101: 00000100:00100000:0.0:1789402330.143526:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402330.143540:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e10000 going to sleep for 11 seconds 00000100:00100000:0.0:1789402330.143556:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224351360 00000100:00100000:0.0:1789402330.143559:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224351360 00000100:00100000:0.0:1789402330.143586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789402330.143593:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351360:12345-0@lo:101: 00010000:00010000:0.0:1789402330.143600:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402330.143610:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7a59 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143625:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7a59 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143634:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7a59 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143640:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83600, rc 0) 00000100:00100000:0.0:1789402330.143666:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224351360:12345-0@lo:101: Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402330.143672:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:0.0:1789402330.143694:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402330.143700:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143718:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1506400 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402330.143721:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143730:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402330.143738:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402330.143743:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789402330.143761:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143767:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402330.143786:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143793:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7a4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9403f4af875f7a52 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143805:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402330.143807:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402330.143808:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402330.143818:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224351488:0@lo:103: 00000100:00100000:0.0:1789402330.143845:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402330.143879:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224351488 00000100:00100000:0.0:1789402330.143882:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224351488 00000100:00100000:0.0:1789402330.143909:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789402330.143923:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:3313:x1876324224351488:12345-0@lo:103: 00010000:00010000:0.0:1789402330.143932:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402330.143943:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215e000/0x9403f4af875f7a52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7a4b expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.143952:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402330.143978:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:3313:x1876324224351488:12345-0@lo:103: Request processed in 56us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402330.143984:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789402330.144008:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224351488:0@lo:103: 00000100:00100000:2.0:1789402330.151582:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351360:0@lo:101: 00010000:00010000:2.0:1789402330.151617:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402330.151631:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402330.151779:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351616:0@lo:501: 00000100:00100000:2.0:1789402330.151837:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402330.151883:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e0f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789402330.154208:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224351616 00000100:00100000:1.0:1789402330.154222:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224351616 00000100:00100000:1.0:1789402330.154301:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789402330.154312:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351616:12345-0@lo:501: 00000100:00100000:1.0:1789402330.154636:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351616:12345-0@lo:501: Request processed in 325us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.154645:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789402330.154748:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351616:0@lo:501: 00000100:00100000:2.0:1789402330.154793:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351744:0@lo:503: 00000100:00100000:2.0:1789402330.154837:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402330.154865:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e0f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789402330.155324:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224351744 00000100:00100000:3.0:1789402330.155330:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224351744 00000100:00100000:3.0:1789402330.155397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789402330.155405:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351744:12345-0@lo:503: 00000100:00100000:3.0:1789402330.155567:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351744:12345-0@lo:503: Request processed in 163us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402330.155575:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789402330.155674:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351744:0@lo:503: 00000040:00080000:2.0:1789402330.155917:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789402330.155993:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351872:0@lo:502: 00000100:00100000:2.0:1789402330.156039:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402330.156059:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789402330.156075:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224351872 00000100:00100000:2.0:1789402330.156078:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224351872 00000100:00100000:2.0:1789402330.156096:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789402330.156101:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351872:12345-0@lo:502: 00000100:00100000:2.0:1789402330.156228:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224351872:12345-0@lo:502: Request processed in 125us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402330.156235:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789402330.156272:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224351872:0@lo:502: 00000040:00080000:2.0:1789402330.156540:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789402330.156597:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789402330.156633:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789402330.156682:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789402330.156729:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789402330.156762:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789402330.156783:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352000:0@lo:502: 00000100:00100000:2.0:1789402330.156817:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402330.156839:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789402330.156852:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224352000 00000100:00100000:2.0:1789402330.156856:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224352000 00000100:00100000:2.0:1789402330.156875:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789402330.156880:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224352000:12345-0@lo:502: 00000100:00100000:2.0:1789402330.156992:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224352000:12345-0@lo:502: Request processed in 111us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402330.156999:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789402330.157038:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352000:0@lo:502: 00000040:00080000:2.0:1789402330.157111:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789402330.157120:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789402330.158818:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789402330.158828:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789402330.158834:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402330.158836:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789402330.158843:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789402330.158857:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93c6d8b1b380) 00000020:00000080:3.0:1789402330.158877:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789402330.158883:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789402330.158938:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6ff7f4000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789402330.158946:0:7635:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789402330.158952:0:7635:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9403f4af875f7a6e 00010000:00010000:3.0:1789402330.161996:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789402330.162311:0:7635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789402330.170451:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789402330.170764:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789402330.180856:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789402330.181685:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789402330.183113:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789402330.183125:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402330.183131:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402330.183133:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789402330.183137:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789402330.183141:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402330.183142:0:7635:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789402330.183145:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789402330.183147:0:7635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789402330.183194:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402330.183198:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402330.183200:0:7635:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789402330.183203:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789402330.185440:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789402330.185473:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789402330.185508:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.185523:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402330.185543:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6ff7f4000 from 1 10000000:01000000:3.0:1789402330.185546:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789402330.185584:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.185592:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.185605:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.185627:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352128:0@lo:101: 00000100:00100000:3.0:1789402330.185693:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.185727:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789402330.186131:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224352128 00000100:00100000:2.0:1789402330.186140:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224352128 00000100:00100000:2.0:1789402330.186200:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789402330.186210:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:7627:x1876324224352128:12345-0@lo:101: 00010000:00010000:2.0:1789402330.186223:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402330.186236:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7a75 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402330.186273:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7a75 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402330.186284:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7a75 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402330.186293:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215ee00, rc 0) 00000100:00100000:2.0:1789402330.186336:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352128:12345-0@lo:101: Request processed in 128us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402330.186363:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789402330.186408:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352128:0@lo:101: 00010000:00010000:2.0:1789402330.186423:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402330.186432:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402330.186537:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352256:0@lo:501: 00000100:00100000:2.0:1789402330.186562:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402330.186582:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e0fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789402330.186879:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224352256 00000100:00100000:3.0:1789402330.186884:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224352256 00000100:00100000:3.0:1789402330.186917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789402330.186925:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352256:12345-0@lo:501: 00000100:00100000:3.0:1789402330.187173:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352256:12345-0@lo:501: Request processed in 248us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402330.187180:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789402330.188136:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352256:0@lo:501: 00000100:00100000:0.0:1789402330.188177:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352384:0@lo:503: 00000100:00100000:0.0:1789402330.188223:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.188335:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224352384 00000100:00100000:3.0:1789402330.188355:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224352384 00000100:00100000:0.0:1789402330.188402:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c3092cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402330.192539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789402330.192558:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352384:12345-0@lo:503: 00000100:00100000:3.0:1789402330.192940:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352384:12345-0@lo:503: Request processed in 388us (4714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402330.192956:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789402330.195804:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352384:0@lo:503: 00000040:00080000:1.0:1789402330.196135:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789402330.196213:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352512:0@lo:502: 00000100:00100000:1.0:1789402330.196548:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402330.196695:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402330.198636:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224352512 00000100:00100000:2.0:1789402330.198650:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224352512 00000100:00100000:2.0:1789402330.198758:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789402330.198780:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352512:12345-0@lo:502: 00000100:00100000:2.0:1789402330.199072:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352512:12345-0@lo:502: Request processed in 293us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402330.199080:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789402330.199166:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352512:0@lo:502: 00000040:00080000:1.0:1789402330.199507:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789402330.199561:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789402330.199598:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352640:0@lo:502: 00000100:00100000:1.0:1789402330.199641:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402330.205912:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402330.208165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224352640 00000100:00100000:3.0:1789402330.208183:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224352640 00000100:00100000:1.0:1789402330.208324:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789402330.208335:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352640:12345-0@lo:502: 00000100:00100000:1.0:1789402330.208646:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352640:12345-0@lo:502: Request processed in 312us (9004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.208653:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789402330.208767:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352640:0@lo:502: 00000040:00080000:3.0:1789402330.208922:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789402330.208937:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789402330.209581:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402330.209590:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402330.209592:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789402330.209598:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6ff7f4000 00000020:00000080:3.0:1789402330.209601:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789402330.209617:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402330.209620:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402330.209621:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789402330.209624:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789402330.210091:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789402330.210117:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789402330.210168:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.210179:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402330.210219:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789402330.210221:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c6ff7f4000 10000000:01000000:1.0:1789402330.210225:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c6ff7f4000 10000000:01000000:1.0:1789402330.210228:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789402330.210233:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6ff7f4000 from 1 10000000:01000000:1.0:1789402330.210235:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789402330.210404:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.210413:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.210439:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402330.210459:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352768:0@lo:101: 00000100:00100000:1.0:1789402330.210521:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402330.210555:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995600 going to sleep for 11 seconds 00000100:00100000:1.0:1789402330.210573:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224352768 00000100:00100000:1.0:1789402330.210578:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224352768 00000100:00100000:1.0:1789402330.210614:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789402330.210622:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224352768:12345-0@lo:101: 00010000:00010000:1.0:1789402330.210633:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402330.210645:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7a83 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.210666:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7a83 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.210676:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7a83 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.210684:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83f400, rc 0) 00000100:00100000:1.0:1789402330.210719:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224352768:12345-0@lo:101: Request processed in 97us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.210727:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789402330.210766:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352768:0@lo:101: 00010000:00010000:1.0:1789402330.210778:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.210799:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402330.210883:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352896:0@lo:501: 00000100:00100000:1.0:1789402330.210907:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402330.210920:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995600 going to sleep for 11 seconds 00000100:00100000:1.0:1789402330.210933:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224352896 00000100:00100000:1.0:1789402330.210936:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224352896 00000100:00100000:1.0:1789402330.210953:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789402330.210958:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224352896:12345-0@lo:501: 00000100:00100000:1.0:1789402330.213211:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224352896:12345-0@lo:501: Request processed in 2244us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.213223:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789402330.213637:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224352896:0@lo:501: 00000100:00100000:3.0:1789402330.213702:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224353024:0@lo:503: 00000100:00100000:3.0:1789402330.213753:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.213819:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789402330.213854:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224353024 00000100:00100000:1.0:1789402330.213860:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224353024 00000100:00100000:1.0:1789402330.213930:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789402330.213939:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224353024:12345-0@lo:503: 00000100:00100000:1.0:1789402330.214178:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224353024:12345-0@lo:503: Request processed in 239us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.214185:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789402330.214263:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224353024:0@lo:503: 00000040:00080000:3.0:1789402330.214598:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789402330.214675:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224353152:0@lo:502: 00000100:00100000:3.0:1789402330.214712:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.215142:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c8d45e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402330.215199:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224353152 00000100:00100000:0.0:1789402330.215206:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224353152 00000100:00100000:0.0:1789402330.215235:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789402330.215243:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224353152:12345-0@lo:502: 00000100:00100000:0.0:1789402330.216149:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224353152:12345-0@lo:502: Request processed in 902us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402330.216158:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789402330.216458:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224353152:0@lo:502: 00000040:00080000:3.0:1789402330.216765:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789402330.216819:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789402330.216861:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789402330.216920:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789402330.216959:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789402330.217007:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789402330.217189:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789402330.217224:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789402330.219949:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789402330.220043:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789402330.220079:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789402330.220148:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789402330.220186:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789402330.220219:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789402330.220268:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789402330.220305:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789402330.220338:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789402330.220424:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789402330.220464:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789402330.220511:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789402330.220561:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789402330.220598:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789402330.220647:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789402330.220693:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789402330.220726:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789402330.220756:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789402330.220804:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789402330.220838:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789402330.220866:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789402330.220908:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789402330.220944:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789402330.220978:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789402330.221006:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789402330.221047:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789402330.221077:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789402330.221128:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789402330.221158:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789402330.221201:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224353280:0@lo:502: 00000100:00100000:2.0:1789402330.221271:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402330.221306:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d8318780 going to sleep for 11 seconds 00000100:00100000:1.0:1789402330.226836:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224353280 00000100:00100000:1.0:1789402330.226852:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224353280 00000100:00100000:1.0:1789402330.226913:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789402330.226923:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224353280:12345-0@lo:502: 00000100:00100000:1.0:1789402330.227213:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224353280:12345-0@lo:502: Request processed in 291us (5942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.227230:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789402330.228933:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224353280:0@lo:502: 00000040:00080000:2.0:1789402330.229635:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789402330.229653:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789402330.233790:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789402330.233825:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93c6fb33cd40) 00000020:00000080:1.0:1789402330.233847:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789402330.233935:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6ff7f4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789402330.233940:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6ff7f4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789402330.233942:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6ff7f4000 3 00010000:00080000:1.0:1789402330.233974:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c6ddd7e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.108@tcp at head 00010000:00010000:1.0:1789402330.236833:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789402330.237193:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789402330.237231:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789402330.237244:0:7640:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9403f4af875f7a98 00000100:00080000:1.0:1789402330.237263:0:7640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789402330.237275:0:7640:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93c6ddd7e000 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:1.0:1789402330.237312:0:7640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6fa977b80 x1876324224353408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789402330.237338:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789402330.237586:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876324224353408:0@lo:38: 00000100:00100000:2.0:1789402330.237651:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.238054:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224353664:0@lo:400: 00000100:00100000:3.0:1789402330.238087:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.238109:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402330.238115:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224353792:0@lo:400: 00000100:00100000:3.0:1789402330.238139:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402330.238276:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224353408 00000100:00100000:1.0:1789402330.238284:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224353408 00000100:00100000:1.0:1789402330.238311:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224353664 00000100:00100000:1.0:1789402330.238314:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224353664 00000100:00100000:1.0:1789402330.238376:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789402330.238386:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224353664:12345-0@lo:400: 00000100:00100000:1.0:1789402330.238453:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224353664:12345-0@lo:400: Request processed in 69us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.238461:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789402330.238584:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224353536:0@lo:400: 00000100:00100000:2.0:1789402330.238611:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402330.238797:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224353536 00000100:00100000:2.0:1789402330.238802:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224353536 00000100:00100000:2.0:1789402330.238823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789402330.238830:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224353536:12345-0@lo:400: 00000100:00100000:2.0:1789402330.238885:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224353536:12345-0@lo:400: Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402330.238892:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789402330.238906:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789402330.238911:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876324224353408:12345-0@lo:38: 00010000:00080000:2.0:1789402330.238931:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:2.0:1789402330.238962:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9403f4af875f7a9f 00000004:00100000:2.0:1789402330.238977:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789402330.239007:0:5844:0:(import.c:65:import_set_state_nolock()) ffff93c6eec1b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789402330.239124:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876324224353408:12345-0@lo:38: Request processed in 210us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402330.239138:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789402330.239157:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789402330.239192:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6fa977b80 x1876324224353408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789402340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402330.239202:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789402330.239210:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789402330.239217:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789402330.239221:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789402330.239223:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789402330.239228:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876324224353408:0@lo:38: 00000040:00080000:2.0:1789402330.239440:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:3.0:1789402330.239601:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6c9988000 x1876324224353536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402330.239612:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224353536:0@lo:400: 00000100:00100000:2.0:1789402330.239751:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1876324224353920:0@lo:901: 00000100:00100000:2.0:1789402330.239783:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402330.239814:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224353920 00000100:00100000:2.0:1789402330.239818:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224353920 00000100:00100000:2.0:1789402330.239850:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789402330.239857:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1876324224353920:12345-0@lo:901: 00010000:00080000:1.0:1789402330.240137:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6c998b480 x1876324224353664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402330.240158:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224353664:0@lo:400: 00000020:01000000:3.0:1789402330.240217:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789402330.240242:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789402330.240269:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.240280:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789402330.240324:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789402330.240326:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402330.240327:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402330.240329:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402330.240330:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402330.240331:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402330.240333:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402330.240334:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789402330.240336:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789402330.240359:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402330.240361:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789402330.240365:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789402330.240367:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789402330.240368:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402330.240369:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402330.240370:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402330.240371:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402330.240373:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402330.240374:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402330.240375:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789402330.240376:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789402330.240376:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402330.240377:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789402330.240392:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789402330.240401:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224354048:0@lo:253: 00000100:00100000:3.0:1789402330.240439:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.240466:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75fc00 going to sleep for 11 seconds 00000100:00080000:3.0:1789402330.241389:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402330.241402:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e3365840 going to sleep for 11 seconds 00000100:00100000:1.0:1789402330.242110:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224353792 00000100:00100000:1.0:1789402330.242119:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224353792 00000100:00100000:1.0:1789402330.242185:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789402330.242196:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224353792:12345-0@lo:400: 00000100:00100000:1.0:1789402330.242283:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224353792:12345-0@lo:400: Request processed in 89us (4142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.242289:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789402330.242339:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6c998b100 x1876324224353792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402330.242358:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224353792:0@lo:400: 00000100:00080000:3.0:1789402330.242588:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402330.242780:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1876324224353920:12345-0@lo:901: Request processed in 2921us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402330.242788:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789402330.243127:0:7641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6da97ca80 x1876324224353920/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789402346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402330.243137:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1876324224353920:0@lo:901: 00000100:00100000:2.0:1789402330.244727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224354048 00000100:00100000:2.0:1789402330.244739:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224354048 00000100:00100000:2.0:1789402330.244791:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789402330.244802:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:7627:x1876324224354048:12345-0@lo:253: 20000000:01000000:2.0:1789402330.245195:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789402330.245211:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789402330.285217:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789402330.285270:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789402330.285707:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789402330.285713:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789402330.285736:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.285755:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79f0 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.285777:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.285817:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f79f0 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402330.285906:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f79f0 expref: 14 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402330.285924:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876324224354176:0@lo:104: 00000100:00100000:0.0:1789402330.285986:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402330.286109:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a99900 going to sleep for 11 seconds 00000100:00100000:1.0:1789402330.286169:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224354176 00000100:00100000:1.0:1789402330.286176:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224354176 00000100:00100000:1.0:1789402330.286273:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789402330.286284:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5860:x1876324224354176:12345-0@lo:104: 00010000:00010000:1.0:1789402330.286297:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402330.286374:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789402330.286380:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:5860:x1876324224354176:12345-0@lo:104: Request processed in 99us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402330.286386:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789402330.287024:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876324224354176:0@lo:104: 00010000:00010000:0.0:1789402330.287047:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.288673:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402330.288686:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.288697:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e400 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:3.0:1789402330.288701:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.288711:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789402330.288730:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402330.288737:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789402330.288778:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.288786:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789402330.288803:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.288810:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f79f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.288828:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402330.288840:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402330.288842:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402330.288855:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402330.288872:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224354304:0@lo:103: 00000100:00100000:3.0:1789402330.288926:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402330.288970:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224354304 00000100:00100000:3.0:1789402330.288978:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224354304 00010000:00010000:3.0:1789402330.289003:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79f0 expref: 15 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.289039:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789402330.289048:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+15:3314:x1876324224354304:12345-0@lo:103: 00010000:00010000:3.0:1789402330.289060:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402330.289064:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79f0 expref: 15 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289081:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f79f0 expref: 15 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289095:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506600/0x9403f4af875f79f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f79f0 expref: 15 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289109:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289117:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789402330.289131:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012847911s 00010000:00010000:3.0:1789402330.289136:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289144:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289151:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289157:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289163:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83a00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402330.289167:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289175:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289192:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289202:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402330.289230:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:3314:x1876324224354304:12345-0@lo:103: Request processed in 184us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402330.289237:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789402330.289306:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224354304:0@lo:103: 00010000:00010000:3.0:1789402330.289330:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289338:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402330.289365:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83a00/0x9403f4af875f7aa6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402330.298989:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:7627:x1876324224354048:12345-0@lo:253: Request processed in 54181us (58540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402330.299003:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789402330.299198:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8612d911-d8bf-490d-b22c-35e85a3b4473:7627:1876324224354048:0@lo:253: 10000000:01000000:2.0:1789402330.299214:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789402330.299216:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789402330.299218:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789402330.299220:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789402330.299221:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789402330.299222:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789402330.299223:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789402330.299224:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789402330.299225:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789402330.299227:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789402330.299228:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789402330.299230:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789402330.299241:0:7627:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789402330.306154:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402330.306644:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789402330.306964:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402330.307206:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789402330.312191:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789402330.313656:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789402330.318954:0:7627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789402330.510605:0:7627:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789402330.510610:0:7627:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789402330.510635:0:7627:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789402330.510679:0:7627:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.108@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789402330.510703:0:7627:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789402330.510723:0:7627:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789402330.595537:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402331.618595:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402332.642787:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402333.668621:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402333.922862:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402333.922889:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224354432:0@lo:13: 00000100:00100000:0.0:1789402333.922957:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402333.923187:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224354432 00000100:00100000:2.0:1789402333.923197:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224354432 00000100:00100000:2.0:1789402333.923265:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789402333.923276:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224354432:12345-0@lo:13: 00002000:00000024:2.0:1789402333.923312:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402333.923387:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224354432:12345-0@lo:13: Request processed in 113us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402333.923395:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789402333.923450:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789402333.923592:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa974000 x1876324224354432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402333.923612:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224354432:0@lo:13: 00010000:00010000:3.0:1789402334.690650:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402335.458957:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789402335.458983:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224354688:0@lo:400: 00000100:00100000:3.0:1789402335.458991:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224355072:0@lo:400: 00000100:00100000:0.0:1789402335.465163:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224354944:0@lo:400: 00000100:00100000:2.0:1789402335.465471:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402335.465523:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224354560:0@lo:400: 00000100:00100000:2.0:1789402335.465553:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402335.465598:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224354688 00000100:00100000:2.0:1789402335.465606:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224354688 00000100:00100000:2.0:1789402335.465652:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789402335.465661:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224354688:12345-0@lo:400: 00000100:00100000:2.0:1789402335.465707:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224354688:12345-0@lo:400: Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402335.465714:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789402335.465736:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224354560 00000100:00100000:2.0:1789402335.465740:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224354560 00000100:00100000:2.0:1789402335.465764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789402335.465770:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:3316:x1876324224354560:12345-0@lo:400: 00000100:00100000:2.0:1789402335.465797:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:3316:x1876324224354560:12345-0@lo:400: Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402335.465803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1789402335.465846:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c9988000 x1876324224354688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402335.465861:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224354688:0@lo:400: 00000100:00100000:2.0:1789402335.465870:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224354560:0@lo:400: 00000100:00100000:3.0:1789402335.469131:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402335.474273:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224354816:0@lo:400: 00000100:00100000:0.0:1789402335.474339:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402335.474422:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224355072 00000100:00100000:0.0:1789402335.474430:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224355072 00000100:00100000:0.0:1789402335.474496:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224354816 00000100:00100000:0.0:1789402335.474499:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224354816 00000100:00100000:0.0:1789402335.474534:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789402335.474543:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224355072:12345-0@lo:400: 00000100:00100000:0.0:1789402335.474597:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224355072:12345-0@lo:400: Request processed in 55us (5472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402335.474605:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789402335.474621:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789402335.474626:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224354816:12345-0@lo:400: 00000100:00100000:0.0:1789402335.474653:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224354816:12345-0@lo:400: Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402335.474659:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789402335.474672:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789402335.474697:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c998b100 x1876324224354816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402335.474710:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224354816:0@lo:400: 00000100:00100000:0.0:1789402335.474747:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789402335.474784:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c9989180 x1876324224355072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402335.474793:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224355072:0@lo:400: 00000100:00100000:2.0:1789402335.475113:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224354944 00000100:00100000:2.0:1789402335.475118:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224354944 00000100:00100000:2.0:1789402335.475164:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789402335.475172:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224354944:12345-0@lo:400: 00000100:00100000:2.0:1789402335.475210:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224354944:12345-0@lo:400: Request processed in 39us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402335.475222:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789402335.475380:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c998b480 x1876324224354944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402335.475390:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224354944:0@lo:400: 00000100:00080000:1.0:1789402335.475464:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789402335.716022:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402336.742026:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789402337.303753:0:7984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789402337.762879:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789402338.018658:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789402338.018666:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6e61ce000 from 30 10000000:01000000:3.0:1789402338.018672:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789402338.018714:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.018725:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.018736:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402338.034205:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355200:0@lo:101: 00000100:00100000:3.0:1789402338.034291:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.034359:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072780 going to sleep for 11 seconds 00000100:00100000:2.0:1789402338.035306:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224355200 00000100:00100000:2.0:1789402338.035317:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224355200 00000100:00100000:2.0:1789402338.035398:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789402338.035408:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224355200:12345-0@lo:101: 00010000:00010000:2.0:1789402338.035425:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402338.035455:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7aad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402338.035483:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7aad expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402338.035504:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7aad expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402338.035514:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215fa00, rc 0) 00000100:00100000:2.0:1789402338.035571:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224355200:12345-0@lo:101: Request processed in 165us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402338.035578:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789402338.035628:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355200:0@lo:101: 00010000:00010000:2.0:1789402338.035647:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402338.035657:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402338.035737:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355328:0@lo:501: 00000100:00100000:2.0:1789402338.035780:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402338.035802:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224355328 00000100:00100000:2.0:1789402338.035805:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224355328 00000100:00100000:2.0:1789402338.035824:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789402338.035830:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224355328:12345-0@lo:501: 00000100:00100000:2.0:1789402338.036147:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224355328:12345-0@lo:501: Request processed in 316us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402338.036155:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789402338.036200:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a99c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789402338.036211:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355328:0@lo:501: 00000100:00100000:2.0:1789402338.036238:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355456:0@lo:503: 00000100:00100000:2.0:1789402338.036273:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402338.036292:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224355456 00000100:00100000:2.0:1789402338.036295:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224355456 00000100:00100000:2.0:1789402338.036314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789402338.036319:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224355456:12345-0@lo:503: 00000100:00100000:2.0:1789402338.036610:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224355456:12345-0@lo:503: Request processed in 288us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402338.036616:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789402338.036647:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a99c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789402338.036659:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355456:0@lo:503: 00000100:00100000:1.0:1789402338.041894:0:8016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8016:1876324224355584:0@lo:502: 00000100:00100000:1.0:1789402338.041985:0:8016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.042029:0:8016:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789402338.042670:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224355584 00000100:00100000:0.0:1789402338.042678:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224355584 00000100:00100000:0.0:1789402338.042723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789402338.042732:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:8016:x1876324224355584:12345-0@lo:502: 00000100:00100000:0.0:1789402338.043076:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:8016:x1876324224355584:12345-0@lo:502: Request processed in 344us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402338.043092:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789402338.043460:0:8016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8016:1876324224355584:0@lo:502: 00000100:00100000:1.0:1789402338.043528:0:8016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8016:1876324224355712:0@lo:502: 00000100:00100000:1.0:1789402338.043573:0:8016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.043604:0:8016:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789402338.043751:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224355712 00000100:00100000:2.0:1789402338.043766:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224355712 00000100:00100000:2.0:1789402338.043803:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789402338.043811:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:8016:x1876324224355712:12345-0@lo:502: 00000100:00100000:2.0:1789402338.044158:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:8016:x1876324224355712:12345-0@lo:502: Request processed in 346us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402338.044166:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789402338.044317:0:8016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8016:1876324224355712:0@lo:502: 00000040:00080000:1.0:1789402338.044340:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789402338.049086:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789402338.049122:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789402338.049133:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.049145:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402338.049155:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789402338.049157:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789402338.049167:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789402338.049209:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.049219:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.049230:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402338.049252:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355840:0@lo:101: 00000100:00100000:3.0:1789402338.049310:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.049365:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224355840 00000100:00100000:3.0:1789402338.049373:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224355840 00000100:00100000:3.0:1789402338.049413:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789402338.049422:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224355840:12345-0@lo:101: 00010000:00010000:3.0:1789402338.049446:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402338.049457:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7abb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.049480:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7abb expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.049501:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7abb expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.049510:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1506800, rc 0) 00000100:00100000:3.0:1789402338.049539:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224355840:12345-0@lo:101: Request processed in 118us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.049546:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789402338.049591:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072300 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.049609:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355840:0@lo:101: 00010000:00010000:3.0:1789402338.049622:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.049632:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402338.049676:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355968:0@lo:501: 00000100:00100000:3.0:1789402338.049698:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.049718:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224355968 00000100:00100000:3.0:1789402338.049722:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224355968 00000100:00100000:3.0:1789402338.049741:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789402338.049747:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224355968:12345-0@lo:501: 00000100:00100000:3.0:1789402338.050282:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224355968:12345-0@lo:501: Request processed in 533us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.050290:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789402338.050315:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072300 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.050327:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224355968:0@lo:501: 00000100:00100000:3.0:1789402338.050381:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224356096:0@lo:503: 00000100:00100000:3.0:1789402338.050417:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.050455:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224356096 00000100:00100000:3.0:1789402338.050459:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224356096 00000100:00100000:3.0:1789402338.050481:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789402338.050486:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224356096:12345-0@lo:503: 00000100:00100000:3.0:1789402338.050782:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224356096:12345-0@lo:503: Request processed in 295us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.050797:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789402338.050825:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072300 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.050836:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224356096:0@lo:503: 00000100:00100000:2.0:1789402338.054946:0:8018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8018:1876324224356224:0@lo:502: 00000100:00100000:2.0:1789402338.055152:0:8018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.055256:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224356224 00000100:00100000:3.0:1789402338.055264:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224356224 00000100:00100000:3.0:1789402338.055309:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789402338.055318:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:8018:x1876324224356224:12345-0@lo:502: 00000100:00100000:3.0:1789402338.058150:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:8018:x1876324224356224:12345-0@lo:502: Request processed in 2824us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.058164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789402338.060621:0:8018:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a99840 going to sleep for 11 seconds 00000100:00100000:2.0:1789402338.060660:0:8018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8018:1876324224356224:0@lo:502: 00000020:01000000:2.0:1789402338.060701:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789402338.060711:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402338.060713:0:8018:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789402338.060719:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789402338.060721:0:8018:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789402338.060751:0:8018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8018:1876324224356352:0@lo:502: 00000100:00100000:2.0:1789402338.060880:0:8018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402338.061180:0:8018:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a99840 going to sleep for 11 seconds 00000100:00100000:0.0:1789402338.061266:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224356352 00000100:00100000:0.0:1789402338.061274:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224356352 00000100:00100000:0.0:1789402338.061325:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789402338.061335:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:8018:x1876324224356352:12345-0@lo:502: 00000100:00100000:2.0:1789402338.062681:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:8018:x1876324224356352:12345-0@lo:502: Request processed in 1343us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402338.062692:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789402338.064252:0:8018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8018:1876324224356352:0@lo:502: 00000020:01000000:0.0:1789402338.064858:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402338.064868:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402338.064870:0:8018:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789402338.064877:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789402338.065122:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789402338.065141:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789402338.065152:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.065164:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402338.065184:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789402338.065186:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6e31a1800 from 30 10000000:01000000:3.0:1789402338.065190:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789402338.065226:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.065235:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.065260:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402338.065281:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224356480:0@lo:101: 00000100:00100000:3.0:1789402338.065365:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.065407:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789402338.065855:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224356480 00000100:00100000:0.0:1789402338.065862:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224356480 00000100:00100000:0.0:1789402338.065910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789402338.065919:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224356480:12345-0@lo:101: 00010000:00010000:0.0:1789402338.065933:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402338.065945:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7ac9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402338.065978:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7ac9 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402338.065990:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7ac9 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402338.065999:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82200, rc 0) 00000100:00100000:0.0:1789402338.066100:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224356480:12345-0@lo:101: Request processed in 181us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402338.066107:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789402338.066518:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224356480:0@lo:101: 00010000:00010000:2.0:1789402338.066535:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402338.066544:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402338.066601:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224356608:0@lo:501: 00000100:00100000:2.0:1789402338.066638:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402338.066671:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a99840 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.066781:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224356608 00000100:00100000:3.0:1789402338.066787:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224356608 00000100:00100000:3.0:1789402338.066818:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789402338.066826:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224356608:12345-0@lo:501: 00000100:00100000:3.0:1789402338.067068:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224356608:12345-0@lo:501: Request processed in 243us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.067076:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789402338.067299:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224356608:0@lo:501: 00000100:00100000:2.0:1789402338.067328:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224356736:0@lo:503: 00000100:00100000:2.0:1789402338.067389:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402338.067405:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a99840 going to sleep for 11 seconds 00000100:00100000:0.0:1789402338.067504:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224356736 00000100:00100000:0.0:1789402338.067515:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224356736 00000100:00100000:0.0:1789402338.067537:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789402338.067543:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224356736:12345-0@lo:503: 00000100:00100000:0.0:1789402338.067686:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224356736:12345-0@lo:503: Request processed in 142us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402338.067694:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789402338.067881:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224356736:0@lo:503: 00000100:00100000:2.0:1789402338.068571:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8019:1876324224356864:0@lo:502: 00000100:00100000:2.0:1789402338.068616:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402338.068649:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a99600 going to sleep for 11 seconds 00000100:00100000:0.0:1789402338.068746:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224356864 00000100:00100000:0.0:1789402338.068752:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224356864 00000100:00100000:0.0:1789402338.068796:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789402338.068804:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:8019:x1876324224356864:12345-0@lo:502: 00000100:00100000:0.0:1789402338.069006:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:8019:x1876324224356864:12345-0@lo:502: Request processed in 202us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402338.069015:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789402338.069308:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8019:1876324224356864:0@lo:502: 00000100:00100000:3.0:1789402338.069388:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8019:1876324224356992:0@lo:502: 00000100:00100000:3.0:1789402338.069424:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.069453:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789402338.069603:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224356992 00000100:00100000:0.0:1789402338.069608:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224356992 00000100:00100000:2.0:1789402338.069752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789402338.069771:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+16:8019:x1876324224356992:12345-0@lo:502: 00000100:00100000:2.0:1789402338.069930:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+16:8019:x1876324224356992:12345-0@lo:502: Request processed in 161us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402338.069937:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789402338.070001:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8019:1876324224356992:0@lo:502: 00000040:00080000:0.0:1789402338.070021:0:8019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789402338.070513:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789402338.070532:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789402338.070542:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.070554:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402338.070564:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789402338.070567:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6e31a1800 from 5 10000000:01000000:1.0:1789402338.070570:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789402338.070596:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.070606:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.070627:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402338.070642:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357120:0@lo:101: 00000100:00100000:1.0:1789402338.070672:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.070979:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.071111:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224357120 00000100:00100000:3.0:1789402338.071119:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224357120 00000100:00100000:2.0:1789402338.071287:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789402338.071296:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224357120:12345-0@lo:101: 00010000:00010000:2.0:1789402338.071306:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402338.071324:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c70215f800/0x9403f4af875f7ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7ad7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402338.071374:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215f800/0x9403f4af875f7ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7ad7 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402338.071387:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c70215f800/0x9403f4af875f7ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7ad7 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402338.071409:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215f800, rc 0) 00000100:00100000:2.0:1789402338.071455:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224357120:12345-0@lo:101: Request processed in 160us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402338.071461:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789402338.071666:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357120:0@lo:101: 00010000:00010000:1.0:1789402338.071680:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.071689:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402338.071735:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357248:0@lo:256: 00000100:00100000:1.0:1789402338.071781:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.071811:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.071852:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224357248 00000100:00100000:3.0:1789402338.071856:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224357248 00000100:00100000:3.0:1789402338.071890:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789402338.071896:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224357248:12345-0@lo:256: 20000000:01000000:3.0:1789402338.071909:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789402338.071925:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789402338.071928:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789402338.072012:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224357248:12345-0@lo:256: Request processed in 115us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.072019:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789402338.072198:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357248:0@lo:256: 10000000:01000000:1.0:1789402338.072242:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789402338.072249:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.072257:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402338.072264:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789402338.072266:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789402338.072273:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789402338.072296:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.072304:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.072312:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402338.072324:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357376:0@lo:101: 00000100:00100000:1.0:1789402338.072394:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.072425:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.072612:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224357376 00000100:00100000:3.0:1789402338.072617:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224357376 00000100:00100000:3.0:1789402338.072637:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789402338.072643:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224357376:12345-0@lo:101: 00010000:00010000:3.0:1789402338.072651:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402338.072660:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7ae5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.072677:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7ae5 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.072687:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7ae5 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402338.072694:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1507e00, rc 0) 00000100:00100000:3.0:1789402338.072722:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224357376:12345-0@lo:101: Request processed in 78us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.072728:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789402338.072888:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357376:0@lo:101: 00010000:00010000:1.0:1789402338.072899:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.072906:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402338.072945:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357504:0@lo:501: 00000100:00100000:1.0:1789402338.072977:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.073019:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789402338.073159:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224357504 00000100:00100000:0.0:1789402338.073163:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224357504 00000100:00100000:3.0:1789402338.073213:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789402338.073220:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224357504:12345-0@lo:501: 00000100:00100000:2.0:1789402338.073747:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224357504:12345-0@lo:501: Request processed in 526us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402338.073858:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357504:0@lo:501: 00000100:00100000:1.0:1789402338.073889:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357632:0@lo:503: 00000100:00100000:1.0:1789402338.073927:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.073970:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.074077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224357632 00000100:00100000:3.0:1789402338.074082:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224357632 00000100:00100000:2.0:1789402338.074108:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789402338.075847:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789402338.075865:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224357632:12345-0@lo:503: 00000100:00100000:0.0:1789402338.076395:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224357632:12345-0@lo:503: Request processed in 536us (2465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402338.076404:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789402338.076539:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224357632:0@lo:503: 00000100:00100000:1.0:1789402338.077983:0:8020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8020:1876324224357760:0@lo:502: 00000100:00100000:1.0:1789402338.078052:0:8020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.082991:0:8020:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789402338.083297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224357760 00000100:00100000:2.0:1789402338.083306:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224357760 00000100:00100000:2.0:1789402338.083367:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789402338.083377:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8020:x1876324224357760:12345-0@lo:502: 00000100:00100000:2.0:1789402338.083750:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8020:x1876324224357760:12345-0@lo:502: Request processed in 374us (5698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402338.083890:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789402338.084250:0:8020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8020:1876324224357760:0@lo:502: 00000020:01000000:1.0:1789402338.084283:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789402338.084290:0:8020:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789402338.084297:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402338.084300:0:8020:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789402338.084305:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789402338.084308:0:8020:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.108@tcp to nid 0x20000c0a8cb6c (192.168.203.108@tcp) 00000020:01000000:1.0:1789402338.084329:0:8020:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789402338.084332:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789402338.084374:0:8020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93c6fb33b380) 00000020:00000080:1.0:1789402338.084395:0:8020:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789402338.084400:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789402338.084483:0:8020:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789402338.084489:0:8020:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789402338.084506:0:8020:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f7afa 00010000:00080000:1.0:1789402338.084533:0:8020:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c6ff6b3000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.108@tcp at head 00010000:00010000:1.0:1789402338.084880:0:8020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789402338.085370:0:8020:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789402338.085383:0:8020:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789402338.087954:0:8020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789402338.088696:0:8020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789402338.088746:0:8020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789402338.088903:0:8020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789402338.089798:0:8021:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789402338.089803:0:8021:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789402338.091655:0:8020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789402338.091670:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789402338.091701:0:8020:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789402338.091730:0:8020:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f7b01 00000100:00080000:1.0:1789402338.091741:0:8020:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789402338.091752:0:8020:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c6ff6b3000 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:1.0:1789402338.091861:0:8020:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6fa974000 x1876324224357888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789402338.091886:0:8020:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789402338.091944:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789402338.091948:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402338.091950:0:8020:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789402338.091953:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789402338.091957:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402338.092060:0:8020:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789402338.092066:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789402338.092068:0:8020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789402338.092096:0:8020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8020:1876324224358016:0@lo:502: 00000100:00100000:1.0:1789402338.092237:0:8020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.092281:0:8020:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789402338.092338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224358016 00000100:00100000:0.0:1789402338.092373:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224358016 00000100:00100000:0.0:1789402338.092410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789402338.092418:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8020:x1876324224358016:12345-0@lo:502: 00000100:00100000:0.0:1789402338.092665:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8020:x1876324224358016:12345-0@lo:502: Request processed in 247us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402338.092673:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789402338.092946:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224358528:0@lo:400: 00000100:00100000:3.0:1789402338.093053:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.093077:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402338.093083:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224358144:0@lo:400: 00000100:00100000:3.0:1789402338.093112:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.093137:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224358272:0@lo:400: 00000100:00100000:3.0:1789402338.093156:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.093246:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789402338.093252:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224358400:0@lo:400: 00000100:00100000:3.0:1789402338.093279:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.093308:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224358528 00000100:00100000:3.0:1789402338.093313:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224358528 00000100:00100000:3.0:1789402338.093376:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224358144 00000100:00100000:3.0:1789402338.093380:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224358144 00000100:00100000:3.0:1789402338.093393:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224358272 00000100:00100000:3.0:1789402338.093395:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224358272 00000100:00100000:3.0:1789402338.093408:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789402338.093416:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224358528:12345-0@lo:400: 00000100:00100000:3.0:1789402338.093467:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224358528:12345-0@lo:400: Request processed in 51us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.093474:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789402338.093486:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789402338.093559:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224358144:12345-0@lo:400: 00000100:00100000:3.0:1789402338.093588:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224358144:12345-0@lo:400: Request processed in 96us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.093594:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789402338.093606:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789402338.093612:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224358272:12345-0@lo:400: 00000100:00100000:3.0:1789402338.093638:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224358272:12345-0@lo:400: Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.093644:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789402338.093675:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224358400 00000100:00100000:3.0:1789402338.093679:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224358400 00000100:00100000:3.0:1789402338.093703:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789402338.093709:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224358400:12345-0@lo:400: 00000100:00100000:3.0:1789402338.093737:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224358400:12345-0@lo:400: Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.093743:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789402338.093932:0:8020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8020:1876324224358016:0@lo:502: 00000020:01000000:1.0:1789402338.093975:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789402338.093981:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402338.093983:0:8020:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789402338.093987:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789402338.094191:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789402338.094207:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789402338.094217:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402338.094228:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402338.094237:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789402338.094240:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c6c99019c0 from 1 10000000:01000000:0.0:1789402338.094243:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789402338.094267:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402338.094275:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402338.094285:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402338.094300:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224358656:0@lo:101: 00000100:00100000:0.0:1789402338.094330:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402338.094381:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e32aa9c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789402338.094579:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402338.094584:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789402338.094611:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c998a680 x1876324224358144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402338.094623:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224358144:0@lo:400: 00010000:00080000:3.0:1789402338.094633:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c9988a80 x1876324224358528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402338.094642:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224358528:0@lo:400: 00010000:00080000:3.0:1789402338.094671:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c9989880 x1876324224358400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402338.094679:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224358400:0@lo:400: 00010000:00080000:3.0:1789402338.094689:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c998a300 x1876324224358272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402338.094698:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224358272:0@lo:400: 00000100:00100000:1.0:1789402338.094837:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224358656 00000100:00100000:1.0:1789402338.094842:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224358656 00000100:00100000:1.0:1789402338.094881:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789402338.094888:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224358656:12345-0@lo:101: 00010000:00010000:1.0:1789402338.094900:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402338.094912:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7b08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.094948:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7b08 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.095028:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7b08 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.095039:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83fe00, rc 0) 00000100:00100000:1.0:1789402338.095077:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224358656:12345-0@lo:101: Request processed in 188us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402338.095084:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789402338.095117:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224358656:0@lo:101: 00010000:00010000:1.0:1789402338.095130:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.095138:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402338.095247:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224358784:0@lo:501: 00000100:00100000:1.0:1789402338.095273:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.095292:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224358784 00000100:00100000:1.0:1789402338.095296:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224358784 00000100:00100000:1.0:1789402338.095315:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789402338.095322:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224358784:12345-0@lo:501: 00000100:00100000:2.0:1789402338.095716:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224357888:0@lo:8: 00000100:00100000:2.0:1789402338.095753:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.096094:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224358784:12345-0@lo:501: Request processed in 770us (819us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789402338.096103:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789402338.096144:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2ba5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402338.096157:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224358784:0@lo:501: 00000100:00100000:3.0:1789402338.096319:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224357888 00000100:00100000:3.0:1789402338.096325:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224357888 00000100:00100000:3.0:1789402338.096415:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789402338.096422:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3312:x1876324224357888:12345-0@lo:8: 00010000:00080000:3.0:1789402338.096464:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:3.0:1789402338.096503:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f7b16 00002000:00100000:3.0:1789402338.096516:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93c6ddd67000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789402338.096521:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789402338.096524:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789402338.096624:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 10000000:01000000:1.0:1789402338.096859:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789402338.096868:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402338.096880:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789402338.097060:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789402338.097085:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd61000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789402338.097142:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876324224357888:12345-0@lo:8: Request processed in 719us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.097150:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789402338.097245:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa974000 x1876324224357888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789402348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402338.097254:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789402338.097270:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789402338.097277:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789402338.097282:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789402338.097285:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6ff6b3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789402338.097307:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789402338.097312:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224357888:0@lo:8: 00000004:00080000:0.0:1789402338.098901:0:8021:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789402338.099044:0:8021:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 243247699595ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789402338.159224:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789402338.229058:0:8022:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789402338.229088:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1876324224359040:0@lo:7: 00000100:00100000:3.0:1789402338.229153:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.229200:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c7000729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.229228:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224358912:0@lo:13: 00000100:00100000:3.0:1789402338.229251:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.229290:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224359040 00000100:00100000:3.0:1789402338.229297:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224359040 00000100:00100000:3.0:1789402338.229370:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789402338.229379:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8022:x1876324224359040:12345-0@lo:7: 00000100:00080000:0.0:1789402338.230535:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789402338.230557:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224358912 00000100:00100000:0.0:1789402338.230564:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224358912 00000100:00100000:0.0:1789402338.230612:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789402338.230622:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1876324224358912:12345-0@lo:13: 00002000:00000024:0.0:1789402338.230645:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789402338.230708:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1876324224358912:12345-0@lo:13: Request processed in 87us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402338.230714:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789402338.235458:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c998a300 x1876324224358912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402338.235483:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224358912:0@lo:13: 00002000:00080000:3.0:1789402338.239279:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789402338.239287:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789402338.239402:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8022:x1876324224359040:12345-0@lo:7: Request processed in 10020us (10245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.239413:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789402338.239818:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c9989880 x1876324224359040/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789402354 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402338.239833:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1876324224359040:0@lo:7: 00000004:00080000:2.0:1789402338.239856:0:8022:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789402338.239894:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1876324224359168:0@lo:5: 00000100:00100000:2.0:1789402338.239929:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402338.239982:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.240114:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224359168 00000100:00100000:3.0:1789402338.240122:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224359168 00000100:00100000:3.0:1789402338.240164:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789402338.240173:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8022:x1876324224359168:12345-0@lo:5: 00002000:00080000:3.0:1789402338.240196:0:6691:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789402338.240200:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789402338.240464:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8022:x1876324224359168:12345-0@lo:5: Request processed in 292us (534us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789402338.240472:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789402338.240510:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da97f800 x1876324224359168/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789402354 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402338.240522:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1876324224359168:0@lo:5: 00000004:00080000:3.0:1789402338.240532:0:8022:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789402338.240554:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1876324224359296:0@lo:700: 00000100:00100000:3.0:1789402338.240577:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.240593:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.240608:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224359296 00000100:00100000:3.0:1789402338.240611:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224359296 00000100:00100000:3.0:1789402338.240635:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789402338.240642:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8022:x1876324224359296:12345-0@lo:700: 00000100:00100000:3.0:1789402338.240665:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1876324224359424:0@lo:700: 00000100:00100000:3.0:1789402338.240692:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402338.240707:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.240725:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224359424 00000100:00100000:3.0:1789402338.240728:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224359424 00000100:00100000:3.0:1789402338.240750:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789402338.240882:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1876324224359424:12345-0@lo:700: 40000000:02000000:3.0:1789402338.296423:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789402338.308369:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1876324224359424:12345-0@lo:700: Request processed in 67458us (67643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.308383:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789402338.311490:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c998a300 x1876324224359424/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789402354 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402338.311507:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1876324224359424:0@lo:700: 40000000:02000000:2.0:1789402338.311522:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1789402338.447899:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789402338.447916:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789402338.447967:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8022:x1876324224359296:12345-0@lo:700: Request processed in 207320us (207383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402338.447978:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789402338.448032:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c9988000 x1876324224359296/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789402354 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402338.448048:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1876324224359296:0@lo:700: 00000004:02000040:2.0:1789402338.496447:0:8022:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1789402338.506330:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1876324224359552:0@lo:5: 00000100:00100000:1.0:1789402338.506448:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402338.506491:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e61b3000 going to sleep for 11 seconds 00000100:00100000:3.0:1789402338.506541:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224359552 00000100:00100000:3.0:1789402338.506549:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224359552 00000100:00100000:3.0:1789402338.506592:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789402338.506600:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8022:x1876324224359552:12345-0@lo:5: 00002000:00080000:3.0:1789402338.518310:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789402338.518331:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789402338.533410:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8022:x1876324224359552:12345-0@lo:5: Request processed in 26802us (26954us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789402338.533434:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789402338.534913:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa974380 x1876324224359552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789402354 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402338.534929:0:8022:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789402338.534946:0:8022:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93c6fa974380 x1876324224359552/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789402354 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402338.534967:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1876324224359552:0@lo:5: 00000004:00080000:1.0:1789402338.534982:0:8022:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789402338.786669:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402339.043117:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224359680:0@lo:13: 00000100:00100000:3.0:1789402339.043195:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402339.043384:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224359680 00000100:00100000:2.0:1789402339.043392:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224359680 00000100:00100000:2.0:1789402339.043451:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789402339.043461:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224359680:12345-0@lo:13: 00002000:00000024:2.0:1789402339.043493:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402339.043537:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224359680:12345-0@lo:13: Request processed in 78us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402339.043544:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789402339.043694:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa974000 x1876324224359680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402339.043713:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224359680:0@lo:13: 00010000:00010000:3.0:1789402339.811759:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402340.849403:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402341.860585:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789402342.458368:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789402342.884137:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402343.140531:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224359936:0@lo:400: 00000100:00100000:2.0:1789402343.140642:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402343.140696:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224360448:0@lo:400: 00000100:00100000:2.0:1789402343.140721:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402343.140761:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789402343.140768:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224360064:0@lo:400: 00000100:00100000:2.0:1789402343.140789:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402343.140820:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224359936 00000100:00100000:2.0:1789402343.140840:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224359936 00000100:00100000:3.0:1789402343.140851:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224359808:0@lo:400: 00000100:00100000:2.0:1789402343.140881:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224360064 00000100:00100000:3.0:1789402343.140884:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402343.140884:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224360064 00000100:00100000:3.0:1789402343.140906:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224360320:0@lo:400: 00000100:00100000:2.0:1789402343.140911:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789402343.140919:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224359936:12345-0@lo:400: 00000100:00100000:3.0:1789402343.140925:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402343.140936:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402343.140941:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224360192:0@lo:400: 00000100:00100000:3.0:1789402343.140956:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402343.140966:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224359936:12345-0@lo:400: Request processed in 48us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402343.140973:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789402343.140978:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224359808 00000100:00100000:3.0:1789402343.140981:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224359808 00000100:00100000:2.0:1789402343.140987:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224360320 00000100:00100000:2.0:1789402343.140989:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224360320 00000100:00100000:2.0:1789402343.141002:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789402343.141005:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789402343.141007:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224360064:12345-0@lo:400: 00000100:00100000:3.0:1789402343.141010:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224359808:12345-0@lo:400: 00000100:00100000:2.0:1789402343.141033:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224360064:12345-0@lo:400: Request processed in 26us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402343.141039:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789402343.141049:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789402343.141056:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224360320:12345-0@lo:400: 00000100:00100000:3.0:1789402343.141097:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224359808:12345-0@lo:400: Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402343.141103:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1789402343.141164:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402343.146172:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224360448 00000100:00100000:2.0:1789402343.146186:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224360448 00000100:00100000:2.0:1789402343.146238:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224360192 00000100:00100000:2.0:1789402343.146242:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224360192 00000100:00100000:2.0:1789402343.146263:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789402343.146272:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224360448:12345-0@lo:400: 00000100:00100000:2.0:1789402343.147430:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224360448:12345-0@lo:400: Request processed in 1153us (6702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402343.147442:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789402343.147469:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789402343.147478:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224360192:12345-0@lo:400: 00000100:00100000:2.0:1789402343.147533:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224360192:12345-0@lo:400: Request processed in 57us (6575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402343.147539:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789402343.147574:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789402343.147578:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789402343.147616:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da97fb80 x1876324224360064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402343.147630:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224360064:0@lo:400: 00010000:00080000:2.0:1789402343.147642:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da97d180 x1876324224359936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402343.147649:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224359936:0@lo:400: 00010000:00080000:2.0:1789402343.147658:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da97d500 x1876324224360448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402343.147665:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789402343.147679:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224360448:0@lo:400: 00000100:00100000:2.0:1789402343.147774:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224360320:12345-0@lo:400: Request processed in 6717us (6846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402343.147782:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789402343.149583:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da97dc00 x1876324224360192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402343.149601:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224360192:0@lo:400: 00000100:00100000:3.0:1789402343.149614:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224359808:0@lo:400: 00010000:00080000:3.0:1789402343.149624:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da97d880 x1876324224360320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402343.149635:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224360320:0@lo:400: 00000100:00100000:3.0:1789402343.651408:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402343.651433:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224360576:0@lo:13: 00000100:00100000:3.0:1789402343.651497:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402343.651633:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224360576 00000100:00100000:0.0:1789402343.651641:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224360576 00000100:00100000:0.0:1789402343.651691:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789402343.651700:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224360576:12345-0@lo:13: 00002000:00000024:0.0:1789402343.651732:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789402343.651793:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224360576:12345-0@lo:13: Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402343.651806:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789402343.651888:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa976d80 x1876324224360576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402343.651906:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224360576:0@lo:13: 00010000:00010000:3.0:1789402343.906604:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402344.032080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402344.032237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199170432 00000100:00100000:1.0:1789402344.032261:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199170432 00000100:00100000:1.0:1789402344.032306:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 113 00000100:00100000:1.0:1789402344.032314:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1876324199170432:12345-192.168.203.8@tcp:250: 00010000:00080000:1.0:1789402344.032340:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9@192.168.203.8@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:1.0:1789402344.032404:0:5838:0:(genops.c:1384:class_connect()) connect: client 95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9, cookie 0x9403f4af875f7b1d 00000100:00080000:1.0:1789402344.032538:0:5838:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402344.032607:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+5:2350:x1876324199170432:12345-192.168.203.8@tcp:250: Request processed in 291us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402344.032614:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 113 00000100:00100000:2.0:1789402344.038746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402344.038914:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199170304 00000100:00100000:3.0:1789402344.038924:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199170304 00000100:00100000:1.0:1789402344.039129:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 114 00000100:00100000:1.0:1789402344.039141:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+5:5580:x1876324199170304:12345-192.168.203.8@tcp:101: 00010000:00010000:1.0:1789402344.039158:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402344.039175:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b46fab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402344.039205:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fab expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402344.039216:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fab expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402344.039224:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e800, rc 0) 00000100:00100000:1.0:1789402344.039282:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+6:5580:x1876324199170304:12345-192.168.203.8@tcp:101: Request processed in 144us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402344.039289:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 114 00000100:00100000:2.0:1789402344.048537:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402344.048612:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199170560 00000100:00100000:3.0:1789402344.048622:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199170560 00000100:00100000:3.0:1789402344.048673:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 115 00000100:00100000:3.0:1789402344.048682:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+6:5580:x1876324199170560:12345-192.168.203.8@tcp:501: 00000100:00100000:3.0:1789402344.049170:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+6:5580:x1876324199170560:12345-192.168.203.8@tcp:501: Request processed in 331us (484us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789402344.049181:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 115 00000100:00100000:2.0:1789402344.052463:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402344.052548:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199170688 00000100:00100000:3.0:1789402344.052558:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199170688 00000100:00100000:3.0:1789402344.052610:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 116 00000100:00100000:3.0:1789402344.052618:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+6:5580:x1876324199170688:12345-192.168.203.8@tcp:101: 00010000:00010000:3.0:1789402344.052634:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402344.052652:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b46fb2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402344.052680:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fb2 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402344.052690:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fb2 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402344.052698:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1506000, rc 0) 00000100:00100000:3.0:1789402344.052841:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+7:5580:x1876324199170688:12345-192.168.203.8@tcp:101: Request processed in 223us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402344.052847:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 116 00000100:00100000:2.0:1789402344.063499:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402344.063593:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199170816 00000100:00100000:1.0:1789402344.063603:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199170816 00000100:00100000:1.0:1789402344.063675:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 117 00000100:00100000:1.0:1789402344.063684:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+7:5580:x1876324199170816:12345-192.168.203.8@tcp:501: 00000100:00100000:1.0:1789402344.063983:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:5580:x1876324199170816:12345-192.168.203.8@tcp:501: Request processed in 299us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402344.063991:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 117 00000100:00100000:2.0:1789402344.073132:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402344.079168:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199170944 00000100:00100000:1.0:1789402344.079184:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199170944 00000100:00100000:1.0:1789402344.079320:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 118 00000100:00100000:1.0:1789402344.079331:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:5580:x1876324199170944:12345-192.168.203.8@tcp:503: 00000100:00100000:1.0:1789402344.079764:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:5580:x1876324199170944:12345-192.168.203.8@tcp:503: Request processed in 433us (6639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402344.079782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 118 00000100:00100000:2.0:1789402344.086439:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402344.092089:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199171072 00000100:00100000:3.0:1789402344.092135:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199171072 00000100:00100000:3.0:1789402344.092221:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 119 00000100:00100000:3.0:1789402344.092234:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:5598:x1876324199171072:12345-192.168.203.8@tcp:502: 00000100:00100000:3.0:1789402344.092741:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:5598:x1876324199171072:12345-192.168.203.8@tcp:502: Request processed in 487us (6295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402344.092752:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 119 00000100:00100000:3.0:1789402344.124122:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402344.124232:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199171200 00000100:00100000:1.0:1789402344.124246:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199171200 00000100:00100000:1.0:1789402344.124317:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 120 00000100:00100000:1.0:1789402344.124327:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:5598:x1876324199171200:12345-192.168.203.8@tcp:502: 00000100:00100000:1.0:1789402344.124649:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:5598:x1876324199171200:12345-192.168.203.8@tcp:502: Request processed in 320us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402344.124657:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 120 00000100:00100000:0.0:1789402344.135131:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402344.135248:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199171328 00000100:00100000:2.0:1789402344.135262:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199171328 00000100:00100000:2.0:1789402344.135396:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 121 00000100:00100000:2.0:1789402344.135409:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:5580:x1876324199171328:12345-192.168.203.8@tcp:101: 00010000:00010000:2.0:1789402344.135431:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402344.135456:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c70215f200/0x9403f4af875f7b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b46fdc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402344.135493:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215f200/0x9403f4af875f7b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fdc expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402344.135506:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c70215f200/0x9403f4af875f7b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fdc expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402344.135517:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215f200, rc 0) 00000100:00100000:2.0:1789402344.135587:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5580:x1876324199171328:12345-192.168.203.8@tcp:101: Request processed in 181us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402344.135595:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 121 00000100:00100000:2.0:1789402344.144150:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402344.144289:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199171456 00000100:00100000:3.0:1789402344.144302:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199171456 00000100:00100000:3.0:1789402344.144425:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 122 00000100:00100000:3.0:1789402344.144437:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5580:x1876324199171456:12345-192.168.203.8@tcp:256: 20000000:01000000:3.0:1789402344.144472:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789402344.144504:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789402344.144509:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789402344.144512:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789402344.144514:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789402344.150517:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5580:x1876324199171456:12345-192.168.203.8@tcp:256: Request processed in 6065us (6364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402344.150537:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 122 00000100:00100000:0.0:1789402344.155158:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402344.156560:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199171584 00000100:00100000:1.0:1789402344.156577:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199171584 00000100:00100000:1.0:1789402344.156654:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 123 00000100:00100000:1.0:1789402344.156665:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5580:x1876324199171584:12345-192.168.203.8@tcp:101: 00010000:00010000:1.0:1789402344.156682:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402344.156702:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b46fe3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402344.156750:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fe3 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402344.156763:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fe3 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402344.156783:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83ec00, rc 0) 00000100:00100000:1.0:1789402344.156850:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5580:x1876324199171584:12345-192.168.203.8@tcp:101: Request processed in 186us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402344.156860:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 123 00000100:00100000:3.0:1789402344.162741:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402344.162782:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224360704:0@lo:13: 00000100:00100000:3.0:1789402344.162884:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402344.163114:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224360704 00000100:00100000:1.0:1789402344.163125:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224360704 00000100:00100000:1.0:1789402344.163187:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789402344.163198:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224360704:12345-0@lo:13: 00002000:00000024:1.0:1789402344.163244:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1789402344.163494:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa976d80 x1876324224360704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402344.163517:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224360704:0@lo:13: 00000100:00100000:1.0:1789402344.166671:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224360704:12345-0@lo:13: Request processed in 3460us (3772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402344.166690:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789402344.171263:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402344.171416:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199171712 00000100:00100000:0.0:1789402344.171427:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199171712 00000100:00100000:0.0:1789402344.171490:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 124 00000100:00100000:0.0:1789402344.171505:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5580:x1876324199171712:12345-192.168.203.8@tcp:501: 00000100:00100000:0.0:1789402344.171871:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5580:x1876324199171712:12345-192.168.203.8@tcp:501: Request processed in 363us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402344.171883:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 124 00000100:00100000:3.0:1789402344.174288:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402344.174377:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199171840 00000100:00100000:2.0:1789402344.174394:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199171840 00000100:00100000:2.0:1789402344.174484:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 125 00000100:00100000:2.0:1789402344.174494:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5580:x1876324199171840:12345-192.168.203.8@tcp:503: 00000100:00100000:2.0:1789402344.174849:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5580:x1876324199171840:12345-192.168.203.8@tcp:503: Request processed in 355us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402344.174856:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 125 00000100:00100000:3.0:1789402344.177503:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402344.190136:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199171968 00000100:00100000:0.0:1789402344.190153:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199171968 00000100:00100000:0.0:1789402344.190224:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 126 00000100:00100000:0.0:1789402344.190234:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5603:x1876324199171968:12345-192.168.203.8@tcp:502: 00000100:00100000:0.0:1789402344.190547:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5603:x1876324199171968:12345-192.168.203.8@tcp:502: Request processed in 313us (13058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402344.190555:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 126 00000100:00100000:3.0:1789402344.193595:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402344.194494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199172096 00000100:00100000:0.0:1789402344.194514:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199172096 00000100:00100000:0.0:1789402344.194612:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 127 00000100:00100000:0.0:1789402344.194642:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5603:x1876324199172096:12345-192.168.203.8@tcp:502: 00000100:00100000:0.0:1789402344.194958:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5603:x1876324199172096:12345-192.168.203.8@tcp:502: Request processed in 335us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402344.194966:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 127 00000100:00100000:0.0:1789402344.206044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402344.206134:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199172224 00000100:00100000:1.0:1789402344.206144:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199172224 00000100:00100000:1.0:1789402344.206186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:1.0:1789402344.206195:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffaca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1876324199172224:12345-192.168.203.8@tcp:38: 00010000:00080000:1.0:1789402344.206223:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:1.0:1789402344.206268:0:5846:0:(genops.c:1384:class_connect()) connect: client 4785302d-2648-4148-8042-c10a24a5dd29, cookie 0x9403f4af875f7b40 00000004:00100000:1.0:1789402344.206298:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789402344.206305:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789402344.252639:0:5846:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402344.252878:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffaca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2350:x1876324199172224:12345-192.168.203.8@tcp:38: Request processed in 46567us (46727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402344.252896:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 4 00010000:00010000:1.0:1789402344.930578:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402345.256722:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402345.256867:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199172480 00000100:00100000:2.0:1789402345.256891:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199172480 00000100:00100000:2.0:1789402345.256966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:2.0:1789402345.256976:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:5580:x1876324199172480:12345-192.168.203.8@tcp:41: 00000004:00000024:2.0:1789402345.257028:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789402345.257092:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:5580:x1876324199172480:12345-192.168.203.8@tcp:41: Request processed in 117us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402345.257100:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00080000:0.0:1789402345.257206:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402345.257468:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402345.257810:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199172352 00000100:00100000:0.0:1789402345.257816:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199172352 00000100:00100000:0.0:1789402345.257855:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:0.0:1789402345.257862:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:0:x1876324199172352:12345-192.168.203.8@tcp:41: 00000004:00000024:0.0:1789402345.257876:0:6712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789402345.257915:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:0:x1876324199172352:12345-192.168.203.8@tcp:41: Request processed in 54us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402345.257921:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:2.0:1789402345.261414:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402345.261705:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199172608 00000100:00100000:3.0:1789402345.261714:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199172608 00000100:00100000:3.0:1789402345.261771:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:3.0:1789402345.261781:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:5580:x1876324199172608:12345-192.168.203.8@tcp:40: 00000100:00100000:3.0:1789402345.261871:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:5580:x1876324199172608:12345-192.168.203.8@tcp:40: Request processed in 91us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402345.261891:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:3.0:1789402345.270051:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402345.270107:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402345.270335:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199172992 00000100:00100000:0.0:1789402345.270387:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199172992 00000100:00100000:0.0:1789402345.270456:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:0.0:1789402345.270467:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:5580:x1876324199172992:12345-192.168.203.8@tcp:33: 00000100:00100000:3.0:1789402345.271530:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402345.271772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199173120 00000100:00100000:1.0:1789402345.271784:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199173120 00000100:00100000:1.0:1789402345.271829:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 128 00000100:00100000:1.0:1789402345.271838:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199173120:12345-192.168.203.8@tcp:400: 00000100:00100000:1.0:1789402345.271912:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199173120:12345-192.168.203.8@tcp:400: Request processed in 74us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402345.271919:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 128 00000100:00100000:2.0:1789402345.272516:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199172736 00000100:00100000:2.0:1789402345.272523:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199172736 00000100:00100000:2.0:1789402345.272556:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:2.0:1789402345.272563:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1876324199172736:12345-192.168.203.8@tcp:8: 00010000:00080000:2.0:1789402345.272587:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1789402345.272622:0:6689:0:(genops.c:1384:class_connect()) connect: client 4785302d-2648-4148-8042-c10a24a5dd29, cookie 0x9403f4af875f7b47 00002000:00100000:2.0:1789402345.272638:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4785302d-2648-4148-8042-c10a24a5dd29/ffff93c6eec1f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789402345.272648:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789402345.273141:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789402345.273170:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93c6eec1e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789402345.273605:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2350:x1876324199172736:12345-192.168.203.8@tcp:8: Request processed in 1034us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402345.273613:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:3.0:1789402345.278087:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402345.278179:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199172864 00000100:00100000:2.0:1789402345.278188:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199172864 00000100:00100000:2.0:1789402345.278233:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:2.0:1789402345.278241:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876324199172864:12345-192.168.203.8@tcp:8: 00010000:00080000:2.0:1789402345.278284:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1789402345.278313:0:6690:0:(genops.c:1384:class_connect()) connect: client 4785302d-2648-4148-8042-c10a24a5dd29, cookie 0x9403f4af875f7b4e 00002000:00100000:2.0:1789402345.278324:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4785302d-2648-4148-8042-c10a24a5dd29/ffff93c6eec1b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789402345.278392:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789402345.278703:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789402345.278749:0:6690:0:(import.c:65:import_set_state_nolock()) ffff93c6eec18800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789402345.278811:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2350:x1876324199172864:12345-192.168.203.8@tcp:8: Request processed in 569us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402345.278818:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000004:00080000:3.0:1789402345.303765:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33224us 00000004:00200000:3.0:1789402345.316200:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789402345.317020:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:5580:x1876324199172992:12345-192.168.203.8@tcp:33: Request processed in 45952us (46309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402345.317044:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:3.0:1789402345.561133:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402345.561247:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199173248 00000100:00100000:0.0:1789402345.561261:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199173248 00000100:00100000:0.0:1789402345.561335:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:0.0:1789402345.561413:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:5620:x1876324199173248:12345-192.168.203.8@tcp:101: 00010000:00010000:0.0:1789402345.561440:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402345.561471:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7b55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4700d expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402345.561579:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82600/0x9403f4af875f7b5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402345.561595:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82600/0x9403f4af875f7b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402345.561612:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82600/0x9403f4af875f7b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402345.561667:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789402345.561672:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402345.561690:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82600/0x9403f4af875f7b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402345.561718:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7b55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4700d expref: 8 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402345.561736:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82600/0x9403f4af875f7b5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4700d expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402345.561745:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:0.0:1789402345.561748:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789402345.561752:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82600, rc 0) 00000100:00100000:0.0:1789402345.561823:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:5620:x1876324199173248:12345-192.168.203.8@tcp:101: Request processed in 478us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402345.561831:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 8 00010000:00010000:3.0:1789402345.955010:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402346.978659:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402347.676743:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402347.676825:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199173376 00000100:00100000:3.0:1789402347.676834:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199173376 00000100:00100000:3.0:1789402347.676906:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:3.0:1789402347.676917:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:5672:x1876324199173376:12345-192.168.203.8@tcp:41: 00000004:00000024:3.0:1789402347.676959:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789402347.677030:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:5672:x1876324199173376:12345-192.168.203.8@tcp:41: Request processed in 116us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402347.677038:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00080000:0.0:1789402347.677392:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402347.682245:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402347.682380:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199173504 00000100:00100000:3.0:1789402347.682391:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199173504 00000100:00100000:3.0:1789402347.682461:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:3.0:1789402347.682472:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4785302d-2648-4148-8042-c10a24a5dd29+6:5672:x1876324199173504:12345-192.168.203.8@tcp:13: 00002000:00000024:3.0:1789402347.682510:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789402347.682672:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789402347.682884:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4785302d-2648-4148-8042-c10a24a5dd29+6:5672:x1876324199173504:12345-192.168.203.8@tcp:13: Request processed in 413us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402347.682898:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:1.0:1789402347.697380:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402347.697479:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199173632 00000100:00100000:0.0:1789402347.697489:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199173632 00000100:00100000:0.0:1789402347.697562:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:0.0:1789402347.697584:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4785302d-2648-4148-8042-c10a24a5dd29+6:5672:x1876324199173632:12345-192.168.203.8@tcp:13: 00002000:00000024:0.0:1789402347.697621:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789402347.697685:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4785302d-2648-4148-8042-c10a24a5dd29+6:5672:x1876324199173632:12345-192.168.203.8@tcp:13: Request processed in 113us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402347.697692:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00080000:2.0:1789402347.698232:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789402348.002853:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402348.261204:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224360832:0@lo:400: 00000100:00100000:3.0:1789402348.261302:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402348.261447:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224361344:0@lo:400: 00000100:00100000:3.0:1789402348.261593:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402348.261625:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402348.261632:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224361216:0@lo:400: 00000100:00100000:3.0:1789402348.261660:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402348.261694:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224360832 00000100:00100000:3.0:1789402348.261704:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224360832 00000100:00100000:3.0:1789402348.262722:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789402348.263217:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffaca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224360960:0@lo:400: 00000100:00100000:0.0:1789402348.263304:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402348.263383:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224361472:0@lo:400: 00000100:00100000:0.0:1789402348.263415:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402348.263446:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402348.264116:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224360832:12345-0@lo:400: 00000100:00100000:3.0:1789402348.264198:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224360832:12345-0@lo:400: Request processed in 1464us (2896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402348.264207:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789402348.264264:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224361344 00000100:00100000:3.0:1789402348.264274:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224361344 00000100:00100000:3.0:1789402348.264365:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224360960 00000100:00100000:3.0:1789402348.264369:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224360960 00000100:00100000:3.0:1789402348.264394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789402348.264403:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224361344:12345-0@lo:400: 00000100:00100000:3.0:1789402348.265027:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224361344:12345-0@lo:400: Request processed in 623us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402348.265036:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789402348.265056:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789402348.265294:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224361216 00000100:00100000:2.0:1789402348.265302:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224361216 00000100:00100000:2.0:1789402348.265366:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224361472 00000100:00100000:2.0:1789402348.265371:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224361472 00000100:00100000:0.0:1789402348.265382:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789402348.265391:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789402348.265393:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224361216:12345-0@lo:400: 00000100:00100000:2.0:1789402348.265399:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789402348.265449:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224360832:0@lo:400: 00000100:00100000:3.0:1789402348.265839:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224360960:12345-0@lo:400: 00000100:00100000:0.0:1789402348.265909:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224361216:12345-0@lo:400: Request processed in 518us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402348.265918:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789402348.265940:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789402348.265947:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224361472:12345-0@lo:400: 00000100:00100000:0.0:1789402348.265980:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224361472:12345-0@lo:400: Request processed in 33us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402348.265986:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789402348.266191:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224361088:0@lo:400: 00000100:00100000:0.0:1789402348.266237:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789402348.266286:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6ffac9180 x1876324224361472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402348.266310:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224361472:0@lo:400: 00000100:00100000:0.0:1789402348.266382:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224361088 00000100:00100000:0.0:1789402348.266388:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224361088 00000100:00100000:0.0:1789402348.266435:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789402348.266444:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224361088:12345-0@lo:400: 00000100:00100000:0.0:1789402348.266564:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224361088:12345-0@lo:400: Request processed in 121us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402348.266573:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789402348.266632:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224361088:0@lo:400: 00000100:00080000:0.0:1789402348.267008:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789402348.267014:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789402348.267018:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402348.270378:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224361344:0@lo:400: 00010000:00080000:2.0:1789402348.270448:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6ffac8380 x1876324224361216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402348.270465:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224361216:0@lo:400: 00000100:00100000:3.0:1789402348.275382:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224360960:12345-0@lo:400: Request processed in 9263us (11793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402348.275402:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789402348.276075:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffaca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224360960:0@lo:400: 00000001:00100000:1.0:1789402348.356895:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000100:00100000:3.0:1789402348.781468:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224361600:0@lo:13: 00000100:00100000:3.0:1789402348.781534:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402348.781604:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224361600 00000100:00100000:3.0:1789402348.781611:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224361600 00000100:00100000:3.0:1789402348.781655:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789402348.781663:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224361600:12345-0@lo:13: 00002000:00000024:3.0:1789402348.781684:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402348.781727:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224361600:12345-0@lo:13: Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402348.781733:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789402348.781774:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb57b800 x1876324224361600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402348.781793:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224361600:0@lo:13: 00010000:00010000:1.0:1789402349.027316:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402349.284295:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224361728:0@lo:13: 00000100:00100000:0.0:1789402349.284398:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402349.284571:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224361728 00000100:00100000:3.0:1789402349.284580:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224361728 00000100:00100000:3.0:1789402349.284631:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789402349.284641:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224361728:12345-0@lo:13: 00002000:00000024:3.0:1789402349.284685:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402349.284728:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224361728:12345-0@lo:13: Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402349.284735:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789402349.284993:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa975180 x1876324224361728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402349.285171:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224361728:0@lo:13: 00000001:00100000:1.0:1789402349.346041:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000001:00100000:1.0:1789402349.847970:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00010000:00010000:0.0:1789402350.059279:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789402350.402837:0:8302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789402350.630583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402350.630625:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402350.630647:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402350.630696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402350.630827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199173760 00000100:00100000:0.0:1789402350.630837:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199173760 00000100:00100000:0.0:1789402350.630898:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 130 00000100:00100000:0.0:1789402350.630909:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199173760:12345-192.168.203.8@tcp:400: 00000100:00100000:0.0:1789402350.630977:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199173760:12345-192.168.203.8@tcp:400: Request processed in 70us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402350.630984:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 130 00000100:00100000:0.0:1789402350.631015:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199174016 00000100:00100000:0.0:1789402350.631018:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199174016 00000100:00100000:0.0:1789402350.631050:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199174144 00000100:00100000:0.0:1789402350.631053:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199174144 00000100:00100000:0.0:1789402350.631086:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:0.0:1789402350.631092:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199174016:12345-192.168.203.8@tcp:400: 00000100:00100000:0.0:1789402350.631120:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199174016:12345-192.168.203.8@tcp:400: Request processed in 28us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402350.631126:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:0.0:1789402350.631137:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:0.0:1789402350.631144:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199174144:12345-192.168.203.8@tcp:400: 00000100:00100000:0.0:1789402350.631167:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199174144:12345-192.168.203.8@tcp:400: Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402350.631173:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:0.0:1789402350.631192:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199173888 00000100:00100000:0.0:1789402350.631195:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199173888 00000100:00100000:0.0:1789402350.631222:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00100000:0.0:1789402350.631228:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199173888:12345-192.168.203.8@tcp:400: 00000100:00100000:0.0:1789402350.631255:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199173888:12345-192.168.203.8@tcp:400: Request processed in 26us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402350.631260:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00080000:0.0:1789402350.631426:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789402350.631431:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789402350.631433:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789402351.074732:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402352.103287:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402353.124439:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402353.381570:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224361984:0@lo:400: 00000100:00100000:0.0:1789402353.381728:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224361856:0@lo:400: 00000100:00100000:0.0:1789402353.381765:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402353.381809:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb57bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224362368:0@lo:400: 00000100:00100000:0.0:1789402353.381852:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224361856 00000100:00100000:0.0:1789402353.381860:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224361856 00000100:00100000:0.0:1789402353.381906:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789402353.381929:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224361856:12345-0@lo:400: 00000100:00100000:0.0:1789402353.381976:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224361856:12345-0@lo:400: Request processed in 48us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402353.381983:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789402353.382228:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402353.382263:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224362496:0@lo:400: 00000100:00100000:3.0:1789402353.382288:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402353.382321:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402353.382327:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224362112:0@lo:400: 00000100:00100000:3.0:1789402353.382373:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402353.382404:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224362496 00000100:00100000:3.0:1789402353.382408:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224362496 00000100:00100000:3.0:1789402353.382450:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789402353.382458:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224362496:12345-0@lo:400: 00000100:00100000:3.0:1789402353.382495:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224362496:12345-0@lo:400: Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402353.382501:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789402353.382522:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224361984 00000100:00100000:3.0:1789402353.382525:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224361984 00000100:00100000:3.0:1789402353.382547:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224362112 00000100:00100000:3.0:1789402353.382551:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224362112 00000100:00100000:3.0:1789402353.382570:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789402353.382576:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224361984:12345-0@lo:400: 00000100:00100000:3.0:1789402353.382605:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224361984:12345-0@lo:400: Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402353.382611:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789402353.382622:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789402353.382628:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224362112:12345-0@lo:400: 00000100:00100000:3.0:1789402353.382725:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224362112:12345-0@lo:400: Request processed in 97us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402353.382740:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789402353.382758:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789402353.382762:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402353.382791:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224362112:0@lo:400: 00000100:00100000:3.0:1789402353.382801:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224361984:0@lo:400: 00010000:00080000:3.0:1789402353.382811:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb579180 x1876324224362496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402353.382820:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224362496:0@lo:400: 00000100:00100000:1.0:1789402353.382971:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224362240:0@lo:400: 00000100:00100000:1.0:1789402353.383004:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402353.383042:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224362240 00000100:00100000:1.0:1789402353.383047:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224362240 00000100:00100000:1.0:1789402353.387943:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789402353.387958:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224362240:12345-0@lo:400: 00000100:00100000:1.0:1789402353.388046:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224362240:12345-0@lo:400: Request processed in 92us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402353.388052:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789402353.388097:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb578380 x1876324224362240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402353.388112:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224362240:0@lo:400: 00000100:00100000:1.0:1789402353.389850:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402353.389920:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224361856:0@lo:400: 00000100:00100000:2.0:1789402353.390028:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224362368 00000100:00100000:2.0:1789402353.390036:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224362368 00000100:00100000:2.0:1789402353.390078:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789402353.390086:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224362368:12345-0@lo:400: 00000100:00100000:2.0:1789402353.390156:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224362368:12345-0@lo:400: Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.390164:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789402353.390973:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb57bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224362368:0@lo:400: 00000100:00080000:2.0:1789402353.392405:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789402353.392413:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789402353.844965:0:8449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe017c7c40 20000000:00000080:2.0:1789402353.844981:0:8449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c7003ca800 uarg=0000000000000000 20000000:01000000:2.0:1789402353.845015:0:8449:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789402353.845017:0:8449:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789402353.845020:0:8449:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789402353.845024:0:8449:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789402353.845029:0:8449:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789402353.845089:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789402353.845092:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789402353.845252:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789402353.845255:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789402353.847165:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789402353.847574:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789402353.847638:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789402353.847684:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1789402353.847702:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789402353.847705:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789402353.850170:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789402353.850607:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789402353.850653:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789402353.850704:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1789402353.850716:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789402353.850718:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789402353.855524:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789402353.856182:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789402353.856248:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789402353.856286:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789402353.856300:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789402353.856303:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789402353.856955:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789402353.860868:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789402353.860925:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789402353.860961:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1789402353.860981:0:8449:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789402353.861002:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861019:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7a59 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861027:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7a83 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861034:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7aad expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861052:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7abb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861059:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7ac9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861065:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7ae5 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861072:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7b08 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861081:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fab expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861088:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fb2 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861095:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861133:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fb2 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861146:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fb2 expref: 9 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.861159:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224362624:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402353.861293:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fab expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861318:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fab expref: 9 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.861328:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224362752:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402353.861393:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7b08 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.861401:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7b08 expref: 18 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.861410:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224362880:0@lo:104: 00000100:00100000:1.0:1789402353.861445:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789402353.861485:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7ae5 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.861488:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224362880 00000100:00100000:2.0:1789402353.861497:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224362880 00010000:00010000:1.0:1789402353.861498:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7ae5 expref: 18 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.861509:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363008:0@lo:104: 00000100:00100000:1.0:1789402353.861535:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789402353.865206:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7ac9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.865287:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7ac9 expref: 18 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.865302:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363136:0@lo:104: 00010000:00010000:1.0:1789402353.865381:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7abb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.865402:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7abb expref: 18 pid: 5836 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.865411:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363264:0@lo:104: 00010000:00010000:1.0:1789402353.865435:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7aad expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.865442:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7aad expref: 18 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.865450:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363392:0@lo:104: 00010000:00010000:1.0:1789402353.865469:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7a83 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.865476:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7a83 expref: 18 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.865483:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363520:0@lo:104: 00010000:00010000:1.0:1789402353.865514:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7a59 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.865522:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7a59 expref: 18 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.865530:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363648:0@lo:104: 00000100:00100000:1.0:1789402353.865546:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402353.869406:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402353.869437:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402353.871630:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224362624:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402353.871646:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789402353.871667:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224362752:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402353.871686:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402353.871722:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402353.871747:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402353.871760:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402353.871769:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402353.871779:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224363008 00000100:00100000:2.0:1789402353.871792:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224363008 00000100:00100000:2.0:1789402353.871830:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224363136 00000100:00100000:2.0:1789402353.871833:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224363136 00000100:00100000:2.0:1789402353.871843:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224363264 00000100:00100000:2.0:1789402353.871846:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224363264 00000100:00100000:2.0:1789402353.871854:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224363392 00000100:00100000:2.0:1789402353.871856:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224363392 00000100:00100000:2.0:1789402353.871865:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224363520 00000100:00100000:2.0:1789402353.871867:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224363520 00000100:00100000:2.0:1789402353.871874:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224363648 00000100:00100000:2.0:1789402353.871876:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224363648 00000100:00100000:2.0:1789402353.871886:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789402353.871894:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+9:8449:x1876324224362880:12345-0@lo:104: 00010000:00010000:2.0:1789402353.871911:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.871984:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789402353.871990:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+9:8449:x1876324224362880:12345-0@lo:104: Request processed in 97us (10546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.871997:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789402353.872015:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789402353.872021:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddf9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+8:8449:x1876324224363008:12345-0@lo:104: 00010000:00010000:2.0:1789402353.872029:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.872061:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789402353.872067:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddf9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+8:8449:x1876324224363008:12345-0@lo:104: Request processed in 47us (10532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.872073:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789402353.872558:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789402353.872575:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+7:8449:x1876324224363136:12345-0@lo:104: 00010000:00010000:2.0:1789402353.872583:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.872615:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789402353.872620:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+7:8449:x1876324224363136:12345-0@lo:104: Request processed in 47us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.872625:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789402353.872638:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789402353.872644:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+6:8449:x1876324224363264:12345-0@lo:104: 00010000:00010000:2.0:1789402353.872651:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.872676:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789402353.872681:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+6:8449:x1876324224363264:12345-0@lo:104: Request processed in 38us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.872687:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789402353.872698:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789402353.872771:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+5:8449:x1876324224363392:12345-0@lo:104: 00010000:00010000:2.0:1789402353.872779:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.872808:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789402353.872813:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+5:8449:x1876324224363392:12345-0@lo:104: Request processed in 46us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.872819:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789402353.872832:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789402353.872844:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+4:8449:x1876324224363520:12345-0@lo:104: 00010000:00010000:2.0:1789402353.872852:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.872878:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789402353.872882:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+4:8449:x1876324224363520:12345-0@lo:104: Request processed in 40us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.872887:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789402353.872899:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789402353.872905:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:8449:x1876324224363648:12345-0@lo:104: 00010000:00010000:2.0:1789402353.872912:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.872937:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789402353.872942:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:8449:x1876324224363648:12345-0@lo:104: Request processed in 38us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.872948:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789402353.872971:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224362880:0@lo:104: 00010000:00010000:2.0:1789402353.872978:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789402353.872985:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.872989:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363008:0@lo:104: 00010000:00010000:2.0:1789402353.872999:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83800 already unused, calling callback (ffffffffc1d64c20) 00000100:00100000:1.0:1789402353.873003:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363136:0@lo:104: 10000000:00010000:2.0:1789402353.873004:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.873013:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363264:0@lo:104: 00010000:00010000:2.0:1789402353.873017:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.873023:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363392:0@lo:104: 10000000:00010000:2.0:1789402353.873030:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.873033:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363520:0@lo:104: 00000100:00100000:1.0:1789402353.873042:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1876324224363648:0@lo:104: 10000000:01000000:2.0:1789402353.873046:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402353.873083:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.873086:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873160:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402353.873184:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873192:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f7b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7b0f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873206:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789402353.873209:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873219:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83f800 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402353.873222:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873229:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402353.873235:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402353.873241:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402353.873256:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.873261:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224363776:0@lo:103: 00010000:00010000:2.0:1789402353.873264:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402353.873286:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873293:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f800/0x9403f4af875f7ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7aec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.873301:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789402353.873304:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789402353.873319:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873326:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1506400 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402353.873329:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873336:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402353.873365:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402353.873371:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402353.873387:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873392:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402353.873398:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873404:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1506400/0x9403f4af875f7ac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7ad0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873413:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789402353.873572:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873580:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1506600 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402353.873583:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873589:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402353.873595:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402353.873599:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402353.873613:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873618:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402353.873634:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873640:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1506600/0x9403f4af875f7abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7ac2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873649:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789402353.873652:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873658:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1507200 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402353.873660:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.873678:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402353.873684:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402353.873688:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402353.873701:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874170:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402353.874177:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874183:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7aad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7ab4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874194:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789402353.874197:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874202:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83f200 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402353.874205:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874211:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402353.874218:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402353.874229:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402353.874243:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874249:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402353.874253:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874260:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f200/0x9403f4af875f7a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a8a expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874268:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402353.874271:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874276:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402353.874279:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874285:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402353.874291:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402353.874296:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402353.874317:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874323:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402353.874334:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874340:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82000/0x9403f4af875f7a59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a60 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.874378:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402353.874380:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402353.874382:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402353.874390:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402353.874410:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224363904:0@lo:103: 00000100:00100000:2.0:1789402353.874800:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402353.874825:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224364416:0@lo:103: 00000100:00100000:2.0:1789402353.874843:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402353.874854:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789402353.874860:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224364032:0@lo:103: 00000100:00100000:2.0:1789402353.874876:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402353.874884:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224364544:0@lo:103: 00000100:00100000:2.0:1789402353.874904:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402353.874942:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224364288:0@lo:103: 00000100:00100000:1.0:1789402353.874970:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402353.874984:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789402353.874989:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224364160:0@lo:103: 00000100:00100000:1.0:1789402353.875007:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402353.875074:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1789402353.875584:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199174272 00000100:00100000:2.0:1789402353.875591:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199174272 00010000:00010000:2.0:1789402353.875623:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fb2 expref: 10 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.875642:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199174400 00000100:00100000:2.0:1789402353.875644:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199174400 00010000:00010000:2.0:1789402353.875656:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fab expref: 11 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.875664:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224363776 00000100:00100000:2.0:1789402353.875674:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224363776 00010000:00010000:2.0:1789402353.875686:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7b08 expref: 19 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.875696:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224363904 00000100:00100000:2.0:1789402353.875699:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224363904 00010000:00010000:2.0:1789402353.876058:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7ae5 expref: 20 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.876072:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224364416 00000100:00100000:2.0:1789402353.876075:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224364416 00010000:00010000:2.0:1789402353.876088:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7a83 expref: 21 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.876170:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224364032 00000100:00100000:2.0:1789402353.876173:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224364032 00010000:00010000:2.0:1789402353.876185:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7ac9 expref: 22 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.876194:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224364544 00000100:00100000:2.0:1789402353.876196:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224364544 00010000:00010000:2.0:1789402353.876205:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7a59 expref: 23 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.876214:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224364288 00000100:00100000:2.0:1789402353.876218:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224364288 00010000:00010000:2.0:1789402353.876225:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7aad expref: 24 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.876234:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224364160 00000100:00100000:2.0:1789402353.876236:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224364160 00010000:00010000:2.0:1789402353.876245:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7abb expref: 25 pid: 5836 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402353.876270:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:2.0:1789402353.876277:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:2352:x1876324199174272:12345-192.168.203.8@tcp:103: 00010000:00010000:2.0:1789402353.876291:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402353.876297:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fb2 expref: 11 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876319:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fb2 expref: 11 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876335:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7b2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fb2 expref: 11 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876379:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402353.876442:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199174272:12345-192.168.203.8@tcp:103: Request processed in 160us (7042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.876449:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:2.0:1789402353.876467:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:2.0:1789402353.876476:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:2352:x1876324199174400:12345-192.168.203.8@tcp:103: 00010000:00010000:2.0:1789402353.876485:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402353.876489:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fab expref: 9 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876500:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fab expref: 9 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876510:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7b24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fab expref: 9 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876529:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402353.876548:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:2352:x1876324199174400:12345-192.168.203.8@tcp:103: Request processed in 74us (7111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.876554:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:2.0:1789402353.876570:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789402353.876579:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+25:3316:x1876324224363776:12345-0@lo:103: 00010000:00010000:2.0:1789402353.876587:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402353.876593:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7b08 expref: 25 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876602:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7b08 expref: 25 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876613:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7b08 expref: 25 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876621:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402353.876663:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+24:3316:x1876324224363776:12345-0@lo:103: Request processed in 86us (3363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.876669:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789402353.876681:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789402353.876686:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+23:3313:x1876324224363904:12345-0@lo:103: 00010000:00010000:2.0:1789402353.876694:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402353.876698:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7ae5 expref: 23 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876812:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7ae5 expref: 23 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876831:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7ae5 expref: 23 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876842:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402353.876867:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224363776:0@lo:103: 00000100:00100000:2.0:1789402353.876886:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+22:3313:x1876324224363904:12345-0@lo:103: Request processed in 198us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.876894:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789402353.876910:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789402353.876916:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+21:3313:x1876324224364416:12345-0@lo:103: 00010000:00010000:2.0:1789402353.876925:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402353.876929:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7a83 expref: 21 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876938:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7a83 expref: 21 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876947:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83f400/0x9403f4af875f7a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7a83 expref: 21 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.876955:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402353.876978:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+20:3313:x1876324224364416:12345-0@lo:103: Request processed in 63us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.876983:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789402353.876994:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789402353.877000:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224364032:12345-0@lo:103: 00010000:00010000:2.0:1789402353.877007:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402353.877011:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7ac9 expref: 19 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.877026:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7ac9 expref: 19 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.877035:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7ad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7ac9 expref: 19 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.877042:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402353.877066:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:3313:x1876324224364032:12345-0@lo:103: Request processed in 66us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.877071:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789402353.877084:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789402353.877089:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:3313:x1876324224364544:12345-0@lo:103: 00010000:00010000:2.0:1789402353.877279:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402353.877286:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7a59 expref: 17 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.877295:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7a59 expref: 17 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.877304:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f7a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7a59 expref: 17 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.877324:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402353.877434:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789402353.877443:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789402353.877793:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3313:x1876324224364544:12345-0@lo:103: Request processed in 702us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.877799:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789402353.877834:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789402353.877841:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:3316:x1876324224364288:12345-0@lo:103: 00010000:00010000:2.0:1789402353.877855:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402353.877861:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7aad expref: 15 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.877869:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7aad expref: 15 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.877879:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215fa00/0x9403f4af875f7ab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7aad expref: 15 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.877888:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402353.877969:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+14:3316:x1876324224364288:12345-0@lo:103: Request processed in 128us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.877975:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789402353.877990:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789402353.877998:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:3316:x1876324224364160:12345-0@lo:103: 00010000:00010000:2.0:1789402353.878006:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402353.878011:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7abb expref: 13 pid: 5836 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878021:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7abb expref: 13 pid: 5836 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878035:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506800/0x9403f4af875f7ac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7abb expref: 13 pid: 5836 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878047:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878056:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878078:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878085:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878161:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878171:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878177:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83fa00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402353.878181:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878189:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878203:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402353.878213:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402353.878238:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+12:3316:x1876324224364160:12345-0@lo:103: Request processed in 242us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402353.878244:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789402353.878283:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224364032:0@lo:103: 00000100:00100000:2.0:1789402353.878292:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224364544:0@lo:103: 00000100:00100000:2.0:1789402353.878299:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224363904:0@lo:103: 00000100:00100000:2.0:1789402353.878326:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224364416:0@lo:103: 00000100:00100000:1.0:1789402353.878689:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224364288:0@lo:103: 00000100:00100000:1.0:1789402353.878702:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224364160:0@lo:103: 00010000:00010000:1.0:1789402353.878788:0:8449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.878801:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402353.878807:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83fa00/0x9403f4af875f7b63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402353.892214:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789402353.892239:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224364672:0@lo:13: 00000100:00100000:1.0:1789402353.892319:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402353.899199:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224364672 00000100:00100000:3.0:1789402353.899212:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224364672 00000100:00100000:3.0:1789402353.899275:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789402353.899284:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224364672:12345-0@lo:13: 00002000:00000024:3.0:1789402353.899339:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1789402353.899553:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31bce00 x1876324224364672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402353.899573:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224364672:0@lo:13: 00000100:00100000:3.0:1789402353.900786:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224364672:12345-0@lo:13: Request processed in 1498us (8474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402353.900797:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789402354.146561:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402354.407730:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224364800:0@lo:13: 00000100:00100000:1.0:1789402354.407802:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402354.409510:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224364800 00000100:00100000:3.0:1789402354.409522:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224364800 00000100:00100000:3.0:1789402354.409581:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789402354.409591:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224364800:12345-0@lo:13: 00002000:00000024:3.0:1789402354.409628:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402354.409693:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224364800:12345-0@lo:13: Request processed in 104us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402354.409700:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789402354.409836:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7006d4380 x1876324224364800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402354.409856:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224364800:0@lo:13: 00010000:00010000:2.0:1789402355.170514:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402355.742788:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402355.747415:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199174656 00000100:00100000:3.0:1789402355.747430:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199174656 00000100:00100000:3.0:1789402355.747520:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 29 00000100:00100000:3.0:1789402355.747532:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199174656:12345-192.168.203.8@tcp:400: 00000100:00100000:3.0:1789402355.747620:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199174656:12345-192.168.203.8@tcp:400: Request processed in 90us (4840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.747627:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 29 00000100:00080000:2.0:1789402355.747739:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402355.748163:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402355.748218:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402355.748250:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402355.748330:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199174528 00000100:00100000:2.0:1789402355.748336:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199174528 00000100:00100000:3.0:1789402355.748392:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199174912 00000100:00100000:3.0:1789402355.748398:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199174912 00000100:00100000:2.0:1789402355.748403:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 132 00000100:00100000:2.0:1789402355.748414:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:2351:x1876324199174528:12345-192.168.203.8@tcp:400: 00000100:00100000:3.0:1789402355.748436:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199174784 00000100:00100000:3.0:1789402355.748440:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199174784 00000100:00100000:2.0:1789402355.748457:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:2351:x1876324199174528:12345-192.168.203.8@tcp:400: Request processed in 45us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.748465:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:2.0:1789402355.748466:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 132 00000100:00100000:3.0:1789402355.748480:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199174912:12345-192.168.203.8@tcp:400: 00000100:00100000:3.0:1789402355.748511:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199174912:12345-192.168.203.8@tcp:400: Request processed in 36us (5676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.748531:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:3.0:1789402355.748546:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:3.0:1789402355.748553:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199174784:12345-192.168.203.8@tcp:400: 00000100:00080000:2.0:1789402355.748560:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789402355.748565:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402355.748578:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199174784:12345-192.168.203.8@tcp:400: Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.748586:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 14 10000000:01000000:2.0:1789402355.810525:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789402355.810533:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6ff7f4000 from 39 10000000:01000000:2.0:1789402355.810538:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789402355.810598:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.810609:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.810621:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402355.810644:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224364928:0@lo:101: 00000100:00100000:2.0:1789402355.810710:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402355.810837:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c54593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402355.812672:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224364928 00000100:00100000:0.0:1789402355.812685:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224364928 00000100:00100000:0.0:1789402355.812751:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789402355.812761:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+12:5841:x1876324224364928:12345-0@lo:101: 00010000:00010000:0.0:1789402355.812776:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402355.812794:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f7b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7b6a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402355.812981:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f7b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7b6a expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402355.812995:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f7b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7b6a expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402355.813005:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83200, rc 0) 00000100:00100000:0.0:1789402355.813172:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224364928:12345-0@lo:101: Request processed in 412us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402355.813189:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789402355.815422:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224364928:0@lo:101: 00010000:00010000:2.0:1789402355.815449:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.815461:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402355.815536:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365056:0@lo:501: 00000100:00100000:2.0:1789402355.815697:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402355.815799:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c54593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402355.819987:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224365056 00000100:00100000:0.0:1789402355.820002:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224365056 00000100:00100000:1.0:1789402355.823586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789402355.823600:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224365056:12345-0@lo:501: 00000100:00100000:1.0:1789402355.824382:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224365056:12345-0@lo:501: Request processed in 783us (8683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402355.824390:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789402355.824513:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365056:0@lo:501: 00000100:00100000:3.0:1789402355.824577:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365184:0@lo:503: 00000100:00100000:3.0:1789402355.824621:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.824660:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402355.824776:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224365184 00000100:00100000:0.0:1789402355.824782:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224365184 00000100:00100000:0.0:1789402355.824819:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789402355.824897:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224365184:12345-0@lo:503: 00000100:00100000:0.0:1789402355.825054:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224365184:12345-0@lo:503: Request processed in 161us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402355.825125:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789402355.825283:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365184:0@lo:503: 00000100:00100000:3.0:1789402355.825736:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8469:1876324224365312:0@lo:502: 00000100:00100000:3.0:1789402355.825774:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.825852:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a42780 going to sleep for 11 seconds 00000100:00100000:0.0:1789402355.826061:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224365312 00000100:00100000:0.0:1789402355.826251:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224365312 00000100:00100000:0.0:1789402355.826325:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789402355.826334:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:8469:x1876324224365312:12345-0@lo:502: 00000100:00100000:0.0:1789402355.826681:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+13:8469:x1876324224365312:12345-0@lo:502: Request processed in 348us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402355.826689:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789402355.826803:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8469:1876324224365312:0@lo:502: 00000100:00100000:3.0:1789402355.826860:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8469:1876324224365440:0@lo:502: 00000100:00100000:3.0:1789402355.826894:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.827089:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a42780 going to sleep for 11 seconds 00000100:00100000:2.0:1789402355.827222:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224365440 00000100:00100000:2.0:1789402355.827229:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224365440 00000100:00100000:2.0:1789402355.827253:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789402355.827259:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:8469:x1876324224365440:12345-0@lo:502: 00000100:00100000:2.0:1789402355.827448:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:8469:x1876324224365440:12345-0@lo:502: Request processed in 188us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402355.827455:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789402355.827560:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8469:1876324224365440:0@lo:502: 00000040:00080000:3.0:1789402355.827583:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789402355.827777:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789402355.827795:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789402355.827804:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.827814:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402355.827833:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789402355.827836:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789402355.827839:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789402355.827864:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.827878:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.827888:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402355.827902:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365568:0@lo:101: 00000100:00100000:2.0:1789402355.827933:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402355.827964:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.828084:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224365568 00000100:00100000:3.0:1789402355.828090:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224365568 00000100:00100000:3.0:1789402355.828111:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789402355.828123:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+13:5841:x1876324224365568:12345-0@lo:101: 00010000:00010000:3.0:1789402355.828133:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402355.828144:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c0030e00/0x9403f4af875f7b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7b78 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.828164:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c0030e00/0x9403f4af875f7b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7b78 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.828173:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c0030e00/0x9403f4af875f7b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7b78 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.828180:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c0030e00, rc 0) 00000100:00100000:3.0:1789402355.828220:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224365568:12345-0@lo:101: Request processed in 98us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.828226:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789402355.828590:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365568:0@lo:101: 00010000:00010000:2.0:1789402355.828603:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.828613:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402355.828654:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365696:0@lo:501: 00000100:00100000:2.0:1789402355.828678:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402355.828705:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.828795:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224365696 00000100:00100000:3.0:1789402355.828799:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224365696 00000100:00100000:3.0:1789402355.828818:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789402355.828837:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224365696:12345-0@lo:501: 00000100:00100000:3.0:1789402355.829052:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224365696:12345-0@lo:501: Request processed in 227us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.829060:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789402355.829237:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365696:0@lo:501: 00000100:00100000:2.0:1789402355.829262:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365824:0@lo:503: 00000100:00100000:2.0:1789402355.829308:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402355.829326:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.829661:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224365824 00000100:00100000:3.0:1789402355.829666:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224365824 00000100:00100000:3.0:1789402355.829687:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789402355.829692:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224365824:12345-0@lo:503: 00000100:00100000:3.0:1789402355.829832:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224365824:12345-0@lo:503: Request processed in 127us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.829847:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789402355.829970:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224365824:0@lo:503: 00000100:00100000:2.0:1789402355.830407:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8470:1876324224365952:0@lo:502: 00000100:00100000:2.0:1789402355.830445:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402355.830469:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c54593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.830551:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224365952 00000100:00100000:3.0:1789402355.830555:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224365952 00000100:00100000:3.0:1789402355.830581:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789402355.830587:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:8470:x1876324224365952:12345-0@lo:502: 00000100:00100000:3.0:1789402355.830714:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+14:8470:x1876324224365952:12345-0@lo:502: Request processed in 126us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.830720:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789402355.830844:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8470:1876324224365952:0@lo:502: 00000020:01000000:2.0:1789402355.830864:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789402355.830871:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402355.830874:0:8470:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789402355.830879:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789402355.830896:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8470:1876324224366080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789402355.830923:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402355.830939:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c54593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402355.831038:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224366080 00000100:00100000:0.0:1789402355.831042:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224366080 00000100:00100000:0.0:1789402355.831060:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789402355.831077:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:8470:x1876324224366080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402355.831188:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:8470:x1876324224366080:12345-0@lo:502:llog_process_th.0 Request processed in 111us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402355.831194:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789402355.831320:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8470:1876324224366080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789402355.831337:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402355.831341:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402355.831360:0:8470:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789402355.831364:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789402355.833653:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789402355.833685:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789402355.833696:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402355.833721:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402355.833732:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789402355.833735:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6e61ce000 from 39 10000000:01000000:0.0:1789402355.833738:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789402355.833774:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402355.833782:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402355.833793:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402355.833817:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789402355.833949:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402355.834027:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1789402355.835232:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224366208 00000100:00100000:2.0:1789402355.835242:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224366208 00000100:00100000:2.0:1789402355.835303:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789402355.835313:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+14:5841:x1876324224366208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402355.835328:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402355.835357:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c70215e000/0x9403f4af875f7b8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7b86 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.835383:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215e000/0x9403f4af875f7b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7b86 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.835393:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c70215e000/0x9403f4af875f7b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7b86 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.835417:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215e000, rc 0) 00000100:00100000:2.0:1789402355.835513:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224366208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402355.835520:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789402355.837480:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402355.837509:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402355.837520:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402355.837598:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402355.837650:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402355.837707:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9dd780 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.837808:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224366336 00000100:00100000:3.0:1789402355.837815:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224366336 00000100:00100000:3.0:1789402355.837869:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789402355.837878:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224366336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.838120:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224366336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.838127:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789402355.838256:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402355.838285:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402355.838335:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402355.838381:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9dd780 going to sleep for 11 seconds 00000100:00100000:1.0:1789402355.838445:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224366464 00000100:00100000:1.0:1789402355.838450:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224366464 00000100:00100000:1.0:1789402355.838471:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789402355.838485:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224366464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402355.838633:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224366464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402355.838640:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789402355.838717:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402355.839158:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8471:1876324224366592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402355.839192:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402355.839222:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9dd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402355.839271:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224366592 00000100:00100000:1.0:1789402355.839275:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224366592 00000100:00100000:1.0:1789402355.839304:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789402355.839310:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:8471:x1876324224366592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402355.839494:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:8471:x1876324224366592:12345-0@lo:502:llog_process_th.0 Request processed in 183us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402355.839501:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789402355.839588:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8471:1876324224366592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402355.839628:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8471:1876324224366720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402355.839657:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402355.839682:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.839778:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224366720 00000100:00100000:3.0:1789402355.839783:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224366720 00000100:00100000:3.0:1789402355.839801:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789402355.839807:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:8471:x1876324224366720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402355.839941:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+15:8471:x1876324224366720:12345-0@lo:502:llog_process_th.0 Request processed in 133us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.839947:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789402355.840074:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8471:1876324224366720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789402355.840095:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789402355.840273:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789402355.840288:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789402355.840305:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.840327:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402355.840337:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789402355.840339:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789402355.840378:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789402355.840406:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.840413:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.840422:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402355.840436:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.840465:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.840493:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402355.840553:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224366848 00000100:00100000:2.0:1789402355.840558:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224366848 00000100:00100000:2.0:1789402355.840592:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789402355.840599:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+15:5841:x1876324224366848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402355.840608:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402355.840620:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c70215ea00/0x9403f4af875f7b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7b94 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.840642:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215ea00/0x9403f4af875f7b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7b94 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.840652:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c70215ea00/0x9403f4af875f7b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7b94 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.840659:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215ea00, rc 0) 00000100:00100000:2.0:1789402355.840698:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224366848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.840741:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402355.840753:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.840761:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402355.840803:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.841457:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.841567:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a429c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402355.844672:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224366976 00000100:00100000:1.0:1789402355.844688:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224366976 00000100:00100000:1.0:1789402355.844744:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789402355.844754:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224366976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402355.845189:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789402355.845952:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224366976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1197us (4493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402355.845962:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789402355.846072:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224366976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.846123:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224367104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.846177:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.846210:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402355.846940:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224367104 00000100:00100000:0.0:1789402355.846949:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224367104 00000100:00100000:0.0:1789402355.846992:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789402355.847000:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224367104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402355.847240:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224367104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402355.847248:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789402355.856029:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224367104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.856643:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8472:1876324224367232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402355.856716:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.856756:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402355.856805:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224367232 00000100:00100000:1.0:1789402355.856811:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224367232 00000100:00100000:1.0:1789402355.856865:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789402355.856874:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:8472:x1876324224367232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402355.857098:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:8472:x1876324224367232:12345-0@lo:502:llog_process_th.0 Request processed in 224us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402355.857106:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789402355.857308:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8472:1876324224367232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789402355.857337:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402355.857380:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402355.857383:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789402355.857388:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789402355.857407:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8472:1876324224367360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402355.857438:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.857453:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c53a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402355.857523:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224367360 00000100:00100000:1.0:1789402355.857533:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224367360 00000100:00100000:1.0:1789402355.857562:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789402355.857570:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:8472:x1876324224367360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402355.857684:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:8472:x1876324224367360:12345-0@lo:502:llog_process_th.0 Request processed in 115us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402355.857690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789402355.857777:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8472:1876324224367360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789402355.857794:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402355.857798:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402355.857799:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789402355.857803:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789402355.857995:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789402355.858015:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789402355.858025:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402355.858035:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402355.858045:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789402355.858047:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6e31a1800 from 39 10000000:01000000:1.0:1789402355.858050:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789402355.858076:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402355.858083:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402355.858092:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402355.858104:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224367488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789402355.858128:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402355.858179:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2480 going to sleep for 11 seconds 00000100:00100000:2.0:1789402355.860170:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224367488 00000100:00100000:2.0:1789402355.860183:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224367488 00000100:00100000:2.0:1789402355.860227:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789402355.860236:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224367488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402355.860252:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402355.860278:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c70215e400/0x9403f4af875f7ba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7ba2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.860316:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c70215e400/0x9403f4af875f7ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7ba2 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.860327:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c70215e400/0x9403f4af875f7ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7ba2 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.860336:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215e400, rc 0) 00000100:00100000:2.0:1789402355.860421:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224367488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402355.860427:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789402355.862012:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224367488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402355.862038:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.862067:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402355.862143:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224367616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.862188:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.862222:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402355.862490:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224367616 00000100:00100000:1.0:1789402355.862496:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224367616 00000100:00100000:1.0:1789402355.862539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789402355.862549:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224367616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402355.862797:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224367616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402355.862805:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789402355.862964:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224367616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.862995:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224367744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.863033:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.863063:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.863076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224367744 00000100:00100000:3.0:1789402355.863080:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224367744 00000100:00100000:3.0:1789402355.863100:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789402355.863106:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224367744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.863242:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224367744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.863249:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789402355.863285:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224367744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.863484:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8473:1876324224367872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402355.863516:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.863532:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224367872 00000100:00100000:3.0:1789402355.863536:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224367872 00000100:00100000:3.0:1789402355.863553:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789402355.863559:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:8473:x1876324224367872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402355.863711:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:8473:x1876324224367872:12345-0@lo:502:llog_process_th.0 Request processed in 151us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.863718:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789402355.863749:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e06000 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.863760:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8473:1876324224367872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402355.863797:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8473:1876324224368000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402355.863910:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.863929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224368000 00000100:00100000:3.0:1789402355.863932:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224368000 00000100:00100000:3.0:1789402355.863948:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789402355.863954:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:8473:x1876324224368000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402355.864070:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:8473:x1876324224368000:12345-0@lo:502:llog_process_th.0 Request processed in 115us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.864077:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789402355.864106:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e06000 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.864117:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8473:1876324224368000:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789402355.864136:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789402355.864181:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789402355.864195:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789402355.864203:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.864213:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402355.864223:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789402355.864230:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789402355.864233:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789402355.864254:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.864261:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.864269:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402355.864281:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.864324:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.864337:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e06000 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.864370:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224368128 00000100:00100000:3.0:1789402355.864374:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224368128 00000100:00100000:3.0:1789402355.864390:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789402355.864395:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224368128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402355.864403:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402355.864414:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c0031800/0x9403f4af875f7bb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7bb0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.864433:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c0031800/0x9403f4af875f7bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7bb0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.864443:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c0031800/0x9403f4af875f7bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7bb0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.864450:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c0031800, rc 0) 00000100:00100000:3.0:1789402355.864477:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224368128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.864489:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789402355.864517:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402355.864529:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.864537:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402355.864573:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.864596:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.864615:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e06000 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.864625:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224368256 00000100:00100000:3.0:1789402355.864629:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224368256 00000100:00100000:3.0:1789402355.864645:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789402355.864650:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224368256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.866199:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224368256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1540us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.866209:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789402355.868978:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402355.869042:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402355.869113:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402355.869192:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789402355.872476:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224368384 00000100:00100000:2.0:1789402355.872491:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224368384 00000100:00100000:2.0:1789402355.872587:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789402355.872599:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224368384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789402355.874101:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224368384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1499us (4982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402355.874113:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789402355.874235:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402355.875578:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8474:1876324224368512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402355.875669:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402355.879496:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789402355.879606:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224368512 00000100:00100000:3.0:1789402355.879616:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224368512 00000100:00100000:3.0:1789402355.879687:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789402355.879696:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8474:x1876324224368512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402355.880539:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8474:x1876324224368512:12345-0@lo:502:llog_process_th.0 Request processed in 842us (4868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402355.880547:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789402355.884863:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8474:1876324224368512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789402355.884918:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789402355.884931:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402355.884934:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789402355.884941:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789402355.884983:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8474:1876324224368640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789402355.885057:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402355.885092:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459840 going to sleep for 11 seconds 00000100:00100000:1.0:1789402355.885214:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224368640 00000100:00100000:1.0:1789402355.885222:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224368640 00000100:00100000:1.0:1789402355.885277:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789402355.885287:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8474:x1876324224368640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402355.885560:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8474:x1876324224368640:12345-0@lo:502:llog_process_th.0 Request processed in 275us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402355.885568:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789402355.885742:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8474:1876324224368640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789402355.885765:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402355.885769:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402355.885771:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789402355.885775:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789402355.885984:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789402355.886010:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789402355.886020:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.886032:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402355.886041:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789402355.886043:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c6c99019c0 from 1 10000000:01000000:3.0:1789402355.886046:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789402355.886070:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.886078:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402355.886087:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402355.886100:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789402355.886130:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402355.886162:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9956c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402355.886253:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224368768 00000100:00100000:2.0:1789402355.886259:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224368768 00000100:00100000:2.0:1789402355.886304:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789402355.886312:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224368768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402355.886323:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402355.886366:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3dfe00/0x9403f4af875f7bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7bbe expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.886387:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3dfe00/0x9403f4af875f7bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7bbe expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.886397:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3dfe00/0x9403f4af875f7bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7bbe expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402355.886405:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dfe00, rc 0) 00000100:00100000:2.0:1789402355.886444:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224368768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402355.886450:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789402355.886549:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789402355.886562:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bc5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402355.886578:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7bc5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402355.886620:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402355.886644:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402355.886670:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789402355.886734:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224368896 00000100:00100000:0.0:1789402355.886739:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224368896 00000100:00100000:0.0:1789402355.886777:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789402355.886784:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224368896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402355.887078:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224368896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (431us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789402355.887085:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789402355.887169:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224368896:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789402355.887188:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789402355.887194:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bc5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402355.887202:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bc5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402356.194526:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402356.638787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402356.638868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199175040 00000100:00100000:3.0:1789402356.638877:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199175040 00000100:00100000:3.0:1789402356.638934:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 165 00000100:00100000:3.0:1789402356.638945:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:5594:x1876324199175040:12345-192.168.203.8@tcp:101: 00010000:00010000:3.0:1789402356.638961:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402356.638981:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47014 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402356.639028:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47014 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402356.639040:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47014 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402356.639049:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1507e00, rc 0) 00000100:00100000:3.0:1789402356.639158:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5594:x1876324199175040:12345-192.168.203.8@tcp:101: Request processed in 215us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402356.639165:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 165 00000100:00100000:1.0:1789402356.647731:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402356.647832:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199175168 00000100:00100000:2.0:1789402356.647842:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199175168 00000100:00100000:2.0:1789402356.647895:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 166 00000100:00100000:2.0:1789402356.647906:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5594:x1876324199175168:12345-192.168.203.8@tcp:501: 00000100:00100000:2.0:1789402356.648253:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5594:x1876324199175168:12345-192.168.203.8@tcp:501: Request processed in 349us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402356.648261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 166 00000100:00100000:1.0:1789402356.657677:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402356.658044:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199175296 00000100:00100000:0.0:1789402356.658054:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199175296 00000100:00100000:0.0:1789402356.658159:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 167 00000100:00100000:0.0:1789402356.658171:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5594:x1876324199175296:12345-192.168.203.8@tcp:503: 00000100:00100000:0.0:1789402356.658442:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5594:x1876324199175296:12345-192.168.203.8@tcp:503: Request processed in 273us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402356.658451:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 167 00000100:00100000:3.0:1789402356.661810:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402356.662774:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199175424 00000100:00100000:2.0:1789402356.662787:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199175424 00000100:00100000:2.0:1789402356.662849:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 168 00000100:00100000:2.0:1789402356.662861:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:6073:x1876324199175424:12345-192.168.203.8@tcp:502: 00000100:00100000:2.0:1789402356.663168:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:6073:x1876324199175424:12345-192.168.203.8@tcp:502: Request processed in 309us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402356.663176:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 168 00000100:00100000:3.0:1789402356.666116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402356.666245:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199175552 00000100:00100000:2.0:1789402356.666255:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199175552 00000100:00100000:2.0:1789402356.666309:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 169 00000100:00100000:2.0:1789402356.666320:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:6073:x1876324199175552:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789402356.666604:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:6073:x1876324199175552:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 285us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402356.666612:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 169 00000100:00100000:3.0:1789402356.669509:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402356.669610:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199175680 00000100:00100000:2.0:1789402356.669628:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199175680 00000100:00100000:2.0:1789402356.669669:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 170 00000100:00100000:2.0:1789402356.669678:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5594:x1876324199175680:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402356.669693:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402356.669711:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3df200/0x9403f4af875f7bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4701b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402356.669738:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3df200/0x9403f4af875f7bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4701b expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402356.669762:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3df200/0x9403f4af875f7bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4701b expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402356.669771:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df200, rc 0) 00000100:00100000:2.0:1789402356.669834:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5594:x1876324199175680:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 Request processed in 157us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402356.669842:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 170 00000100:00100000:3.0:1789402356.673860:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402356.674515:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199175808 00000100:00100000:2.0:1789402356.674524:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199175808 00000100:00100000:2.0:1789402356.674587:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 171 00000100:00100000:2.0:1789402356.674598:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5594:x1876324199175808:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402356.675406:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5594:x1876324199175808:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 Request processed in 804us (1550us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789402356.675416:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 171 00010000:00010000:2.0:1789402357.218742:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789402358.136558:0:8512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8c4afc20 20000000:00000080:3.0:1789402358.136574:0:8512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c6ff651800 uarg=0000000000000000 20000000:01000000:3.0:1789402358.136609:0:8512:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789402358.136615:0:8512:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789402358.136619:0:8512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789402358.141591:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789402358.141824:0:8512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789402358.151515:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789402358.151571:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789402358.151621:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789402358.151638:0:8512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789402358.151664:0:8512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.151683:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c2a83c00/0x9403f4af875f794f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7948 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.151691:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f79aa expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.151706:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7a75 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.151715:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fe3 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.151724:0:8512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.151762:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fe3 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.151779:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fe3 expref: 9 pid: 5836 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402358.151792:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876324224369024:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402358.151902:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7a75 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.151928:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7a75 expref: 18 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402358.151937:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876324224369152:0@lo:104: 00000100:00100000:1.0:1789402358.151977:0:8512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789402358.152007:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f79aa expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.152015:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f79aa expref: 18 pid: 5836 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402358.152034:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876324224369280:0@lo:104: 00000100:00100000:1.0:1789402358.152058:0:8512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789402358.152080:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c2a83c00/0x9403f4af875f794f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7948 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.152088:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c2a83c00/0x9403f4af875f794f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7948 expref: 18 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402358.152095:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876324224369408:0@lo:104: 00000100:00100000:1.0:1789402358.152114:0:8512:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789402358.152207:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789402358.152225:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402358.152237:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224369152 00000100:00100000:2.0:1789402358.152244:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224369152 00000100:00100000:2.0:1789402358.152288:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224369280 00000100:00100000:2.0:1789402358.152291:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224369280 00000100:00100000:2.0:1789402358.152304:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224369408 00000100:00100000:2.0:1789402358.152306:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224369408 00000100:00100000:2.0:1789402358.152318:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789402358.152326:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+5:8512:x1876324224369152:12345-0@lo:104: 00010000:00010000:2.0:1789402358.152338:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152426:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789402358.152432:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+5:8512:x1876324224369152:12345-0@lo:104: Request processed in 107us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402358.152439:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789402358.152456:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789402358.152462:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+4:8512:x1876324224369280:12345-0@lo:104: 00010000:00010000:2.0:1789402358.152469:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152498:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789402358.152503:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+4:8512:x1876324224369280:12345-0@lo:104: Request processed in 42us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402358.152509:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789402358.152535:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789402358.152543:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:8512:x1876324224369408:12345-0@lo:104: 00010000:00010000:2.0:1789402358.152551:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152577:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789402358.152582:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+3:8512:x1876324224369408:12345-0@lo:104: Request processed in 42us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402358.152588:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789402358.152604:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789402358.152609:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152617:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1506200 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402358.152627:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152637:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402358.152645:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402358.152652:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789402358.152679:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152686:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402358.152717:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152725:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1506200/0x9403f4af875f7a75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7a7c expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152738:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789402358.152742:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152748:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83f000 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402358.152751:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152757:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402358.152775:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402358.152780:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789402358.152794:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152799:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402358.152805:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152812:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83f000/0x9403f4af875f79aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f79b1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152821:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402358.152824:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152830:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402358.152833:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152839:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402358.152845:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402358.152850:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789402358.152871:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152877:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402358.152898:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402358.152899:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224369536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402358.152913:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e000/0x9403f4af875f7948 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f794f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.152928:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402358.152931:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402358.152933:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402358.152941:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402358.152943:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402358.152977:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402358.152983:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224369664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402358.153003:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402358.153188:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224369792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789402358.153216:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402358.153250:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224369536 00000100:00100000:2.0:1789402358.153255:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224369536 00010000:00010000:2.0:1789402358.153288:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7a75 expref: 19 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402358.153313:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224369664 00000100:00100000:2.0:1789402358.153317:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224369664 00010000:00010000:2.0:1789402358.153329:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79aa expref: 20 pid: 5836 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402358.153364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224369792 00000100:00100000:2.0:1789402358.153367:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224369792 00010000:00010000:2.0:1789402358.153381:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c2a83c00/0x9403f4af875f794f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7948 expref: 21 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402358.153395:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789402358.153409:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+21:3313:x1876324224369536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402358.153420:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402358.153426:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7a75 expref: 21 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.153436:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7a75 expref: 21 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.153453:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402358.153487:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+21:3313:x1876324224369536:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402358.153493:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789402358.153507:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789402358.153513:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+20:3313:x1876324224369664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402358.153520:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402358.153524:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f79aa expref: 20 pid: 5836 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.153532:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f79aa expref: 20 pid: 5836 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.153540:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402358.153560:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+20:3313:x1876324224369664:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402358.153567:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789402358.153579:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789402358.153586:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224369792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402358.153594:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402358.153605:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c2a83c00/0x9403f4af875f794f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7948 expref: 19 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.153614:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c2a83c00/0x9403f4af875f794f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7948 expref: 19 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402358.153623:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402358.153650:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224369792:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402358.153657:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789402358.153693:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224369792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789402358.153715:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224369664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789402358.153722:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224369536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789402358.154689:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215ee00/0x9403f4af875f7a7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7a75 expref: 18 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402358.154705:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876324224369152:0@lo:104: 00010000:00010000:1.0:1789402358.154715:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83e600/0x9403f4af875f79b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f79aa expref: 17 pid: 5836 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402358.154724:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876324224369280:0@lo:104: 00010000:00010000:1.0:1789402358.154733:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83c00/0x9403f4af875f794f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7948 expref: 16 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402358.154742:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876324224369408:0@lo:104: 00000100:00100000:1.0:1789402358.158249:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876324224369024:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402358.158301:0:8512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402358.164315:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402358.165318:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199175936 00000100:00100000:3.0:1789402358.165336:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199175936 00010000:00010000:3.0:1789402358.165426:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fe3 expref: 10 pid: 5836 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402358.165471:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 24 00000100:00100000:3.0:1789402358.165481:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199175936:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402358.165507:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402358.165518:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fe3 expref: 10 pid: 5836 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165537:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fe3 expref: 10 pid: 5836 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165564:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83ec00/0x9403f4af875f7b39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fe3 expref: 10 pid: 5836 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165594:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165608:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165632:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165647:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165945:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165956:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165962:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83fe00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402358.165966:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.165985:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.166006:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402358.166019:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402358.166135:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:2352:x1876324199175936:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 653us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402358.166144:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 24 00010000:00010000:1.0:1789402358.166211:0:8512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.166220:0:8512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402358.166227:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7bda lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402358.243995:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402358.499205:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224370048:0@lo:400:kworker.0 00000100:00100000:1.0:1789402358.499286:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402358.499369:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402358.499375:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224370176:0@lo:400:kworker.0 00000100:00100000:1.0:1789402358.499401:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402358.499478:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224370304:0@lo:400:kworker.0 00000100:00100000:0.0:1789402358.499507:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402358.499537:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789402358.499543:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224369920:0@lo:400:kworker.0 00000100:00100000:0.0:1789402358.499564:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402358.499582:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224370432:0@lo:400:kworker.0 00000100:00100000:0.0:1789402358.499622:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402358.499651:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224370048 00000100:00100000:0.0:1789402358.499671:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224370048 00000100:00100000:0.0:1789402358.499718:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224370304 00000100:00100000:0.0:1789402358.499722:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224370304 00000100:00100000:0.0:1789402358.499737:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224369920 00000100:00100000:0.0:1789402358.499739:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224369920 00000100:00100000:0.0:1789402358.499753:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789402358.499761:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224370048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402358.499810:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224370048:12345-0@lo:400:kworker.0 Request processed in 49us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402358.499817:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789402358.499833:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789402358.499838:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224370304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402358.499868:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224370304:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402358.499873:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789402358.499884:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789402358.499890:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224369920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402358.499914:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224369920:12345-0@lo:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402358.499920:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789402358.499956:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224369920:0@lo:400:kworker.0 00000100:00100000:0.0:1789402358.499967:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224370304:0@lo:400:kworker.0 00000100:00100000:0.0:1789402358.499991:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224370048:0@lo:400:kworker.0 00000100:00100000:2.0:1789402358.500181:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224370176 00000100:00100000:2.0:1789402358.500186:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224370176 00000100:00100000:2.0:1789402358.500223:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224370432 00000100:00100000:2.0:1789402358.500226:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224370432 00000100:00100000:2.0:1789402358.500252:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789402358.500259:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224370176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402358.500311:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224370176:12345-0@lo:400:kworker.0 Request processed in 52us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402358.500316:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789402358.500328:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789402358.500334:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224370432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402358.500401:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224370432:12345-0@lo:400:kworker.0 Request processed in 66us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402358.500408:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789402358.500426:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402358.500430:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789402358.500433:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789402358.500451:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da8d7480 x1876324224370432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402358.500462:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224370432:0@lo:400:kworker.0 00010000:00080000:2.0:1789402358.500483:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da8d5180 x1876324224370176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402358.500493:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224370176:0@lo:400:kworker.0 00000100:00100000:2.0:1789402359.010826:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224370560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789402359.010899:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402359.011897:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224370560 00000100:00100000:1.0:1789402359.011908:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224370560 00000100:00100000:1.0:1789402359.011999:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789402359.012022:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224370560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402359.012056:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402359.012118:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224370560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402359.012125:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789402359.012186:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31bd180 x1876324224370560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402359.012205:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224370560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789402359.266649:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789402359.330434:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789402359.330441:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6ff7f4000 from 4 10000000:01000000:1.0:1789402359.330446:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789402359.330491:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402359.330503:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402359.330529:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402359.330555:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224370688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789402359.330632:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402359.330694:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789402359.330773:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224370688 00000100:00100000:2.0:1789402359.330781:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224370688 00000100:00100000:2.0:1789402359.330847:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789402359.330856:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224370688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402359.330869:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402359.330882:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7be1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.330931:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7be1 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.330942:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7be1 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.330950:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df600, rc 0) 00000100:00100000:2.0:1789402359.331000:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224370688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402359.331007:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789402359.331385:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224370688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789402359.331401:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402359.331409:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402359.331459:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224370816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402359.331487:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402359.331510:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789402359.331592:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224370816 00000100:00100000:2.0:1789402359.331596:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224370816 00000100:00100000:2.0:1789402359.331626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789402359.331633:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224370816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402359.331895:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224370816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402359.331901:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789402359.332120:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224370816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402359.332149:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224370944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402359.332183:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402359.332210:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789402359.332252:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224370944 00000100:00100000:2.0:1789402359.332256:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224370944 00000100:00100000:2.0:1789402359.332325:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789402359.332332:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224370944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789402359.332496:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224370944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402359.332503:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789402359.332655:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224370944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402359.332867:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8549:1876324224371072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402359.332901:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402359.339783:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224371072 00000100:00100000:1.0:1789402359.339807:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224371072 00000100:00100000:1.0:1789402359.339857:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789402359.339877:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:8549:x1876324224371072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402359.340111:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:8549:x1876324224371072:12345-0@lo:502:llog_process_th.0 Request processed in 244us (7208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402359.340125:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789402359.344532:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1789402359.344575:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8549:1876324224371072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789402359.344686:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402359.344701:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402359.344703:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789402359.344714:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6ff7f4000 00000020:00000080:0.0:1789402359.344718:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789402359.344870:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8549:1876324224371200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402359.344936:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402359.344967:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789402359.345419:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224371200 00000100:00100000:2.0:1789402359.345427:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224371200 00000100:00100000:2.0:1789402359.345487:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789402359.345495:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:8549:x1876324224371200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789402359.345708:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:8549:x1876324224371200:12345-0@lo:502:llog_process_th.0 Request processed in 213us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402359.345716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789402359.346469:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8549:1876324224371200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789402359.346499:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402359.346506:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402359.346509:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789402359.346515:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789402359.346744:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789402359.346762:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789402359.346772:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.346783:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402359.346793:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789402359.346803:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6e61ce000 from 4 10000000:01000000:2.0:1789402359.346806:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789402359.346836:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.346843:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.346851:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402359.346868:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224371328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789402359.346905:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402359.346926:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c3391600 going to sleep for 11 seconds 00000100:00100000:0.0:1789402359.350465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224371328 00000100:00100000:0.0:1789402359.350479:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224371328 00000100:00100000:0.0:1789402359.350539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789402359.350550:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224371328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402359.350566:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402359.350585:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7bef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402359.350638:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7bef expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402359.350651:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7bef expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402359.350661:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83400, rc 0) 00000100:00100000:0.0:1789402359.350735:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224371328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (3829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402359.350742:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789402359.350809:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224371328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402359.350827:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402359.350837:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402359.350896:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224371456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402359.350926:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402359.350953:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789402359.350966:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224371456 00000100:00100000:0.0:1789402359.350969:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224371456 00000100:00100000:0.0:1789402359.350991:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789402359.350997:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224371456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402359.351217:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224371456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402359.351233:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789402359.351262:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224371456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402359.351303:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224371584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402359.351371:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402359.351385:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789402359.351396:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224371584 00000100:00100000:0.0:1789402359.351400:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224371584 00000100:00100000:0.0:1789402359.351416:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789402359.351422:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224371584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402359.351549:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224371584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402359.351555:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789402359.351590:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224371584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402359.351748:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8551:1876324224371712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402359.351782:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402359.351799:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224371712 00000100:00100000:0.0:1789402359.351802:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224371712 00000100:00100000:0.0:1789402359.351823:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789402359.351829:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8551:x1876324224371712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402359.351942:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8551:x1876324224371712:12345-0@lo:502:llog_process_th.0 Request processed in 112us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402359.351949:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789402359.351976:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789402359.351988:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8551:1876324224371712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789402359.352013:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402359.352022:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402359.352024:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789402359.352033:0:8551:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6e61ce000 00000020:00000080:0.0:1789402359.352035:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789402359.355918:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8551:1876324224371840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402359.355988:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402359.356029:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e6270b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789402359.356905:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224371840 00000100:00100000:2.0:1789402359.356920:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224371840 00000100:00100000:2.0:1789402359.356978:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789402359.356987:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8551:x1876324224371840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789402359.357214:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:8551:x1876324224371840:12345-0@lo:502:llog_process_th.0 Request processed in 227us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402359.357222:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789402359.357730:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8551:1876324224371840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789402359.357763:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402359.357770:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402359.357772:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789402359.357777:0:8551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789402359.360449:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789402359.360480:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789402359.360491:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.360504:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402359.360514:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789402359.360516:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6e31a1800 from 4 10000000:01000000:2.0:1789402359.360518:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789402359.360556:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.360564:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.360575:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402359.362427:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224371968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789402359.362493:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402359.362533:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c33916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402359.362554:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224371968 00000100:00100000:2.0:1789402359.362566:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224371968 00000100:00100000:2.0:1789402359.362892:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789402359.362903:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224371968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402359.362919:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402359.362935:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7bfd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.362961:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7bfd expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.362972:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7bfd expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.362980:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de800, rc 0) 00000100:00100000:2.0:1789402359.363020:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224371968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402359.363026:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789402359.363074:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224371968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402359.363087:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402359.363096:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402359.363152:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224372096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402359.363176:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402359.363190:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c33916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402359.363202:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224372096 00000100:00100000:2.0:1789402359.363214:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224372096 00000100:00100000:2.0:1789402359.363234:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789402359.363240:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224372096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402359.366565:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224372096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3316us (3379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402359.366578:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789402359.367282:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224372096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402359.367893:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224372224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402359.367950:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402359.367987:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402359.368925:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224372224 00000100:00100000:2.0:1789402359.368934:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224372224 00000100:00100000:2.0:1789402359.368982:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789402359.368990:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224372224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789402359.369183:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224372224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402359.369191:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789402359.369243:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224372224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402359.381312:0:8554:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8554:1876324224372352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402359.381487:0:8554:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402359.381527:0:8554:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e6270b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789402359.381900:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224372352 00000100:00100000:2.0:1789402359.381908:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224372352 00000100:00100000:2.0:1789402359.381990:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789402359.382000:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:8554:x1876324224372352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789402359.382207:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:8554:x1876324224372352:12345-0@lo:502:llog_process_th.0 Request processed in 208us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402359.382216:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789402359.391470:0:8554:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8554:1876324224372352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789402359.391516:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789402359.391526:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402359.391529:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789402359.391539:0:8554:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6e31a1800 00000020:00000080:1.0:1789402359.391542:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789402359.391950:0:8554:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8554:1876324224372480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402359.392019:0:8554:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402359.398575:0:8554:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402359.400939:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224372480 00000100:00100000:0.0:1789402359.400954:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224372480 00000100:00100000:0.0:1789402359.401075:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789402359.401086:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:8554:x1876324224372480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402359.403094:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:8554:x1876324224372480:12345-0@lo:502:llog_process_th.0 Request processed in 2003us (11068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402359.403106:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789402359.403293:0:8554:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:8554:1876324224372480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789402359.403339:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789402359.403360:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402359.403362:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789402359.403370:0:8554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789402359.410895:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789402359.410925:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789402359.410937:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402359.410951:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402359.523336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402359.523717:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199176064 00000100:00100000:1.0:1789402359.523727:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199176064 00000100:00100000:1.0:1789402359.523773:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 187 00000100:00100000:1.0:1789402359.523783:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:5594:x1876324199176064:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789402359.523805:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402359.523824:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47022 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402359.523861:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47022 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402359.523872:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47022 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402359.523880:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e800, rc 0) 00000100:00100000:1.0:1789402359.523931:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5594:x1876324199176064:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 Request processed in 150us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402359.523939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 187 00000100:00100000:1.0:1789402359.524134:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224372608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402359.524172:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402359.524363:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224372608 00000100:00100000:1.0:1789402359.524369:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224372608 00000100:00100000:1.0:1789402359.524397:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789402359.524404:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224372608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789402359.524447:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402359.524483:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224372608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402359.524489:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789402359.524519:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31bdf80 x1876324224372608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402359.524534:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224372608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402359.533854:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402359.533887:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199176192 00000100:00100000:3.0:1789402359.533896:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199176192 00000100:00100000:3.0:1789402359.533939:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 188 00000100:00100000:3.0:1789402359.533948:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5594:x1876324199176192:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402359.534184:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5594:x1876324199176192:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 Request processed in 236us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402359.534202:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 188 00000100:00100000:3.0:1789402359.555319:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402359.555400:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199176320 00000100:00100000:3.0:1789402359.555409:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199176320 00000100:00100000:3.0:1789402359.555471:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 189 00000100:00100000:3.0:1789402359.555481:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5594:x1876324199176320:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789402359.555700:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:5594:x1876324199176320:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 Request processed in 219us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402359.555709:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 189 00000100:00100000:3.0:1789402359.563175:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402359.563225:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199176448 00000100:00100000:3.0:1789402359.563235:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199176448 00000100:00100000:3.0:1789402359.563291:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 190 00000100:00100000:3.0:1789402359.563301:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:6130:x1876324199176448:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789402359.563596:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:6130:x1876324199176448:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 295us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402359.563604:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 190 00000100:00100000:3.0:1789402359.567480:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402359.568064:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199176576 00000100:00100000:0.0:1789402359.568074:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199176576 00000100:00100000:0.0:1789402359.568128:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 191 00000100:00100000:0.0:1789402359.568139:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:6130:x1876324199176576:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789402359.568416:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:6130:x1876324199176576:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 277us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402359.568437:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 191 00010000:00010000:1.0:1789402360.291289:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402360.866778:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402360.866818:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402360.866848:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402360.866873:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402360.866907:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199176704 00000100:00100000:3.0:1789402360.866920:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199176704 00000100:00100000:3.0:1789402360.866980:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 192 00000100:00100000:3.0:1789402360.866991:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199176704:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402360.867090:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199176704:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402360.867098:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 192 00000100:00100000:3.0:1789402360.867138:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199177088 00000100:00100000:3.0:1789402360.867142:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199177088 00000100:00100000:3.0:1789402360.867181:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199176960 00000100:00100000:3.0:1789402360.867184:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199176960 00000100:00100000:3.0:1789402360.867209:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:3.0:1789402360.867216:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199177088:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402360.867245:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199177088:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 30us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402360.867263:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:3.0:1789402360.867277:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:3.0:1789402360.867284:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199176960:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402360.867305:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199176960:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 23us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402360.867311:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:0.0:1789402360.867768:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199176832 00000100:00080000:3.0:1789402360.867899:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402360.867904:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789402360.867949:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199176832 00000100:00080000:3.0:1789402360.868042:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402360.868896:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:1.0:1789402360.868919:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199176832:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402360.869007:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199176832:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 92us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402360.869016:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 33 00010000:00010000:2.0:1789402361.320481:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402362.338690:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402363.362473:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402363.627058:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224372736:0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.627129:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402363.628131:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224372736 00000100:00100000:3.0:1789402363.628142:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224372736 00000100:00100000:0.0:1789402363.628164:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224373248:0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.628198:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402363.628226:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789402363.628244:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224372864:0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.628266:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402363.628283:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224373376:0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.628305:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402363.628336:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224372992:0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.628377:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402363.628400:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402363.628407:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224373120:0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.628426:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402363.628451:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224373248 00000100:00100000:0.0:1789402363.628454:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224373248 00000100:00100000:0.0:1789402363.628493:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224372864 00000100:00100000:0.0:1789402363.628496:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224372864 00000100:00100000:0.0:1789402363.628506:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224372992 00000100:00100000:3.0:1789402363.628588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789402363.628599:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224372736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402363.628727:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224372736:12345-0@lo:400:kworker.0 Request processed in 129us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402363.628750:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789402363.628758:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224372992 00000100:00100000:0.0:1789402363.628782:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789402363.628789:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224373248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.628824:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224373248:12345-0@lo:400:kworker.0 Request processed in 36us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402363.628839:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789402363.628853:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789402363.628936:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224372864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.628970:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224372864:12345-0@lo:400:kworker.0 Request processed in 100us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402363.628975:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789402363.628988:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789402363.628994:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224372992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.629100:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224372992:12345-0@lo:400:kworker.0 Request processed in 105us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402363.629106:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789402363.629130:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224373376 00000100:00100000:0.0:1789402363.629134:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224373376 00000100:00100000:0.0:1789402363.629161:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224373120 00000100:00100000:0.0:1789402363.629163:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224373120 00000100:00100000:0.0:1789402363.629184:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789402363.629192:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224373376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.629222:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224373376:12345-0@lo:400:kworker.0 Request processed in 32us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402363.629228:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789402363.629250:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789402363.629257:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224373120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.629283:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224373120:12345-0@lo:400:kworker.0 Request processed in 28us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402363.629289:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789402363.629310:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789402363.629315:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789402363.629317:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789402363.629370:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c5c1e1df80 x1876324224373120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402363.629392:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224373120:0@lo:400:kworker.0 00000100:00100000:0.0:1789402363.629408:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224372992:0@lo:400:kworker.0 00000100:00100000:2.0:1789402363.629747:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224372864:0@lo:400:kworker.0 00010000:00080000:2.0:1789402363.629762:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c5c1e1d500 x1876324224373376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402363.629784:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224373376:0@lo:400:kworker.0 00000100:00100000:2.0:1789402363.629796:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224372736:0@lo:400:kworker.0 00000100:00100000:2.0:1789402363.629805:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224373248:0@lo:400:kworker.0 00000100:00100000:0.0:1789402364.130874:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224373504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789402364.131015:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402364.131145:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224373504 00000100:00100000:0.0:1789402364.131154:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224373504 00000100:00100000:0.0:1789402364.131206:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789402364.131226:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224373504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789402364.131271:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789402364.131326:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224373504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402364.131333:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789402364.131488:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31bdf80 x1876324224373504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402364.131506:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224373504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402364.386537:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402364.643436:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224373632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402364.643547:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402364.643634:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224373632 00000100:00100000:3.0:1789402364.643641:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224373632 00000100:00100000:3.0:1789402364.643683:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789402364.643693:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224373632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402364.643725:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402364.643770:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224373632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402364.643777:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789402364.643813:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da8d5f80 x1876324224373632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402364.643831:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224373632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789402365.412680:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789402365.665747:0:8812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1789402365.989622:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402365.991304:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402365.991339:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402365.991380:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402365.991412:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199177600 00000100:00100000:3.0:1789402365.991421:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199177600 00000100:00100000:3.0:1789402365.991469:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199177472 00000100:00100000:3.0:1789402365.991472:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199177472 00000100:00100000:3.0:1789402365.991494:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:3.0:1789402365.991504:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199177600:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402365.991570:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199177600:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402365.991584:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:3.0:1789402365.991599:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:3.0:1789402365.991605:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199177472:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402365.991629:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199177472:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402365.991635:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:3.0:1789402365.991651:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199177216 00000100:00100000:3.0:1789402365.991654:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199177216 00000100:00100000:3.0:1789402365.991674:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 194 00000100:00100000:3.0:1789402365.991680:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2353:x1876324199177216:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402365.991701:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2353:x1876324199177216:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 21us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402365.991706:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 194 00000100:00080000:3.0:1789402365.991728:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402365.991732:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789402365.993484:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199177344 00000100:00100000:0.0:1789402365.993494:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199177344 00000100:00080000:3.0:1789402365.993606:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402365.994448:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 37 00000100:00100000:0.0:1789402365.994464:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199177344:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402365.994545:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199177344:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 86us (4931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402365.994552:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 37 00010000:00010000:0.0:1789402366.436298:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402367.458581:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402368.482839:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402368.738897:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224374016:0@lo:400:kworker.0 00000100:00100000:2.0:1789402368.738992:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402368.739063:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789402368.739070:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224374144:0@lo:400:kworker.0 00000100:00100000:2.0:1789402368.739099:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402368.739157:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224374016 00000100:00100000:2.0:1789402368.739167:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224374016 00000100:00100000:2.0:1789402368.739247:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789402368.739259:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224374016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402368.739325:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224374016:12345-0@lo:400:kworker.0 Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402368.739333:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789402368.739396:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224374144 00000100:00100000:2.0:1789402368.739400:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224374144 00000100:00100000:2.0:1789402368.739432:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789402368.739439:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224374144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402368.739472:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224374144:12345-0@lo:400:kworker.0 Request processed in 33us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402368.739478:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789402368.739496:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789402368.739510:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789402368.739556:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7006d7100 x1876324224374144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402368.739573:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224374144:0@lo:400:kworker.0 00000100:00100000:2.0:1789402368.740687:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224374016:0@lo:400:kworker.0 00000100:00100000:0.0:1789402368.740969:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224373760:0@lo:400:kworker.0 00000100:00100000:0.0:1789402368.741043:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402368.741109:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224374272:0@lo:400:kworker.0 00000100:00100000:0.0:1789402368.741139:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402368.741166:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789402368.741174:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224373888:0@lo:400:kworker.0 00000100:00100000:0.0:1789402368.741208:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402368.741228:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224374400:0@lo:400:kworker.0 00000100:00100000:0.0:1789402368.741253:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402368.741288:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224374272 00000100:00100000:0.0:1789402368.741295:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224374272 00000100:00100000:0.0:1789402368.741367:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224373888 00000100:00100000:0.0:1789402368.741370:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224373888 00000100:00100000:0.0:1789402368.741392:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789402368.741400:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224374272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402368.741452:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224374272:12345-0@lo:400:kworker.0 Request processed in 52us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402368.741459:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789402368.741476:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789402368.741482:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224373888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402368.741506:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224373888:12345-0@lo:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402368.741512:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789402368.741532:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224374400 00000100:00100000:0.0:1789402368.741536:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224374400 00000100:00100000:0.0:1789402368.741563:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789402368.741569:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224374400:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789402368.741704:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402368.741709:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402368.741743:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224373760 00000100:00100000:2.0:1789402368.741748:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224373760 00000100:00100000:2.0:1789402368.741778:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789402368.741785:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224373760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402368.741819:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224373760:12345-0@lo:400:kworker.0 Request processed in 35us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402368.741825:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789402368.741886:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224373888:0@lo:400:kworker.0 00000100:00100000:2.0:1789402368.741895:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224373760:0@lo:400:kworker.0 00000100:00100000:2.0:1789402368.741903:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224374272:0@lo:400:kworker.0 00000100:00100000:0.0:1789402368.741980:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224374400:12345-0@lo:400:kworker.0 Request processed in 410us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402368.741998:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789402368.742243:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7006d4a80 x1876324224374400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402368.742255:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224374400:0@lo:400:kworker.0 00000100:00100000:2.0:1789402369.251824:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224374528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789402369.251925:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402369.252061:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224374528 00000100:00100000:2.0:1789402369.259078:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224374528 00000100:00100000:2.0:1789402369.259477:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789402369.259494:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224374528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789402369.259543:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402369.259658:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224374528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (7736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402369.259666:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789402369.259741:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7006d4a80 x1876324224374528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402369.259769:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224374528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402369.508209:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402369.764334:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402369.764384:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224374656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402369.764474:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402369.764552:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224374656 00000100:00100000:1.0:1789402369.765063:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224374656 00000100:00100000:1.0:1789402369.765136:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789402369.765147:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224374656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789402369.765217:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402369.765285:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224374656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402369.765293:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789402369.765364:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31bdf80 x1876324224374656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402369.765388:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224374656:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789402370.540523:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402371.106711:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402371.106760:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402371.106792:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199177856 00000100:00100000:3.0:1789402371.106803:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199177856 00000100:00080000:2.0:1789402371.106838:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402371.106860:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:0.0:1789402371.106904:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199177728 00000100:00100000:0.0:1789402371.106909:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199177728 00000100:00100000:0.0:1789402371.106937:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 196 00000100:00100000:0.0:1789402371.106945:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2351:x1876324199177728:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402371.107013:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2351:x1876324199177728:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402371.107021:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 196 00000100:00100000:3.0:1789402371.107152:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199177856:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402371.107199:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199177856:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 331us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402371.115810:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:2.0:1789402371.115887:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402371.115929:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402371.116000:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199177984 00000100:00100000:3.0:1789402371.116008:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199177984 00000100:00100000:3.0:1789402371.116056:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199178112 00000100:00100000:3.0:1789402371.116060:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199178112 00000100:00100000:3.0:1789402371.116083:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:3.0:1789402371.116092:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2350:x1876324199177984:12345-192.168.203.8@tcp:9:kworker.0 00000020:00000080:3.0:1789402371.116127:0:6689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7b47 00000100:00080000:3.0:1789402371.116136:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93c6eec1e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789402371.116185:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789402371.116674:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+2:2350:x1876324199177984:12345-192.168.203.8@tcp:9:kworker.0 Request processed in 581us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402371.116683:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:3.0:1789402371.116697:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:3.0:1789402371.116704:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2350:x1876324199178112:12345-192.168.203.8@tcp:9:kworker.0 00000100:00080000:2.0:1789402371.116822:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402371.116826:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789402371.116988:0:6689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7b4e 00000100:00080000:3.0:1789402371.116996:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93c6eec18800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789402371.117061:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789402371.117290:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+2:2350:x1876324199178112:12345-192.168.203.8@tcp:9:kworker.0 Request processed in 585us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402371.117298:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 11 00010000:00010000:2.0:1789402371.122947:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402371.123572:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789402371.464008:0:9056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing yml_node 00010000:00010000:2.0:1789402371.556278:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402372.584481:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402373.602591:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402373.858840:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224375168:0@lo:400:kworker.0 00000100:00100000:3.0:1789402373.858946:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402373.859304:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402373.859313:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224375040:0@lo:400:kworker.0 00000100:00100000:3.0:1789402373.859379:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402373.859436:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224375168 00000100:00100000:3.0:1789402373.859447:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224375168 00000100:00100000:3.0:1789402373.859517:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789402373.859529:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224375168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402373.859592:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224375168:12345-0@lo:400:kworker.0 Request processed in 65us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402373.859600:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789402373.859654:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da8d4000 x1876324224375168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402373.859672:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224375168:0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.859800:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224374912:0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.859846:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402373.859870:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224375424:0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.859895:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402373.859927:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789402373.859933:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224374784:0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.860221:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402373.860268:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224375296:0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.860292:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402373.860327:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224375040 00000100:00100000:1.0:1789402373.860331:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224375040 00000100:00100000:1.0:1789402373.860390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224374912 00000100:00100000:1.0:1789402373.860393:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224374912 00000100:00100000:1.0:1789402373.860404:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224375296 00000100:00100000:1.0:1789402373.860407:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224375296 00000100:00100000:1.0:1789402373.860420:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789402373.860426:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224375040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.860463:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224375040:12345-0@lo:400:kworker.0 Request processed in 37us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402373.860470:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789402373.860484:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789402373.860490:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224374912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.860519:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224374912:12345-0@lo:400:kworker.0 Request processed in 29us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402373.860525:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789402373.860552:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789402373.860558:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224375296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.860587:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224375296:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402373.860593:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789402373.860612:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224375424 00000100:00100000:1.0:1789402373.860616:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224375424 00000100:00100000:1.0:1789402373.860644:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789402373.860650:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224375424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.860681:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224375424:12345-0@lo:400:kworker.0 Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402373.860868:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224375040:0@lo:400:kworker.0 00000100:00100000:0.0:1789402373.861067:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224375296:0@lo:400:kworker.0 00000100:00100000:0.0:1789402373.861081:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224374912:0@lo:400:kworker.0 00010000:00080000:0.0:1789402373.861094:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da8d5c00 x1876324224375424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402373.861104:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224375424:0@lo:400:kworker.0 00000100:00080000:2.0:1789402373.861202:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402373.861209:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789402373.861212:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402373.861225:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224374784 00000100:00100000:2.0:1789402373.861230:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224374784 00000100:00100000:2.0:1789402373.861273:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789402373.861281:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224374784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402373.861330:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224374784:12345-0@lo:400:kworker.0 Request processed in 50us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402373.861336:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789402373.861662:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224374784:0@lo:400:kworker.0 00000100:00100000:1.0:1789402373.861931:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000001:00100000:1.0:1789402373.914786:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:1.0:1789402373.914800:0:7645:0:(genops.c:885:class_export_put()) final put ffff93c6eec1b800/4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:3.0:1789402373.914999:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6eec1b800/4785302d-2648-4148-8042-c10a24a5dd29 for lustre-OST0001 00000020:00000080:3.0:1789402373.915065:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6eec18800 for lustre-OST0001 00000100:00100000:3.0:1789402374.371200:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402374.371233:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224375552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402374.371333:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402374.371606:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224375552 00000100:00100000:2.0:1789402374.371616:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224375552 00000100:00100000:2.0:1789402374.371688:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789402374.371701:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224375552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789402374.371745:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402374.371805:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224375552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402374.371812:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789402374.373674:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7006d4000 x1876324224375552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402374.373710:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224375552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789402374.629467:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402374.883997:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789402374.884029:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224375680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402374.884123:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402374.884213:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224375680 00000100:00100000:3.0:1789402374.884223:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224375680 00000100:00100000:3.0:1789402374.884283:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789402374.884294:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224375680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402374.884336:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402374.884417:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224375680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402374.884438:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789402374.884491:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb578380 x1876324224375680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402374.884581:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224375680:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789402375.451081:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:1.0:1789402375.451092:0:6714:0:(genops.c:885:class_export_put()) final put ffff93c6eec1f800/4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:1.0:1789402375.451125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6eec1f800/4785302d-2648-4148-8042-c10a24a5dd29 for lustre-OST0000 00000020:00000080:1.0:1789402375.451195:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6eec1e000 for lustre-OST0000 00000001:02000400:1.0:1789402375.566953:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:2.0:1789402375.653503:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402376.223321:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402376.223700:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402376.224420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199178368 00000100:00100000:1.0:1789402376.224435:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199178368 00000100:00100000:1.0:1789402376.224542:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:1.0:1789402376.224556:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199178368:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402376.224684:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199178368:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 130us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402376.224692:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00080000:2.0:1789402376.225665:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402376.226449:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199178240 00000100:00100000:0.0:1789402376.226464:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199178240 00000100:00100000:1.0:1789402376.226686:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 198 00000100:00100000:1.0:1789402376.226699:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2354:x1876324199178240:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402376.226829:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2354:x1876324199178240:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 132us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402376.226837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 198 00010000:00010000:3.0:1789402376.688036:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402377.700037:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789402378.113676:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:2.0:1789402378.731284:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402378.988622:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224375808:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.988718:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402378.988773:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224376320:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.988802:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402378.988830:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789402378.988836:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224375936:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.988856:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402378.988871:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224376448:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.988894:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402378.988923:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224376064:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.988946:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402378.988964:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789402378.988969:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224376192:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989006:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402378.989043:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224375808 00000100:00100000:2.0:1789402378.989054:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224375808 00000100:00100000:2.0:1789402378.989108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789402378.989131:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224375808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989186:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224375808:12345-0@lo:400:kworker.0 Request processed in 69us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402378.989193:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789402378.989239:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224376320 00000100:00100000:2.0:1789402378.989243:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224376320 00000100:00100000:2.0:1789402378.989279:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224375936 00000100:00100000:2.0:1789402378.989282:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224375936 00000100:00100000:2.0:1789402378.989294:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224376064 00000100:00100000:2.0:1789402378.989297:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224376064 00000100:00100000:2.0:1789402378.989313:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789402378.989320:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224376320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989383:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224376320:12345-0@lo:400:kworker.0 Request processed in 63us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402378.989389:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789402378.989402:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789402378.989408:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224375936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989436:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224375936:12345-0@lo:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402378.989442:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789402378.989453:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789402378.989458:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224376064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989492:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224376064:12345-0@lo:400:kworker.0 Request processed in 33us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402378.989509:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789402378.989533:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224376448 00000100:00100000:2.0:1789402378.989536:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224376448 00000100:00100000:2.0:1789402378.989565:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224376192 00000100:00100000:2.0:1789402378.989568:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224376192 00000100:00100000:2.0:1789402378.989590:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789402378.989595:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224376448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989627:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224376448:12345-0@lo:400:kworker.0 Request processed in 32us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402378.989632:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789402378.989644:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789402378.989650:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224376192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989676:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224376192:12345-0@lo:400:kworker.0 Request processed in 27us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402378.989682:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789402378.989711:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789402378.989717:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402378.989720:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789402378.989759:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7006d5880 x1876324224376192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402378.989775:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224376192:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989788:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224376064:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989818:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224375936:0@lo:400:kworker.0 00010000:00080000:2.0:1789402378.989828:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7006d4380 x1876324224376448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402378.989849:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224376448:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989861:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224375808:0@lo:400:kworker.0 00000100:00100000:2.0:1789402378.989871:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224376320:0@lo:400:kworker.0 00000100:00100000:0.0:1789402379.490613:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224376576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789402379.490724:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402379.490897:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224376576 00000100:00100000:3.0:1789402379.490907:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224376576 00000100:00100000:3.0:1789402379.490972:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789402379.490983:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224376576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789402379.491027:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402379.491087:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224376576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402379.491096:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789402379.491271:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6c998a300 x1876324224376576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402379.491294:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224376576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402379.746647:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402380.002985:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224376704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402380.003118:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402380.003212:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224376704 00000100:00100000:3.0:1789402380.003224:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224376704 00000100:00100000:3.0:1789402380.003298:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789402380.003312:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224376704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402380.003805:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402380.003882:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224376704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 572us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402380.003890:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789402380.003947:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb578380 x1876324224376704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402380.003989:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224376704:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789402380.004032:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789402380.773281:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789402380.839909:0:9446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:2.0:1789402381.346405:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402381.346470:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402381.346591:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199178496 00000100:00100000:1.0:1789402381.346604:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199178496 00000100:00100000:1.0:1789402381.346683:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 200 00000100:00100000:1.0:1789402381.346695:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2351:x1876324199178496:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402381.346780:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2351:x1876324199178496:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 88us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402381.346788:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 200 00000100:00100000:3.0:1789402381.347279:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199178624 00000100:00100000:3.0:1789402381.347285:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199178624 00000100:00100000:3.0:1789402381.347382:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:3.0:1789402381.347392:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199178624:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402381.347450:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199178624:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 61us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402381.347457:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00080000:2.0:1789402381.347568:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789402381.801220:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789402382.782714:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 14 12:13:00 EDT 2026 00010000:00010000:2.0:1789402382.822544:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402383.844137:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402384.098573:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224376832:0@lo:400:kworker.0 00000100:00100000:1.0:1789402384.098599:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224376960:0@lo:400:kworker.0 00000100:00100000:0.0:1789402384.098668:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224377088:0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.099849:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402384.099931:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224377344:0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.099972:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402384.099995:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789402384.100002:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224377472:0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.100030:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402384.100122:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224377344 00000100:00100000:3.0:1789402384.100123:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224376832 00000100:00100000:3.0:1789402384.100133:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224376832 00000100:00100000:2.0:1789402384.100133:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224377344 00000100:00100000:2.0:1789402384.100200:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789402384.100212:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224377344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.100282:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224377344:12345-0@lo:400:kworker.0 Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402384.100305:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789402384.100314:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789402384.100325:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224376832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.100336:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224377472 00000100:00100000:2.0:1789402384.100366:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224377472 00000100:00100000:3.0:1789402384.100401:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224376832:12345-0@lo:400:kworker.0 Request processed in 78us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402384.100403:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789402384.100412:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224377472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.100448:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224377472:12345-0@lo:400:kworker.0 Request processed in 37us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402384.100455:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789402384.100686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:2.0:1789402384.101657:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402384.101669:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789402384.101732:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c5c1e1f100 x1876324224377472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402384.101752:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224377472:0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.101768:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224377344:0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.101778:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224376832:0@lo:400:kworker.0 00000100:00100000:1.0:1789402384.104951:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402384.105447:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224377216:0@lo:400:kworker.0 00000100:00100000:1.0:1789402384.105517:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402384.105531:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224376960 00000100:00100000:3.0:1789402384.105543:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224376960 00000100:00100000:3.0:1789402384.105690:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789402384.105703:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224376960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402384.105779:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224376960:12345-0@lo:400:kworker.0 Request processed in 78us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402384.105788:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789402384.107066:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224376960:0@lo:400:kworker.0 00000100:00100000:0.0:1789402384.108899:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402384.115831:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224377216 00000100:00100000:2.0:1789402384.115848:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224377216 00000100:00100000:2.0:1789402384.116056:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789402384.116070:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224377216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.116216:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224377216:12345-0@lo:400:kworker.0 Request processed in 149us (10698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402384.116225:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789402384.116255:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224377088 00000100:00100000:2.0:1789402384.116260:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224377088 00000100:00100000:2.0:1789402384.116293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789402384.116315:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224377088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402384.116389:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224377088:12345-0@lo:400:kworker.0 Request processed in 74us (7501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402384.116396:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789402384.116424:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789402384.116430:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789402384.118573:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224377088:0@lo:400:kworker.0 00010000:00080000:3.0:1789402384.127531:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c5c1e1c000 x1876324224377216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402384.127562:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224377216:0@lo:400:kworker.0 00000100:00100000:0.0:1789402384.620368:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224377600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789402384.620433:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402384.621565:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224377600 00000100:00100000:1.0:1789402384.621577:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224377600 00000100:00100000:1.0:1789402384.621840:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789402384.621850:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224377600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402384.621897:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402384.624332:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224377600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2474us (3889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402384.624367:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789402384.633787:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31bc380 x1876324224377600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402384.633816:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224377600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789402384.866519:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402385.125860:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224377728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402385.125928:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402385.125995:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224377728 00000100:00100000:3.0:1789402385.126003:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224377728 00000100:00100000:3.0:1789402385.126045:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789402385.126059:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224377728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402385.126106:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402385.126156:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224377728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402385.126164:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789402385.126206:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c5c1e1c380 x1876324224377728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402385.126224:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224377728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789402385.890640:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402386.468983:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402386.469037:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402386.469109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199178752 00000100:00100000:1.0:1789402386.469119:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199178752 00000100:00100000:1.0:1789402386.469178:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 202 00000100:00100000:1.0:1789402386.469187:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2354:x1876324199178752:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402386.469254:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2354:x1876324199178752:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402386.469261:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 202 00000100:00100000:3.0:1789402386.469770:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199178880 00000100:00100000:3.0:1789402386.469776:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199178880 00000100:00100000:3.0:1789402386.469835:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00100000:3.0:1789402386.469843:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199178880:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402386.469888:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199178880:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 46us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402386.469895:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00080000:1.0:1789402386.470189:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789402386.914508:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402387.940384:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402388.963831:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402389.226817:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224377984:0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.226897:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402389.226954:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224378496:0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.226978:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402389.227006:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789402389.227012:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224377856:0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227061:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402389.227083:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224378368:0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227103:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402389.227126:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224378240:0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227147:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402389.227175:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789402389.227181:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224378112:0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227202:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402389.227229:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224377984 00000100:00100000:1.0:1789402389.227236:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224377984 00000100:00100000:1.0:1789402389.227280:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224378368 00000100:00100000:1.0:1789402389.227283:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224378368 00000100:00100000:1.0:1789402389.227305:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224378112 00000100:00100000:1.0:1789402389.227308:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224378112 00000100:00100000:1.0:1789402389.227323:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789402389.227330:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224377984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227400:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224377984:12345-0@lo:400:kworker.0 Request processed in 69us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402389.227407:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789402389.227421:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789402389.227427:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224378368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227451:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224378368:12345-0@lo:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402389.227456:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789402389.227464:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789402389.227470:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224378112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227496:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224378112:12345-0@lo:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402389.227501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789402389.227519:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224378496 00000100:00100000:1.0:1789402389.227522:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224378496 00000100:00100000:1.0:1789402389.227546:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224378240 00000100:00100000:1.0:1789402389.227549:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224378240 00000100:00100000:1.0:1789402389.227579:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789402389.227584:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224378496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227615:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224378496:12345-0@lo:400:kworker.0 Request processed in 31us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402389.227620:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789402389.227631:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789402389.227638:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224378240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227664:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224378240:12345-0@lo:400:kworker.0 Request processed in 26us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402389.227669:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789402389.227684:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224377856 00000100:00100000:1.0:1789402389.227687:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224377856 00000100:00100000:1.0:1789402389.227708:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789402389.227713:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224377856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227740:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224377856:12345-0@lo:400:kworker.0 Request processed in 26us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402389.227745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1789402389.227780:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789402389.227784:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789402389.227786:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402389.227819:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224378112:0@lo:400:kworker.0 00010000:00080000:1.0:1789402389.227830:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6f8fdd180 x1876324224378240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402389.227840:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224378240:0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227868:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224377856:0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227888:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224378368:0@lo:400:kworker.0 00000100:00100000:1.0:1789402389.227897:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224377984:0@lo:400:kworker.0 00010000:00080000:1.0:1789402389.227905:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6f8fdf480 x1876324224378496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402389.227913:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224378496:0@lo:400:kworker.0 00000100:00100000:0.0:1789402389.736842:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224378624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789402389.736911:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402389.741371:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224378624 00000100:00100000:1.0:1789402389.741386:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224378624 00000100:00100000:1.0:1789402389.741445:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789402389.741457:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224378624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402389.741494:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402389.741572:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224378624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (4662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402389.741580:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789402389.741621:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6f8fdf480 x1876324224378624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402389.741642:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224378624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402389.992022:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402390.244106:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402390.244135:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224378752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402390.244225:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402390.244437:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224378752 00000100:00100000:3.0:1789402390.244624:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224378752 00000100:00100000:3.0:1789402390.244692:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789402390.244722:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224378752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402390.244767:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402390.245095:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224378752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 375us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402390.245104:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789402390.246667:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6f8fdf480 x1876324224378752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402390.246698:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224378752:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789402391.011322:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402391.599147:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402391.599201:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402391.599290:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199179008 00000100:00100000:3.0:1789402391.599304:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199179008 00000100:00100000:3.0:1789402391.599415:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 204 00000100:00100000:3.0:1789402391.599427:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2351:x1876324199179008:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402391.599521:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2351:x1876324199179008:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 95us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402391.599529:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 204 00000100:00100000:1.0:1789402391.600015:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199179136 00000100:00100000:1.0:1789402391.600033:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199179136 00000100:00100000:1.0:1789402391.600096:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 57 00000100:00100000:1.0:1789402391.600105:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199179136:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402391.600156:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199179136:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 52us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402391.600163:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 57 00000100:00080000:3.0:1789402391.600954:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789402392.035144:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402393.076844:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402394.083128:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402394.338770:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224378880:0@lo:400:kworker.0 00000100:00100000:3.0:1789402394.338878:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402394.340446:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224378880 00000100:00100000:0.0:1789402394.340463:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224378880 00000100:00100000:0.0:1789402394.340529:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789402394.340541:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224378880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.344622:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224379008:0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.344714:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402394.344755:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224379520:0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.344795:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402394.344819:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789402394.344826:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224379392:0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.344847:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402394.344874:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224379136:0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.344899:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402394.344917:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402394.344922:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224379264:0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.344944:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402394.344981:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224379008 00000100:00100000:1.0:1789402394.344991:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224379008 00000100:00100000:1.0:1789402394.345056:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224379392 00000100:00100000:1.0:1789402394.345059:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224379392 00000100:00100000:1.0:1789402394.345084:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224379136 00000100:00100000:1.0:1789402394.345087:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224379136 00000100:00100000:1.0:1789402394.345105:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789402394.345115:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224379008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.345200:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224379008:12345-0@lo:400:kworker.0 Request processed in 74us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402394.345210:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789402394.345232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789402394.345239:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224379392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.345266:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224379392:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402394.345272:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789402394.345287:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789402394.345293:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224379136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.345324:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224379136:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402394.345330:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789402394.345376:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224379520 00000100:00100000:1.0:1789402394.345380:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224379520 00000100:00100000:1.0:1789402394.345408:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224379264 00000100:00100000:1.0:1789402394.345411:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224379264 00000100:00100000:1.0:1789402394.345430:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789402394.345437:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224379520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.345470:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224379520:12345-0@lo:400:kworker.0 Request processed in 34us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402394.345491:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789402394.345503:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789402394.345509:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224379264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.345538:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224379264:12345-0@lo:400:kworker.0 Request processed in 29us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402394.345553:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789402394.345584:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789402394.345589:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789402394.345592:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402394.345626:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224379392:0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.345637:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224379008:0@lo:400:kworker.0 00010000:00080000:1.0:1789402394.345649:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6f8fde300 x1876324224379520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402394.345660:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224379520:0@lo:400:kworker.0 00010000:00080000:1.0:1789402394.345696:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6f8fdd880 x1876324224379264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402394.345705:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224379264:0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.345717:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224379136:0@lo:400:kworker.0 00000100:00100000:0.0:1789402394.355094:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224378880:12345-0@lo:400:kworker.0 Request processed in 14539us (16200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402394.355114:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789402394.368943:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224378880:0@lo:400:kworker.0 00000100:00100000:1.0:1789402394.852732:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224379648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789402394.852835:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402394.853133:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224379648 00000100:00100000:1.0:1789402394.853157:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224379648 00000100:00100000:1.0:1789402394.853217:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789402394.853229:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224379648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402394.853277:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402394.853335:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224379648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402394.853360:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789402394.853782:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb579c00 x1876324224379648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402394.853807:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224379648:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789402395.106500:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402395.375406:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224379776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402395.375512:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402395.375608:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224379776 00000100:00100000:1.0:1789402395.375618:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224379776 00000100:00100000:1.0:1789402395.375676:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789402395.375686:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224379776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789402395.375731:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402395.375807:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224379776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402395.375814:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789402395.375864:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c5c1e1d500 x1876324224379776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402395.375887:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224379776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789402396.137962:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402396.706239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402396.706380:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402396.707916:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199179264 00000100:00100000:2.0:1789402396.707932:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199179264 00000100:00100000:2.0:1789402396.708030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 206 00000100:00100000:2.0:1789402396.708043:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199179264:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402396.708875:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2352:x1876324199179264:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 829us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402396.708886:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 206 00000100:00100000:1.0:1789402396.709871:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199179392 00000100:00100000:1.0:1789402396.709883:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199179392 00000100:00100000:1.0:1789402396.710012:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 61 00000100:00100000:1.0:1789402396.710024:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199179392:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402396.710100:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199179392:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 80us (3876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402396.710107:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 61 00000100:00080000:3.0:1789402396.710847:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789402397.157086:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402398.179141:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402399.202983:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402399.459737:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224379904:0@lo:400:kworker.0 00000100:00100000:3.0:1789402399.459872:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402399.460031:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224380032:0@lo:400:kworker.0 00000100:00100000:1.0:1789402399.460098:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402399.460288:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224380032 00000100:00100000:1.0:1789402399.460300:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224380032 00000100:00100000:1.0:1789402399.460383:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789402399.460394:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224380032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402399.460457:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224380032:12345-0@lo:400:kworker.0 Request processed in 64us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402399.460465:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789402399.460524:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224380032:0@lo:400:kworker.0 00000100:00100000:2.0:1789402399.461498:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224379904 00000100:00100000:2.0:1789402399.461508:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224379904 00000100:00100000:2.0:1789402399.461556:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789402399.461566:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224379904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402399.472115:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224380160:0@lo:400:kworker.0 00000100:00100000:0.0:1789402399.472211:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402399.472256:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402399.472273:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224380288:0@lo:400:kworker.0 00000100:00100000:0.0:1789402399.472305:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402399.472338:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224380544:0@lo:400:kworker.0 00000100:00100000:0.0:1789402399.472384:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402399.472406:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789402399.472412:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224380416:0@lo:400:kworker.0 00000100:00100000:0.0:1789402399.472434:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402399.472471:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224380160 00000100:00100000:0.0:1789402399.472481:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224380160 00000100:00100000:0.0:1789402399.472683:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224380416 00000100:00100000:0.0:1789402399.472687:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224380416 00000100:00100000:0.0:1789402399.472717:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789402399.472727:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224380160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402399.472861:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224380160:12345-0@lo:400:kworker.0 Request processed in 135us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402399.472869:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789402399.472891:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789402399.472898:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224380416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402399.472930:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224380416:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402399.472936:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789402399.472967:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224380288 00000100:00100000:0.0:1789402399.472971:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224380288 00000100:00100000:0.0:1789402399.473003:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224380544 00000100:00100000:0.0:1789402399.473006:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224380544 00000100:00100000:0.0:1789402399.473028:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789402399.473034:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224380288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402399.473280:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224380160:0@lo:400:kworker.0 00000100:00100000:1.0:1789402399.473318:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789402399.473327:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224380544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402399.473388:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224380544:12345-0@lo:400:kworker.0 Request processed in 62us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402399.473394:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789402399.473433:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224380416:0@lo:400:kworker.0 00010000:00080000:1.0:1789402399.473444:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb814380 x1876324224380544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402399.473454:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224380544:0@lo:400:kworker.0 00000100:00080000:1.0:1789402399.473516:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789402399.473521:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789402399.473524:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402399.473665:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224379904:12345-0@lo:400:kworker.0 Request processed in 12099us (13791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402399.473675:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789402399.473903:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224380288:12345-0@lo:400:kworker.0 Request processed in 867us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402399.473909:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789402399.474412:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c5c1e1c000 x1876324224380288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402399.474443:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224380288:0@lo:400:kworker.0 00000100:00100000:3.0:1789402399.475714:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224379904:0@lo:400:kworker.0 00000100:00100000:1.0:1789402399.971652:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224380672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789402399.971745:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402399.973159:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224380672 00000100:00100000:3.0:1789402399.973175:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224380672 00000100:00100000:3.0:1789402399.973601:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789402399.973614:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224380672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789402399.973664:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402399.973767:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224380672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402399.973775:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789402399.973862:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da8d5180 x1876324224380672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402399.973888:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224380672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789402400.226804:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402400.484399:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224380800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402400.484497:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402400.484588:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224380800 00000100:00100000:2.0:1789402400.484598:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224380800 00000100:00100000:2.0:1789402400.484673:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789402400.484683:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224380800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402400.484727:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402400.484786:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224380800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402400.484793:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789402400.485127:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7006d4380 x1876324224380800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402400.485154:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224380800:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789402400.597382:0:10126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:13:18 (1789402398) === 00000100:00100000:3.0:1789402401.135978:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402401.141183:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199179520 00000100:00100000:0.0:1789402401.141206:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199179520 00000100:00100000:0.0:1789402401.141303:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 208 00000100:00100000:0.0:1789402401.141316:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:8131:x1876324199179520:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789402401.141339:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402401.141420:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7c12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47029 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402401.141458:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47029 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402401.141472:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47029 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402401.141494:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82200, rc 0) 00000100:00100000:0.0:1789402401.141584:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8131:x1876324199179520:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 270us (5635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402401.141592:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 208 00000100:00100000:1.0:1789402401.159707:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402401.160035:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199179648 00000100:00100000:2.0:1789402401.160049:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199179648 00000100:00100000:2.0:1789402401.160133:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 209 00000100:00100000:2.0:1789402401.160145:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8131:x1876324199179648:12345-192.168.203.8@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789402401.160823:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8131:x1876324199179648:12345-192.168.203.8@tcp:501:mount.lustre.0 Request processed in 676us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402401.160834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 209 00000100:00100000:3.0:1789402401.170082:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402401.170237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199179776 00000100:00100000:1.0:1789402401.170250:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199179776 00000100:00100000:1.0:1789402401.170334:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 210 00000100:00100000:1.0:1789402401.170390:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8131:x1876324199179776:12345-192.168.203.8@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789402401.170980:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8131:x1876324199179776:12345-192.168.203.8@tcp:503:mount.lustre.0 Request processed in 633us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402401.170991:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 210 00000100:00100000:3.0:1789402401.187237:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402401.187748:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199179904 00000100:00100000:2.0:1789402401.187764:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199179904 00000100:00100000:2.0:1789402401.187842:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 211 00000100:00100000:2.0:1789402401.187853:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8135:x1876324199179904:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789402401.188233:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8135:x1876324199179904:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 380us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402401.188242:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 211 00000100:00100000:2.0:1789402401.208255:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402401.225105:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199180032 00000100:00100000:3.0:1789402401.225130:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199180032 00000100:00100000:3.0:1789402401.225221:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 212 00000100:00100000:3.0:1789402401.225235:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8135:x1876324199180032:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789402401.225933:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8135:x1876324199180032:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 697us (17690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402401.225955:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 212 00000100:00100000:3.0:1789402401.239122:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402401.239426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199180160 00000100:00100000:1.0:1789402401.239442:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199180160 00000100:00100000:1.0:1789402401.239515:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 213 00000100:00100000:1.0:1789402401.239527:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:8131:x1876324199180160:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789402401.239550:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402401.239575:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83f000/0x9403f4af875f7c19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47053 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402401.239612:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83f000/0x9403f4af875f7c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47053 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402401.239645:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83f000/0x9403f4af875f7c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47053 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402401.239657:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83f000, rc 0) 00000100:00100000:1.0:1789402401.239738:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:8131:x1876324199180160:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 213us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402401.239746:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 213 00000100:00100000:0.0:1789402401.245925:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402401.249911:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199180288 00000100:00100000:3.0:1789402401.249931:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199180288 00000100:00100000:3.0:1789402401.250046:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 214 00000100:00100000:3.0:1789402401.250059:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:8131:x1876324199180288:12345-192.168.203.8@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789402401.250115:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789402401.250142:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789402401.250146:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789402401.250150:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789402401.250152:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00010000:00010000:3.0:1789402401.251327:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402401.254408:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:8131:x1876324199180288:12345-192.168.203.8@tcp:256:mount.lustre.0 Request processed in 4335us (8483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402401.254438:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 214 00000100:00100000:0.0:1789402401.269130:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402401.269322:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199180416 00000100:00100000:2.0:1789402401.269335:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199180416 00000100:00100000:2.0:1789402401.269439:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 215 00000100:00100000:2.0:1789402401.269452:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:8131:x1876324199180416:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789402401.269475:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402401.269533:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4705a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402401.269582:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4705a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402401.269595:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4705a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402401.269607:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df000, rc 0) 00000100:00100000:2.0:1789402401.269683:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:8131:x1876324199180416:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 234us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402401.269691:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 215 00000100:00100000:3.0:1789402401.275117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402401.275416:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199180544 00000100:00100000:0.0:1789402401.275430:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199180544 00000100:00100000:0.0:1789402401.275520:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 216 00000100:00100000:0.0:1789402401.275535:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:8131:x1876324199180544:12345-192.168.203.8@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789402401.275977:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:8131:x1876324199180544:12345-192.168.203.8@tcp:501:mount.lustre.0 Request processed in 445us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402401.275986:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 216 00000100:00100000:3.0:1789402401.283667:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402401.287656:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199180672 00000100:00100000:1.0:1789402401.287678:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199180672 00000100:00100000:1.0:1789402401.287835:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 217 00000100:00100000:1.0:1789402401.287849:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:8131:x1876324199180672:12345-192.168.203.8@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789402401.288212:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:8131:x1876324199180672:12345-192.168.203.8@tcp:503:mount.lustre.0 Request processed in 365us (4559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402401.288223:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 217 00000100:00100000:3.0:1789402401.297167:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402401.299227:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199180800 00000100:00100000:0.0:1789402401.299247:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199180800 00000100:00100000:0.0:1789402401.299325:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 218 00000100:00100000:0.0:1789402401.299414:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:8139:x1876324199180800:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789402401.299847:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:8139:x1876324199180800:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 512us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402401.299858:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 218 00000100:00100000:3.0:1789402401.305119:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402401.305406:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199180928 00000100:00100000:1.0:1789402401.305421:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199180928 00000100:00100000:1.0:1789402401.305518:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 219 00000100:00100000:1.0:1789402401.305533:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:8139:x1876324199180928:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789402401.306999:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:8139:x1876324199180928:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 1457us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402401.307014:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 219 00000100:00100000:3.0:1789402401.322848:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402401.327241:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402401.328717:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199181056 00000100:00100000:0.0:1789402401.328735:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199181056 00000100:00100000:0.0:1789402401.328797:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199181440 00000100:00100000:0.0:1789402401.328802:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199181440 00000100:00100000:0.0:1789402401.328877:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 65 00000100:00100000:0.0:1789402401.328890:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199181440:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402401.329002:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199181440:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 114us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402401.329010:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 65 00000100:00100000:0.0:1789402401.329232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:0.0:1789402401.329238:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1876324199181056:12345-192.168.203.8@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789402401.329268:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a@192.168.203.8@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:0.0:1789402401.329602:0:5846:0:(genops.c:1384:class_connect()) connect: client cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a, cookie 0x9403f4af875f7c27 00000004:00100000:0.0:1789402401.329710:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789402401.330064:0:5846:0:(import.c:65:import_set_state_nolock()) ffff93c6ff709000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789402401.330127:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:2350:x1876324199181056:12345-192.168.203.8@tcp:38:mount.lustre.0 Request processed in 885us (7293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402401.330136:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00080000:3.0:1789402401.330838:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402401.342555:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402401.343003:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402401.344706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199181184 00000100:00100000:0.0:1789402401.344725:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199181184 00000100:00100000:0.0:1789402401.344861:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199181312 00000100:00100000:0.0:1789402401.344866:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199181312 00000100:00100000:0.0:1789402401.344899:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:0.0:1789402401.344909:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+7:0:x1876324199181184:12345-192.168.203.8@tcp:41:mount.lustre.0 00000100:00100000:2.0:1789402401.345060:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:2.0:1789402401.345072:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+7:8131:x1876324199181312:12345-192.168.203.8@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789402401.345126:0:6712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789402401.345245:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+7:8131:x1876324199181312:12345-192.168.203.8@tcp:41:mount.lustre.0 Request processed in 176us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402401.345254:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 12 00000004:00000024:0.0:1789402401.345327:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789402401.345384:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:0:x1876324199181184:12345-192.168.203.8@tcp:41:mount.lustre.0 Request processed in 476us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402401.345391:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00080000:3.0:1789402401.352785:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402401.356770:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402401.359181:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199181568 00000100:00100000:2.0:1789402401.359204:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199181568 00000100:00100000:2.0:1789402401.359635:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:2.0:1789402401.359652:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:8131:x1876324199181568:12345-192.168.203.8@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789402401.359793:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:8131:x1876324199181568:12345-192.168.203.8@tcp:40:mount.lustre.0 Request processed in 146us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402401.359823:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:2.0:1789402401.362820:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402401.362865:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402401.362896:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402401.363025:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199181696 00000100:00100000:1.0:1789402401.363037:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199181696 00000100:00100000:1.0:1789402401.363088:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199181824 00000100:00100000:1.0:1789402401.363091:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199181824 00000100:00100000:1.0:1789402401.363135:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:1.0:1789402401.363145:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876324199181696:12345-192.168.203.8@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789402401.363187:0:8217:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a@192.168.203.8@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1789402401.363230:0:8217:0:(genops.c:1384:class_connect()) connect: client cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a, cookie 0x9403f4af875f7c2e 00002000:00100000:1.0:1789402401.363247:0:8217:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a/ffff93c6ddd79000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789402401.363260:0:8217:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789402401.363602:0:8217:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789402401.363646:0:8217:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd78000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402401.363733:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:2350:x1876324199181696:12345-192.168.203.8@tcp:8:mount.lustre.0 Request processed in 588us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402401.363742:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:1.0:1789402401.363763:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:1.0:1789402401.363769:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876324199181824:12345-192.168.203.8@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789402401.363788:0:8217:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a@192.168.203.8@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1789402401.363807:0:8217:0:(genops.c:1384:class_connect()) connect: client cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a, cookie 0x9403f4af875f7c35 00002000:00100000:1.0:1789402401.363813:0:8217:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a/ffff93c6ddd7d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789402401.363820:0:8217:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789402401.364134:0:8217:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789402401.364154:0:8217:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402401.364181:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:2350:x1876324199181824:12345-192.168.203.8@tcp:8:mount.lustre.0 Request processed in 410us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402401.364189:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:3.0:1789402401.364315:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199181952 00000100:00100000:3.0:1789402401.364322:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199181952 00000100:00100000:3.0:1789402401.364395:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00100000:3.0:1789402401.364404:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:8131:x1876324199181952:12345-192.168.203.8@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789402401.364485:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789402401.364541:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:8131:x1876324199181952:12345-192.168.203.8@tcp:33:mount.lustre.0 Request processed in 138us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402401.364548:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 1 00010000:00010000:1.0:1789402402.275597:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402403.299620:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402404.322598:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402404.580335:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224381056:0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.580491:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402404.580552:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224381568:0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.580580:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402404.580609:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224381056 00000100:00100000:1.0:1789402404.580616:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789402404.580619:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224381056 00000100:00100000:1.0:1789402404.580622:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224380928:0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.580649:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402404.580671:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224381440:0@lo:400:kworker.0 00000100:00100000:0.0:1789402404.580675:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789402404.580684:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224381056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.580690:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402404.580717:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224381312:0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.580742:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402404.580749:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224381056:12345-0@lo:400:kworker.0 Request processed in 66us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402404.580759:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789402404.580763:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789402404.580764:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224381184:0@lo:400:kworker.0 00000100:00100000:0.0:1789402404.580779:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224381440 00000100:00100000:1.0:1789402404.580782:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402404.580783:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224381440 00000100:00100000:0.0:1789402404.580808:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224381184 00000100:00100000:1.0:1789402404.580810:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224381568 00000100:00100000:0.0:1789402404.580811:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224381184 00000100:00100000:1.0:1789402404.580812:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224381568 00000100:00100000:0.0:1789402404.580825:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789402404.580831:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224381440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.580839:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224381312 00000100:00100000:1.0:1789402404.580842:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224381312 00000100:00100000:0.0:1789402404.580861:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224381440:12345-0@lo:400:kworker.0 Request processed in 30us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402404.580865:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789402404.580867:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789402404.580871:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224381568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402404.580876:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789402404.580881:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224381184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.580903:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224381568:12345-0@lo:400:kworker.0 Request processed in 32us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402404.580905:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224381184:12345-0@lo:400:kworker.0 Request processed in 24us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402404.580910:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789402404.580910:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789402404.580933:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789402404.580940:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224381312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.580973:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224381312:12345-0@lo:400:kworker.0 Request processed in 34us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402404.580988:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789402404.581008:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224380928 00000100:00100000:1.0:1789402404.581012:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224380928 00000100:00100000:1.0:1789402404.581045:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789402404.581056:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224380928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.581090:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224380928:12345-0@lo:400:kworker.0 Request processed in 39us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402404.581096:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789402404.581184:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224381184:0@lo:400:kworker.0 00010000:00080000:1.0:1789402404.581198:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6da8d5180 x1876324224381312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402404.581209:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224381312:0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.581239:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224380928:0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.581248:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224381440:0@lo:400:kworker.0 00000100:00100000:1.0:1789402404.581258:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224381056:0@lo:400:kworker.0 00010000:00080000:1.0:1789402404.581267:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31f4000 x1876324224381568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402404.581275:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224381568:0@lo:400:kworker.0 00000100:00080000:2.0:1789402404.581461:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789402404.581467:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402404.581469:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1789402404.662296:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a 00000100:00100000:3.0:1789402405.091568:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402405.091780:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224381696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402405.091869:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402405.091998:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224381696 00000100:00100000:0.0:1789402405.092008:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224381696 00000100:00100000:0.0:1789402405.092068:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789402405.092079:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224381696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789402405.092123:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789402405.092180:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224381696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402405.092186:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789402405.094782:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31f7480 x1876324224381696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402405.094827:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224381696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789402405.351106:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402405.602883:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402405.602926:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224381824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402405.603031:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402405.603173:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224381824 00000100:00100000:2.0:1789402405.603184:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224381824 00000100:00100000:2.0:1789402405.603259:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789402405.603820:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224381824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402405.603871:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402405.603962:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224381824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402405.603971:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789402405.604088:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6f7ee3b80 x1876324224381824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402405.604129:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224381824:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789402405.686687:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a 00000001:00100000:3.0:1789402406.156588:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a 00010000:00010000:0.0:1789402406.380086:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402406.430824:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402406.430875:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402406.430954:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402406.430987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402406.431022:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199182592 00000100:00100000:0.0:1789402406.431028:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402406.431038:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199182592 00000100:00100000:0.0:1789402406.431067:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199182336 00000100:00100000:0.0:1789402406.431074:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199182336 00000100:00100000:3.0:1789402406.431122:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199182464 00000100:00100000:0.0:1789402406.431123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199182208 00000100:00100000:3.0:1789402406.431129:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199182464 00000100:00100000:0.0:1789402406.431130:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199182208 00000100:00100000:0.0:1789402406.431166:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:3.0:1789402406.431177:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:0.0:1789402406.431181:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199182336:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402406.431197:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199182592:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402406.431307:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 70 00000100:00100000:2.0:1789402406.431320:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199182208:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402406.431442:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199182336:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 265us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402406.431452:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:0.0:1789402406.431482:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 40 00000100:00100000:0.0:1789402406.431490:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199182464:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402406.431722:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199182080 00000100:00100000:1.0:1789402406.431729:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199182080 00000100:00100000:1.0:1789402406.431767:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 221 00000100:00100000:1.0:1789402406.431775:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199182080:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402406.433726:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199182592:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 2522us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402406.433745:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00080000:3.0:1789402406.433835:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402406.434408:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789402406.434414:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789402406.436989:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199182208:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 5654us (5981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402406.437007:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 70 00000100:00100000:0.0:1789402406.441198:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199182464:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 9690us (10152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402406.441219:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 40 00000100:00100000:1.0:1789402406.441815:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199182080:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 10036us (11002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402406.441828:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 221 00010000:00010000:0.0:1789402407.394585:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789402407.519073:0:10323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789402408.418519:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402409.442751:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402409.701593:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224381952:0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.701675:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402409.701870:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224382464:0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.701910:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402409.701941:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789402409.701947:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224382080:0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.701968:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402409.701986:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224382592:0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.702008:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402409.702059:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224382464 00000100:00100000:3.0:1789402409.702066:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224382464 00000100:00100000:3.0:1789402409.702119:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224382080 00000100:00100000:3.0:1789402409.702123:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224382080 00000100:00100000:3.0:1789402409.702144:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789402409.702151:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224382464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.702283:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224382464:12345-0@lo:400:kworker.0 Request processed in 132us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402409.702291:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789402409.702309:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789402409.702316:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224382080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.702367:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224382080:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402409.702373:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789402409.702391:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224382592 00000100:00100000:3.0:1789402409.702394:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224382592 00000100:00100000:3.0:1789402409.702420:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789402409.702426:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224382592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.702453:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224382592:12345-0@lo:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402409.702459:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789402409.702473:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789402409.702477:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402409.702509:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224382080:0@lo:400:kworker.0 00010000:00080000:3.0:1789402409.702520:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa975500 x1876324224382592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402409.704158:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224382592:0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.704284:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224382464:0@lo:400:kworker.0 00000100:00100000:1.0:1789402409.704409:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224382208:0@lo:400:kworker.0 00000100:00100000:1.0:1789402409.704464:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402409.704504:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402409.704511:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224382336:0@lo:400:kworker.0 00000100:00100000:1.0:1789402409.704538:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402409.704576:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224382336 00000100:00100000:1.0:1789402409.704581:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224382336 00000100:00100000:1.0:1789402409.704632:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789402409.704640:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224382336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402409.704686:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224382336:12345-0@lo:400:kworker.0 Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402409.704694:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789402409.704852:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789402409.704873:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa974380 x1876324224382336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402409.704894:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224382336:0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.704966:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224382208 00000100:00100000:3.0:1789402409.704970:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224382208 00000100:00100000:3.0:1789402409.705013:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789402409.705020:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224382208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402409.705057:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224382208:12345-0@lo:400:kworker.0 Request processed in 37us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402409.705065:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789402409.706518:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402409.706561:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224382208:0@lo:400:kworker.0 00000100:00100000:0.0:1789402409.712854:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224381952 00000100:00100000:0.0:1789402409.712868:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224381952 00000100:00100000:0.0:1789402409.712942:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789402409.712952:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224381952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402409.713810:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224381952:12345-0@lo:400:kworker.0 Request processed in 857us (12132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402409.713820:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789402409.722517:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224381952:0@lo:400:kworker.0 00000100:00100000:3.0:1789402410.211836:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402410.211859:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224382720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402410.211940:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402410.220530:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224382720 00000100:00100000:1.0:1789402410.220547:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224382720 00000100:00100000:1.0:1789402410.220618:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789402410.220627:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224382720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402410.220665:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402410.220748:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224382720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (8807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402410.220755:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789402410.220807:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c5c1e1e300 x1876324224382720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402410.220827:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224382720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789402410.474083:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402410.723628:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789402410.723653:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224382848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402410.723723:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402410.725066:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224382848 00000100:00100000:1.0:1789402410.725078:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224382848 00000100:00100000:1.0:1789402410.725129:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789402410.725137:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224382848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789402410.725170:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402410.725252:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224382848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402410.725259:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789402410.725860:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31f4700 x1876324224382848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402410.725890:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224382848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789402411.490921:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402411.550953:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402411.550986:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402411.551010:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402411.551029:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402411.551050:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402411.551082:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199182848 00000100:00100000:2.0:1789402411.551091:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199182848 00000100:00100000:2.0:1789402411.551139:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199182976 00000100:00100000:2.0:1789402411.551142:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199182976 00000100:00100000:2.0:1789402411.551163:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 74 00000100:00100000:2.0:1789402411.551171:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199182848:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402411.551249:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199182848:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 78us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402411.551257:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 74 00000100:00100000:2.0:1789402411.551274:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 75 00000100:00100000:2.0:1789402411.551280:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199182976:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402411.551304:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199182976:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 24us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402411.551310:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 75 00000100:00100000:2.0:1789402411.551326:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199183104 00000100:00100000:2.0:1789402411.551330:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199183104 00000100:00100000:2.0:1789402411.551382:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199183232 00000100:00100000:2.0:1789402411.551385:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199183232 00000100:00100000:2.0:1789402411.551418:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 43 00000100:00100000:2.0:1789402411.551425:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199183104:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402411.551449:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199183104:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402411.551455:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 43 00000100:00100000:2.0:1789402411.551466:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:2.0:1789402411.551472:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199183232:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402411.551490:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199183232:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 19us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402411.551503:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:2.0:1789402411.551519:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199182720 00000100:00100000:2.0:1789402411.551523:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199182720 00000100:00100000:2.0:1789402411.551547:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 223 00000100:00100000:2.0:1789402411.551553:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199182720:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402411.551575:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199182720:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402411.551581:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 223 00000100:00080000:2.0:1789402411.551608:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402411.551612:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789402411.551615:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789402412.515533:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402413.540100:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402414.562691:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402414.818587:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224383104:0@lo:400:kworker.0 00000100:00100000:0.0:1789402414.818683:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402414.818786:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224382976:0@lo:400:kworker.0 00000100:00100000:1.0:1789402414.819052:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224383104 00000100:00100000:1.0:1789402414.819064:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224383104 00000100:00100000:1.0:1789402414.819279:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789402414.819308:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224383104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402414.819663:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224383360:0@lo:400:kworker.0 00000100:00100000:2.0:1789402414.820714:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402414.821089:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402414.821256:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224383360 00000100:00100000:3.0:1789402414.821267:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224383360 00000100:00100000:3.0:1789402414.821331:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789402414.821380:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224383360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402414.821445:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224383360:12345-0@lo:400:kworker.0 Request processed in 106us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402414.821453:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1789402414.821492:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789402414.821623:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224382976 00000100:00100000:3.0:1789402414.821628:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224382976 00000100:00100000:3.0:1789402414.821654:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789402414.821661:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224382976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402414.821704:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224382976:12345-0@lo:400:kworker.0 Request processed in 43us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402414.821712:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789402414.821833:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224383104:12345-0@lo:400:kworker.0 Request processed in 2524us (3146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402414.821855:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789402414.821895:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224383232:0@lo:400:kworker.0 00000100:00100000:3.0:1789402414.821934:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402414.821967:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224383232 00000100:00100000:3.0:1789402414.821971:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224383232 00000100:00100000:3.0:1789402414.822003:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789402414.822011:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224383232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402414.822049:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224383232:12345-0@lo:400:kworker.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402414.822056:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789402414.822071:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402414.826386:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224382976:0@lo:400:kworker.0 00000100:00100000:2.0:1789402414.826410:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224383488:0@lo:400:kworker.0 00000100:00100000:2.0:1789402414.826572:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789402414.827058:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa974700 x1876324224383360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402414.827076:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224383360:0@lo:400:kworker.0 00000100:00100000:3.0:1789402414.827138:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224383104:0@lo:400:kworker.0 00000100:00100000:1.0:1789402414.827144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224383488 00000100:00100000:1.0:1789402414.827154:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224383488 00000100:00100000:3.0:1789402414.827161:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224383616:0@lo:400:kworker.0 00000100:00100000:3.0:1789402414.827205:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402414.827234:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789402414.827247:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224383488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402414.827266:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224383232:0@lo:400:kworker.0 00000100:00100000:1.0:1789402414.827317:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224383488:12345-0@lo:400:kworker.0 Request processed in 74us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402414.827325:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789402414.827364:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402414.827701:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224383616 00000100:00100000:2.0:1789402414.827707:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224383616 00000100:00100000:2.0:1789402414.827774:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789402414.827783:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402414.827832:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224383616:12345-0@lo:400:kworker.0 Request processed in 51us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402414.827839:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789402414.827881:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224383488:0@lo:400:kworker.0 00010000:00080000:2.0:1789402414.827969:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa974e00 x1876324224383616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402414.827980:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224383616:0@lo:400:kworker.0 00000100:00080000:1.0:1789402414.828101:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402415.332385:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224383744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402415.332499:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402415.332609:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224383744 00000100:00100000:3.0:1789402415.332620:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224383744 00000100:00100000:3.0:1789402415.332684:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789402415.332697:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224383744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789402415.332749:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402415.332812:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224383744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402415.332819:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789402415.332885:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31f7800 x1876324224383744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402415.332908:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224383744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789402415.603320:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402415.849727:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789402415.849759:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224383872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402415.849878:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402415.849968:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224383872 00000100:00100000:2.0:1789402415.849979:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224383872 00000100:00100000:2.0:1789402415.850038:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789402415.850048:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224383872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402415.850091:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402415.850143:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224383872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402415.850150:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789402415.850202:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa974e00 x1876324224383872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402415.850224:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224383872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789402416.610901:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402416.672640:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402416.672687:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402416.672730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402416.672756:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402416.672782:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402416.672814:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199183360 00000100:00100000:3.0:1789402416.672835:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199183360 00000100:00100000:3.0:1789402416.672897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 225 00000100:00100000:3.0:1789402416.672910:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199183360:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402416.673001:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199183360:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 93us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402416.673009:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 225 00000100:00100000:3.0:1789402416.673047:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199183488 00000100:00100000:3.0:1789402416.673066:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199183488 00000100:00100000:3.0:1789402416.673108:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199183616 00000100:00100000:3.0:1789402416.673111:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199183616 00000100:00100000:3.0:1789402416.673136:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 79 00000100:00100000:3.0:1789402416.673143:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199183488:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402416.673181:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199183488:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402416.673186:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 79 00000100:00100000:3.0:1789402416.673199:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 80 00000100:00100000:3.0:1789402416.673273:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199183616:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402416.673305:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199183616:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402416.673311:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 80 00000100:00100000:3.0:1789402416.673335:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199183744 00000100:00100000:3.0:1789402416.673339:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199183744 00000100:00100000:3.0:1789402416.673404:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199183872 00000100:00100000:3.0:1789402416.673408:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199183872 00000100:00100000:3.0:1789402416.673431:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:3.0:1789402416.673439:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199183744:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402416.673468:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199183744:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 30us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402416.673475:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:3.0:1789402416.673487:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:3.0:1789402416.673494:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199183872:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402416.673517:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199183872:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 24us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402416.673534:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00080000:3.0:1789402416.673710:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789402416.673716:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402416.673719:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789402417.635072:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402418.678177:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402419.688509:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402419.943479:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224384256:0@lo:400:kworker.0 00000100:00100000:3.0:1789402419.943545:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402419.943593:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789402419.943598:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224384384:0@lo:400:kworker.0 00000100:00100000:3.0:1789402419.943619:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402419.943651:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224384256 00000100:00100000:3.0:1789402419.943657:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224384256 00000100:00100000:3.0:1789402419.943702:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789402419.943710:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224384256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402419.943756:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224384256:12345-0@lo:400:kworker.0 Request processed in 46us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402419.943763:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789402419.943786:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224384384 00000100:00100000:3.0:1789402419.943790:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224384384 00000100:00100000:3.0:1789402419.943826:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789402419.943832:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224384384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402419.943859:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224384384:12345-0@lo:400:kworker.0 Request processed in 28us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402419.943865:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789402419.943881:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402419.943885:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789402419.943912:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e31f4000 x1876324224384384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402419.943940:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224384384:0@lo:400:kworker.0 00000100:00100000:3.0:1789402419.943953:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224384256:0@lo:400:kworker.0 00000100:00100000:1.0:1789402419.944038:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224384000:0@lo:400:kworker.0 00000100:00100000:1.0:1789402419.944070:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402419.944098:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224384512:0@lo:400:kworker.0 00000100:00100000:1.0:1789402419.944120:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402419.944146:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789402419.944152:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224384128:0@lo:400:kworker.0 00000100:00100000:1.0:1789402419.944170:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402419.944186:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224384640:0@lo:400:kworker.0 00000100:00100000:1.0:1789402419.944201:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402419.944220:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224384512 00000100:00100000:1.0:1789402419.944224:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224384512 00000100:00100000:1.0:1789402419.944248:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224384128 00000100:00100000:1.0:1789402419.944250:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224384128 00000100:00100000:1.0:1789402419.944265:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789402419.944278:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224384512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402419.944309:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224384512:12345-0@lo:400:kworker.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402419.944314:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789402419.944326:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789402419.944331:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224384128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402419.944370:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224384128:12345-0@lo:400:kworker.0 Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402419.944375:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789402419.944387:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402419.944404:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224384128:0@lo:400:kworker.0 00000100:00100000:1.0:1789402419.944412:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224384512:0@lo:400:kworker.0 00000100:00100000:3.0:1789402419.944798:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224384000 00000100:00100000:3.0:1789402419.944814:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224384000 00000100:00100000:3.0:1789402419.944881:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789402419.944889:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224384000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402419.944931:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224384000:12345-0@lo:400:kworker.0 Request processed in 42us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402419.944936:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789402419.947239:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224384640 00000100:00100000:3.0:1789402419.947251:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224384640 00000100:00100000:3.0:1789402419.947377:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789402419.947387:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224384640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402419.947465:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224384640:12345-0@lo:400:kworker.0 Request processed in 80us (3261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402419.947471:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789402419.947517:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6f7ee2300 x1876324224384640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402419.947531:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224384640:0@lo:400:kworker.0 00000100:00100000:3.0:1789402419.947543:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224384000:0@lo:400:kworker.0 00000100:00080000:1.0:1789402419.958208:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789402420.451659:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224384768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789402420.451722:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402420.451810:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224384768 00000100:00100000:1.0:1789402420.451818:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224384768 00000100:00100000:1.0:1789402420.451860:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789402420.451869:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224384768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402420.451900:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402420.451940:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224384768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402420.451947:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789402420.451986:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c5c1e1ea00 x1876324224384768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402420.452148:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224384768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789402420.707506:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402420.977618:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789402420.977643:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224384896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402420.978872:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402420.978960:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224384896 00000100:00100000:3.0:1789402420.978978:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224384896 00000100:00100000:3.0:1789402420.979024:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789402420.979033:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224384896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402420.979070:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402420.979123:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224384896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402420.979130:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789402420.979171:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6f7ee2300 x1876324224384896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402420.979191:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f7ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224384896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789402421.738166:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402421.792959:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402421.793005:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402421.793028:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402421.793051:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402421.793073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402421.793098:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199184256 00000100:00100000:3.0:1789402421.793107:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199184256 00000100:00100000:3.0:1789402421.793163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199184128 00000100:00100000:3.0:1789402421.793166:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199184128 00000100:00100000:3.0:1789402421.793191:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 84 00000100:00100000:3.0:1789402421.793201:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2352:x1876324199184256:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402421.793273:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2352:x1876324199184256:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402421.793280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 84 00000100:00100000:3.0:1789402421.793299:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 85 00000100:00100000:3.0:1789402421.793305:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199184128:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402421.793367:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199184128:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 36us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402421.793375:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 85 00000100:00100000:3.0:1789402421.793552:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199184384 00000100:00100000:3.0:1789402421.793557:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199184384 00000100:00100000:3.0:1789402421.793583:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199184512 00000100:00100000:3.0:1789402421.793586:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199184512 00000100:00100000:3.0:1789402421.793608:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:3.0:1789402421.793615:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2350:x1876324199184384:12345-192.168.203.8@tcp:9:kworker.0 00000020:00000080:3.0:1789402421.793636:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7c2e 00000100:00080000:3.0:1789402421.793646:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd78000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789402421.793687:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789402421.794062:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+2:2350:x1876324199184384:12345-192.168.203.8@tcp:9:kworker.0 Request processed in 446us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402421.794069:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:3.0:1789402421.794083:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:3.0:1789402421.794089:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2350:x1876324199184512:12345-192.168.203.8@tcp:9:kworker.0 00000020:00000080:3.0:1789402421.794100:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7c35 00000100:00080000:3.0:1789402421.794106:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789402421.794126:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789402421.794291:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+2:2350:x1876324199184512:12345-192.168.203.8@tcp:9:kworker.0 Request processed in 201us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402421.794297:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00080000:3.0:1789402421.794319:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789402421.794323:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402421.794325:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789402421.794696:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402421.794703:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402421.794774:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199184000 00000100:00100000:1.0:1789402421.794780:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199184000 00000100:00100000:1.0:1789402421.794830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 227 00000100:00100000:1.0:1789402421.794837:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2352:x1876324199184000:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402421.794883:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2352:x1876324199184000:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 46us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402421.794889:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 227 00010000:00010000:3.0:1789402422.755289:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402423.778612:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402424.810509:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789402424.860845:0:11025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789402425.058893:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224385408:0@lo:400:kworker.0 00000100:00100000:2.0:1789402425.058963:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402425.059021:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789402425.059028:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224385280:0@lo:400:kworker.0 00000100:00100000:2.0:1789402425.059053:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402425.059123:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224385152:0@lo:400:kworker.0 00000100:00100000:0.0:1789402425.059153:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402425.059180:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224385664:0@lo:400:kworker.0 00000100:00100000:0.0:1789402425.059202:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402425.059218:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789402425.059224:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224385024:0@lo:400:kworker.0 00000100:00100000:0.0:1789402425.059251:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402425.059273:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224385536:0@lo:400:kworker.0 00000100:00100000:0.0:1789402425.059293:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402425.059814:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224385280 00000100:00100000:2.0:1789402425.059832:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224385280 00000100:00100000:2.0:1789402425.059889:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224385152 00000100:00100000:2.0:1789402425.059892:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224385152 00000100:00100000:2.0:1789402425.059906:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224385536 00000100:00100000:2.0:1789402425.059907:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224385536 00000100:00100000:2.0:1789402425.059924:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789402425.059932:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224385280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402425.059989:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224385280:12345-0@lo:400:kworker.0 Request processed in 57us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402425.059996:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789402425.060012:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789402425.060018:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224385152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402425.060049:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224385152:12345-0@lo:400:kworker.0 Request processed in 31us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402425.060054:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789402425.060065:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789402425.060071:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224385536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402425.060098:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224385536:12345-0@lo:400:kworker.0 Request processed in 27us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402425.060103:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789402425.060266:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224385280:0@lo:400:kworker.0 00000100:00100000:2.0:1789402425.060297:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224385536:0@lo:400:kworker.0 00000100:00100000:2.0:1789402425.060307:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224385152:0@lo:400:kworker.0 00000100:00100000:3.0:1789402425.060742:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224385408 00000100:00100000:3.0:1789402425.060748:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224385408 00000100:00100000:3.0:1789402425.060804:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224385664 00000100:00100000:3.0:1789402425.060807:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224385664 00000100:00100000:3.0:1789402425.060832:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789402425.060839:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224385408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402425.060887:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224385408:12345-0@lo:400:kworker.0 Request processed in 49us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402425.060893:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789402425.060909:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789402425.060915:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224385664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402425.060948:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224385664:12345-0@lo:400:kworker.0 Request processed in 33us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402425.060953:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789402425.060975:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224385024 00000100:00100000:3.0:1789402425.060979:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224385024 00000100:00100000:3.0:1789402425.061004:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789402425.061010:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224385024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402425.061037:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224385024:12345-0@lo:400:kworker.0 Request processed in 28us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402425.061042:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789402425.061091:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224385024:0@lo:400:kworker.0 00010000:00080000:3.0:1789402425.061105:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa974380 x1876324224385664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402425.061127:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224385664:0@lo:400:kworker.0 00010000:00080000:3.0:1789402425.061157:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa976d80 x1876324224385408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402425.061165:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224385408:0@lo:400:kworker.0 00000100:00080000:1.0:1789402425.061277:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789402425.061282:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789402425.061284:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789402425.147721:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a 00000020:00000080:2.0:1789402425.147731:0:7645:0:(genops.c:885:class_export_put()) final put ffff93c6ddd7d800/cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a 00000020:00000080:0.0:1789402425.147851:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ddd7d800/cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a for lustre-OST0001 00000020:00000080:0.0:1789402425.147979:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ddd7c800 for lustre-OST0001 00000100:00100000:3.0:1789402425.570889:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224385792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402425.570966:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402425.571097:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224385792 00000100:00100000:1.0:1789402425.571105:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224385792 00000100:00100000:1.0:1789402425.571164:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789402425.571174:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224385792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402425.571207:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402425.571256:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224385792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402425.571262:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789402425.571876:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb579f80 x1876324224385792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402425.571897:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224385792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402425.832049:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402426.083725:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224385920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402426.083806:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402426.083955:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224385920 00000100:00100000:0.0:1789402426.083965:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224385920 00000100:00100000:0.0:1789402426.084022:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789402426.084032:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224385920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789402426.084063:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789402426.084114:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224385920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402426.084122:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789402426.084179:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fa977800 x1876324224385920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402426.084199:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224385920:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789402426.628459:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a 00000020:00000080:0.0:1789402426.628468:0:6714:0:(genops.c:885:class_export_put()) final put ffff93c6ddd79000/cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a 00000020:00000080:3.0:1789402426.628521:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ddd79000/cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a for lustre-OST0000 00000020:00000080:3.0:1789402426.628567:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ddd78000 for lustre-OST0000 00010000:00010000:0.0:1789402426.850710:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402426.919395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402426.919441:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402426.919656:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199184640 00000100:00100000:1.0:1789402426.919667:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199184640 00000100:00100000:1.0:1789402426.919712:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 229 00000100:00100000:1.0:1789402426.919721:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199184640:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402426.919799:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199184640:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 79us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402426.919820:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 229 00000100:00100000:2.0:1789402426.922661:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199184768 00000100:00100000:2.0:1789402426.922687:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199184768 00000100:00100000:2.0:1789402426.922760:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 89 00000100:00100000:2.0:1789402426.922771:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199184768:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402426.922851:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199184768:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 81us (3408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402426.922858:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 89 00000100:00080000:2.0:1789402426.922879:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402426.925856:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402426.925895:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199184896 00000100:00100000:3.0:1789402426.925905:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199184896 00000100:00100000:3.0:1789402426.925973:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 90 00000100:00100000:3.0:1789402426.925985:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199184896:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402426.926054:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199184896:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402426.926063:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 90 00000100:00080000:2.0:1789402426.926284:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789402427.880416:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789402428.340492:0:11173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa4eaabf0 20000000:00000080:3.0:1789402428.340510:0:11173:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c6ff652400 uarg=0000000000000000 20000000:01000000:3.0:1789402428.340559:0:11173:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789402428.340564:0:11173:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789402428.340574:0:11173:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789402428.343611:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789402428.343874:0:11173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789402428.352021:0:11173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789402428.352059:0:11173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352078:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7be1 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352157:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7bef expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352164:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7bfd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352172:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47022 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352180:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4705a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352187:0:11173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352232:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4705a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352249:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4705a expref: 12 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402428.352564:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb579500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386048:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402428.352679:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47022 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352688:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47022 expref: 12 pid: 5836 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402428.352697:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb57a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386176:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402428.352750:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7bfd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352757:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7bfd expref: 18 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402428.352766:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb579f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386304:0@lo:104: 00000100:00100000:1.0:1789402428.352805:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789402428.352838:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7bef expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352845:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7bef expref: 18 pid: 5836 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402428.352853:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386432:0@lo:104: 00000100:00100000:1.0:1789402428.352873:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789402428.352896:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7be1 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402428.352904:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7be1 expref: 18 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402428.352921:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386560:0@lo:104: 00000100:00100000:1.0:1789402428.352944:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402428.352953:0:11173:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789402428.353156:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224386304 00000100:00100000:3.0:1789402428.353163:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224386304 00000100:00100000:3.0:1789402428.353199:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224386432 00000100:00100000:3.0:1789402428.353203:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224386432 00000100:00100000:3.0:1789402428.353212:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224386560 00000100:00100000:3.0:1789402428.353214:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224386560 00000100:00100000:3.0:1789402428.353228:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789402428.353237:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+5:11173:x1876324224386304:12345-0@lo:104: 00010000:00010000:3.0:1789402428.353249:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402428.353314:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789402428.353320:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+5:11173:x1876324224386304:12345-0@lo:104: Request processed in 85us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402428.353327:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789402428.353550:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789402428.353558:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+4:11173:x1876324224386432:12345-0@lo:104: 00010000:00010000:3.0:1789402428.353566:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402428.353602:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789402428.353607:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+4:11173:x1876324224386432:12345-0@lo:104: Request processed in 51us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402428.353613:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789402428.353627:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789402428.353633:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:11173:x1876324224386560:12345-0@lo:104: 00010000:00010000:3.0:1789402428.353642:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402428.353674:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789402428.353679:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:11173:x1876324224386560:12345-0@lo:104: Request processed in 47us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402428.353685:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789402428.353790:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789402428.353796:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353804:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dea00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402428.353808:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353817:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402428.353824:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402428.353830:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789402428.353861:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353877:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402428.353899:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353906:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dea00/0x9403f4af875f7bfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c04 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353917:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789402428.353920:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353925:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfa00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402428.353927:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353934:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402428.353940:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402428.353945:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789402428.353959:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353964:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402428.353970:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353976:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7bef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7bf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353990:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402428.353993:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.353998:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e600 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402428.354001:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.354007:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402428.354014:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402428.354018:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789402428.354030:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.354035:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402428.354049:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.354055:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e600/0x9403f4af875f7be1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7be8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.354067:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402428.354069:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402428.354070:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402428.354082:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224386688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402428.354122:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402428.354144:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402428.354150:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224386816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402428.354170:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402428.354397:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb579f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386304:0@lo:104: 00000100:00100000:1.0:1789402428.354406:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386432:0@lo:104: 00000100:00100000:1.0:1789402428.354412:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386560:0@lo:104: 00000100:00100000:2.0:1789402428.357610:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224386944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789402428.357682:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402428.357776:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224386688 00000100:00100000:2.0:1789402428.357784:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224386688 00010000:00010000:2.0:1789402428.357819:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7bfd expref: 19 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402428.357849:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224386816 00000100:00100000:2.0:1789402428.357853:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224386816 00010000:00010000:2.0:1789402428.357865:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7bef expref: 20 pid: 5836 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402428.357875:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224386944 00000100:00100000:2.0:1789402428.357877:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224386944 00010000:00010000:2.0:1789402428.357886:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7be1 expref: 21 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402428.357921:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789402428.357930:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8612d911-d8bf-490d-b22c-35e85a3b4473+21:3315:x1876324224386688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402428.357947:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402428.357952:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7bfd expref: 21 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.357962:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7bfd expref: 21 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.357978:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f7c04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7bfd expref: 21 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.357993:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402428.358029:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8612d911-d8bf-490d-b22c-35e85a3b4473+20:3315:x1876324224386688:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (3906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402428.358036:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789402428.358096:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789402428.358102:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224386816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402428.358109:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402428.358113:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7bef expref: 19 pid: 5836 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.358120:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7bef expref: 19 pid: 5836 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.358129:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f7bf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7bef expref: 19 pid: 5836 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.358149:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402428.358174:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8612d911-d8bf-490d-b22c-35e85a3b4473+18:3315:x1876324224386816:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402428.358179:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789402428.358190:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789402428.358196:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8612d911-d8bf-490d-b22c-35e85a3b4473+17:3313:x1876324224386944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402428.358203:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402428.358206:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7be1 expref: 17 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.358214:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7be1 expref: 17 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.358224:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7be8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7be1 expref: 17 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.358233:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402428.358257:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3313:x1876324224386944:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402428.358264:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789402428.358668:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224386944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789402428.358698:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224386816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789402428.358706:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224386688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789402428.359077:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402428.359403:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402428.359690:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb579500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386048:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402428.359700:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb57a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876324224386176:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402428.359745:0:11173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402428.359959:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199185024 00000100:00100000:3.0:1789402428.359966:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199185024 00010000:00010000:3.0:1789402428.359992:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4705a expref: 13 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402428.360026:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:3.0:1789402428.360033:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199185024:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402428.360045:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402428.360049:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4705a expref: 13 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402428.360060:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4705a expref: 13 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402428.360244:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6ef3df000/0x9403f4af875f7c20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4705a expref: 13 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402428.360260:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402428.360314:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:2351:x1876324199185024:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 280us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402428.360321:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:3.0:1789402428.365335:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402428.366187:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199185152 00000100:00100000:2.0:1789402428.366208:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199185152 00010000:00010000:2.0:1789402428.366251:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47022 expref: 12 pid: 5836 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402428.366357:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 29 00000100:00100000:2.0:1789402428.366370:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:2353:x1876324199185152:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402428.366386:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402428.366391:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47022 expref: 12 pid: 5836 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366405:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47022 expref: 12 pid: 5836 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366423:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83e800/0x9403f4af875f7c0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47022 expref: 12 pid: 5836 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366440:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366448:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366465:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366472:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366478:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366495:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366501:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402428.366505:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366515:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366540:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402428.366552:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402428.366906:0:11173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.366915:0:11173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402428.366920:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83e000/0x9403f4af875f7c3c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402428.373485:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:2353:x1876324199185152:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 7106us (8151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402428.373500:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 29 00010000:00010000:0.0:1789402428.900223:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789402429.545235:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789402429.545248:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6ff7f4000 from 7 10000000:01000000:0.0:1789402429.545253:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789402429.545481:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402429.545495:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402429.545508:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402429.545541:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789402429.545633:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402429.545904:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224387072 00000100:00100000:1.0:1789402429.545914:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224387072 00000100:00100000:0.0:1789402429.546791:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d11d80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402429.547252:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789402429.547784:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224387072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789402429.547809:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402429.547836:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7c43 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402429.547876:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7c43 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402429.547889:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7c43 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402429.547900:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83f800, rc 0) 00000100:00100000:1.0:1789402429.550563:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224387072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2777us (4914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402429.550580:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789402429.552445:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402429.552499:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402429.552516:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402429.552624:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402429.552700:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402429.552772:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d11d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402429.553382:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224387200 00000100:00100000:2.0:1789402429.553393:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224387200 00000100:00100000:2.0:1789402429.553451:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789402429.553461:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224387200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402429.553821:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224387200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402429.553829:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789402429.555485:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402429.555568:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402429.555675:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402429.555720:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402429.556518:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224387328 00000100:00100000:0.0:1789402429.556531:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224387328 00000100:00100000:0.0:1789402429.556612:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789402429.556624:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224387328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402429.558864:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224387328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2225us (3172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402429.558883:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789402429.560578:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789402429.566918:0:11193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789402429.570356:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789402429.570403:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789402429.570418:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402429.570435:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402429.570508:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789402429.570512:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6e61ce000 from 7 10000000:01000000:1.0:1789402429.570515:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789402429.570561:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402429.570568:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402429.570578:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402429.570605:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789402429.570738:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402429.570863:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224387456 00000100:00100000:2.0:1789402429.570874:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224387456 00000100:00100000:1.0:1789402429.570900:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402429.571763:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789402429.571780:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224387456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402429.571801:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402429.571821:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7c51 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402429.571863:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7c51 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402429.571876:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7c51 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402429.571887:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df600, rc 0) 00000100:00100000:2.0:1789402429.572397:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224387456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 618us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402429.572405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789402429.572568:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402429.572593:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402429.572606:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402429.572699:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402429.572753:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402429.572799:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6cb82a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402429.572875:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224387584 00000100:00100000:2.0:1789402429.572883:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224387584 00000100:00100000:2.0:1789402429.573272:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789402429.573284:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224387584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402429.573659:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224387584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402429.573667:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789402429.573777:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402429.573838:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402429.573886:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402429.574124:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6cb82a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402429.574288:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224387712 00000100:00100000:3.0:1789402429.574296:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224387712 00000100:00100000:3.0:1789402429.574333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789402429.574350:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224387712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789402429.574593:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224387712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402429.574601:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789402429.574780:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789402429.575918:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789402429.576412:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789402429.576434:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789402429.576446:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402429.576461:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402429.576473:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789402429.576494:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6e31a1800 from 7 10000000:01000000:3.0:1789402429.576497:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789402429.576539:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402429.576547:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402429.576558:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402429.576584:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789402429.576649:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402429.576695:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c82dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402429.576792:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224387840 00000100:00100000:0.0:1789402429.576803:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224387840 00000100:00100000:0.0:1789402429.576843:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789402429.576852:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224387840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402429.576869:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402429.576884:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7c5f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402429.576915:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7c5f expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402429.576936:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7c5f expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402429.576945:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83800, rc 0) 00000100:00100000:0.0:1789402429.576990:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224387840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402429.576997:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789402429.577310:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402429.577326:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402429.577339:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402429.577423:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402429.577449:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402429.577465:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c82dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402429.577655:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224387968 00000100:00100000:0.0:1789402429.577659:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224387968 00000100:00100000:0.0:1789402429.577679:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789402429.577686:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224387968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402429.578235:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224387968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 547us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402429.578244:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789402429.578287:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224387968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402429.578323:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224388096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402429.578393:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402429.578427:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e0a42300 going to sleep for 11 seconds 00000100:00100000:3.0:1789402429.578441:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224388096 00000100:00100000:3.0:1789402429.578447:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224388096 00000100:00100000:3.0:1789402429.578480:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789402429.578488:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224388096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789402429.578643:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224388096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402429.578657:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789402429.578701:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224388096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789402429.580420:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789402429.581411:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789402429.581445:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789402429.581461:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402429.581476:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402429.922683:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402430.111187:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402430.111367:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199185280 00000100:00100000:3.0:1789402430.111380:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199185280 00000100:00100000:3.0:1789402430.111463:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 239 00000100:00100000:3.0:1789402430.111476:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:5594:x1876324199185280:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402430.111498:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402430.111521:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47084 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402430.111557:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47084 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402430.111569:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47084 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402430.111580:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1506600, rc 0) 00000100:00100000:3.0:1789402430.111648:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199185280:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 Request processed in 175us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402430.111656:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 239 00000100:00100000:3.0:1789402430.117363:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402430.121401:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199185408 00000100:00100000:3.0:1789402430.121422:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199185408 00000100:00100000:3.0:1789402430.121509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 240 00000100:00100000:3.0:1789402430.121522:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199185408:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402430.122133:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199185408:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 Request processed in 611us (4797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402430.122154:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 240 00000100:00100000:2.0:1789402430.133903:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402430.134011:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199185536 00000100:00100000:0.0:1789402430.134022:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199185536 00000100:00100000:0.0:1789402430.134075:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 241 00000100:00100000:0.0:1789402430.134084:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199185536:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402430.134306:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199185536:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 Request processed in 222us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402430.134313:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 241 00000100:00100000:2.0:1789402430.144143:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402430.145473:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199185664 00000100:00100000:3.0:1789402430.145490:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199185664 00000100:00100000:3.0:1789402430.145565:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 242 00000100:00100000:3.0:1789402430.145577:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199185664:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402430.145602:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402430.145626:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4708b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402430.145663:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4708b expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402430.145676:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4708b expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402430.145688:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c1506000, rc 0) 00000100:00100000:3.0:1789402430.145792:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199185664:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 Request processed in 207us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402430.145799:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 242 00000100:00100000:3.0:1789402430.149948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402430.150104:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199185792 00000100:00100000:1.0:1789402430.150118:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199185792 00000100:00100000:1.0:1789402430.150185:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 243 00000100:00100000:1.0:1789402430.150198:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199185792:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402430.150660:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199185792:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 Request processed in 462us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402430.150669:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 243 00000100:00100000:1.0:1789402430.154836:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402430.154998:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199185920 00000100:00100000:2.0:1789402430.155017:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199185920 00000100:00100000:2.0:1789402430.155092:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 244 00000100:00100000:2.0:1789402430.155102:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199185920:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789402430.155642:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199185920:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 Request processed in 538us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402430.155662:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 244 00000100:00100000:2.0:1789402430.185104:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224388224:0@lo:400:kworker.0 00000100:00100000:0.0:1789402430.185110:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224388608:0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.187897:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224388480:0@lo:400:kworker.0 00000100:00100000:3.0:1789402430.189791:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402430.189831:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224388224 00000100:00100000:3.0:1789402430.189840:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224388224 00000100:00100000:3.0:1789402430.189881:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789402430.189890:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224388224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402430.190385:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402430.190389:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224388224:12345-0@lo:400:kworker.0 Request processed in 501us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402430.190404:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789402430.190439:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224388608 00000100:00100000:3.0:1789402430.190443:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224388608 00000100:00100000:0.0:1789402430.190446:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402430.190458:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224388736:0@lo:400:kworker.0 00000100:00100000:3.0:1789402430.190475:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789402430.190481:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224388608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402430.190489:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789402430.190592:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402430.190604:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224388736 00000100:00100000:2.0:1789402430.190608:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224388736 00000100:00100000:2.0:1789402430.190640:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789402430.190646:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224388736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.190745:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402430.190770:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789402430.190777:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224388352:0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.190798:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402430.190815:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224388864:0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.190833:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402430.190877:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224388480 00000100:00100000:1.0:1789402430.190880:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224388480 00000100:00100000:1.0:1789402430.190900:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224388352 00000100:00100000:1.0:1789402430.190902:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224388352 00000100:00100000:1.0:1789402430.190914:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789402430.190930:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224388480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.190966:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224388480:12345-0@lo:400:kworker.0 Request processed in 37us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402430.190972:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789402430.190986:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789402430.190993:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224388352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.191019:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224388352:12345-0@lo:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402430.191024:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789402430.191130:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224388352:0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.191141:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224388480:0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.191204:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224388864 00000100:00100000:1.0:1789402430.191208:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224388864 00000100:00100000:1.0:1789402430.191255:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789402430.191262:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.191298:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224388864:12345-0@lo:400:kworker.0 Request processed in 37us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402430.191304:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789402430.191328:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb814700 x1876324224388864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402430.191340:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224388864:0@lo:400:kworker.0 00000100:00100000:1.0:1789402430.191397:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224388224:0@lo:400:kworker.0 00000100:00100000:3.0:1789402430.197576:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224388608:12345-0@lo:400:kworker.0 Request processed in 7084us (7181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402430.197593:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789402430.198381:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224388736:12345-0@lo:400:kworker.0 Request processed in 7730us (7885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402430.198392:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1789402430.198421:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402430.198428:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402430.200742:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224388736:0@lo:400:kworker.0 00010000:00080000:1.0:1789402430.200766:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb815180 x1876324224388608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402430.200776:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224388608:0@lo:400:kworker.0 00000100:00100000:3.0:1789402430.695186:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402430.695210:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224388992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402430.695288:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402430.695377:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224388992 00000100:00100000:3.0:1789402430.695386:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224388992 00000100:00100000:3.0:1789402430.695431:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789402430.695441:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224388992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789402430.695480:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402430.695524:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224388992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402430.695530:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789402430.695572:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e32c0000 x1876324224388992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402430.695591:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224388992:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789402430.948068:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402431.204487:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224389120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789402431.204559:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402431.204734:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224389120 00000100:00100000:3.0:1789402431.204743:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224389120 00000100:00100000:3.0:1789402431.204796:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789402431.204806:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224389120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402431.204853:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402431.204910:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224389120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402431.204918:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789402431.205037:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e32c0000 x1876324224389120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402431.205129:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224389120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789402431.974096:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402432.035994:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402432.036036:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402432.036061:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402432.037484:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199186048 00000100:00100000:1.0:1789402432.037498:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199186048 00000100:00100000:1.0:1789402432.037579:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 246 00000100:00100000:1.0:1789402432.037590:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199186048:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402432.037673:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199186048:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 84us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402432.037693:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 246 00000100:00100000:1.0:1789402432.037737:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199186304 00000100:00100000:1.0:1789402432.037741:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199186304 00000100:00100000:1.0:1789402432.037783:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199186176 00000100:00100000:1.0:1789402432.037787:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199186176 00000100:00080000:2.0:1789402432.037801:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402432.037810:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 94 00000100:00100000:1.0:1789402432.037817:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199186304:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402432.037848:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199186304:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 31us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402432.037854:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 94 00000100:00100000:1.0:1789402432.037866:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 95 00000100:00100000:1.0:1789402432.037872:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199186176:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402432.037892:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199186176:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 21us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402432.037897:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 95 00000001:02000400:3.0:1789402432.842104:0:11372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789402432.998155:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402434.020747:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402435.043927:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402435.298657:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224389376:0@lo:400:kworker.0 00000100:00100000:0.0:1789402435.298767:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402435.298834:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224389888:0@lo:400:kworker.0 00000100:00100000:0.0:1789402435.298874:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402435.298913:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402435.298919:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224389504:0@lo:400:kworker.0 00000100:00100000:0.0:1789402435.298942:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402435.298978:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224389376 00000100:00100000:0.0:1789402435.298987:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224389376 00000100:00100000:0.0:1789402435.299041:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224389504 00000100:00100000:0.0:1789402435.299045:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224389504 00000100:00100000:0.0:1789402435.299080:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789402435.299090:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224389376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402435.299149:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224389376:12345-0@lo:400:kworker.0 Request processed in 59us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402435.299157:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789402435.299175:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789402435.299182:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224389504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402435.299210:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224389504:12345-0@lo:400:kworker.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402435.299240:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789402435.299263:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224389888 00000100:00100000:0.0:1789402435.299267:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224389888 00000100:00100000:0.0:1789402435.299296:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789402435.299303:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224389888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402435.299336:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224389888:12345-0@lo:400:kworker.0 Request processed in 34us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402435.299371:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789402435.299423:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224389504:0@lo:400:kworker.0 00000100:00100000:0.0:1789402435.299435:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224389376:0@lo:400:kworker.0 00010000:00080000:0.0:1789402435.299448:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb8d4e00 x1876324224389888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402435.299459:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224389888:0@lo:400:kworker.0 00000100:00100000:2.0:1789402435.299697:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224389248:0@lo:400:kworker.0 00000100:00100000:2.0:1789402435.299738:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402435.299766:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224389760:0@lo:400:kworker.0 00000100:00100000:2.0:1789402435.299787:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402435.299806:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789402435.299821:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224389632:0@lo:400:kworker.0 00000100:00100000:2.0:1789402435.299849:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789402435.299891:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402435.299897:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402435.299909:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224389248 00000100:00100000:2.0:1789402435.299913:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224389248 00000100:00100000:2.0:1789402435.299945:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789402435.299952:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224389248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402435.299989:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224389248:12345-0@lo:400:kworker.0 Request processed in 37us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402435.299996:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789402435.300023:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224389760 00000100:00100000:2.0:1789402435.300027:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224389760 00000100:00100000:2.0:1789402435.300053:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789402435.300059:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224389760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402435.300086:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224389760:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402435.300093:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789402435.300112:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224389632 00000100:00100000:2.0:1789402435.300116:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224389632 00000100:00100000:2.0:1789402435.300144:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789402435.300150:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224389632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402435.300179:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224389632:12345-0@lo:400:kworker.0 Request processed in 29us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402435.300185:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789402435.300207:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789402435.300209:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789402435.300227:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb814000 x1876324224389632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402435.300246:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224389632:0@lo:400:kworker.0 00000100:00100000:2.0:1789402435.300255:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224389248:0@lo:400:kworker.0 00000100:00100000:2.0:1789402435.300264:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224389760:0@lo:400:kworker.0 00000100:00100000:0.0:1789402435.811167:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402435.811205:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224390016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789402435.811305:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402435.811534:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224390016 00000100:00100000:3.0:1789402435.811546:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224390016 00000100:00100000:3.0:1789402435.811618:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789402435.811630:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224390016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789402435.811677:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402435.811751:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224390016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402435.811759:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789402435.811977:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e32c3100 x1876324224390016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402435.812002:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224390016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789402436.066888:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402436.322718:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224390144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402436.322853:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402436.322958:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224390144 00000100:00100000:2.0:1789402436.322968:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224390144 00000100:00100000:2.0:1789402436.324401:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789402436.324420:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224390144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402436.324477:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402436.324566:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224390144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402436.324574:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789402436.324634:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e32c2a00 x1876324224390144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402436.324659:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224390144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789402437.090524:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402437.157551:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402437.157602:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402437.157632:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402437.157661:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199186432 00000100:00100000:3.0:1789402437.157685:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199186432 00000100:00100000:0.0:1789402437.157711:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199186560 00000100:00100000:0.0:1789402437.157718:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199186560 00000100:00100000:3.0:1789402437.157745:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 248 00000100:00100000:3.0:1789402437.157759:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199186432:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402437.157772:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199186688 00000100:00100000:0.0:1789402437.157777:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199186688 00000100:00100000:0.0:1789402437.157805:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 99 00000100:00100000:0.0:1789402437.157814:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199186560:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402437.157841:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199186432:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402437.157850:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 248 00000100:00100000:0.0:1789402437.157857:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199186560:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 43us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402437.157867:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 99 00000100:00100000:0.0:1789402437.157893:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 100 00000100:00100000:0.0:1789402437.157900:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199186688:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402437.157931:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199186688:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402437.157936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 100 00000100:00080000:0.0:1789402437.158017:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789402437.266940:0:11473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:13:54 (1789402434) === 00000100:00100000:0.0:1789402437.644942:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402437.646470:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199186944 00000100:00100000:2.0:1789402437.646485:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199186944 00000100:00100000:2.0:1789402437.646566:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:2.0:1789402437.646576:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4785302d-2648-4148-8042-c10a24a5dd29+6:9687:x1876324199186944:12345-192.168.203.8@tcp:700:mkdir.0 00000100:00100000:2.0:1789402437.646681:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4785302d-2648-4148-8042-c10a24a5dd29+6:9687:x1876324199186944:12345-192.168.203.8@tcp:700:mkdir.0 Request processed in 106us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402437.646706:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:2.0:1789402437.649734:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402437.649854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199186816 00000100:00100000:0.0:1789402437.649868:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199186816 00000100:00100000:0.0:1789402437.649962:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:0.0:1789402437.649976:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199186816:12345-192.168.203.8@tcp:41:mkdir.0 00000004:00000024:0.0:1789402437.650050:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789402437.650168:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199186816:12345-192.168.203.8@tcp:41:mkdir.0 Request processed in 195us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402437.650178:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:3.0:1789402437.660192:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402437.660754:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199187200 00000100:00100000:0.0:1789402437.660769:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199187200 00000100:00100000:0.0:1789402437.660847:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:0.0:1789402437.660861:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:9687:x1876324199187200:12345-192.168.203.8@tcp:36:mkdir.0 00010000:00010000:0.0:1789402437.660940:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402437.660976:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82600/0x9403f4af875f7b5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4700d expref: 6 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.660999:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:0.0:1789402437.661012:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402437.661519:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.661546:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.661559:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.661574:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.661581:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.661587:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402437.662899:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789402437.662915:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.662924:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.662932:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.662939:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402437.662945:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.662953:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.662979:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3ec00) 00010000:00010000:0.0:1789402437.662982:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402437.662988:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.662995:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82800/0x9403f4af875f7c7b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402437.663016:0:6712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009851681a reply state 00000000162a874b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402437.663028:0:6712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789402437.663162:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:9687:x1876324199187200:12345-192.168.203.8@tcp:36:mkdir.0 Request processed in 2299us (2982us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789402437.663172:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 15 00010000:00010000:0.0:1789402437.668885:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.668909:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.668920:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.668927:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402437.668932:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.668942:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.668986:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c6c3a3eb00) 00010000:00010000:0.0:1789402437.668990:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402437.668996:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402437.669004:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7c82 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402437.696917:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402437.702407:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199187328 00000100:00100000:0.0:1789402437.702433:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199187328 00000100:00100000:1.0:1789402437.709197:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:1.0:1789402437.709219:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:9688:x1876324199187328:12345-192.168.203.8@tcp:101:chmod.0 00010000:00010000:1.0:1789402437.709252:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402437.709292:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f7c89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47092 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402437.709443:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f7c90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402437.709460:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f7c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402437.709474:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f7c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402437.709520:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789402437.709525:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402437.709568:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f7c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402437.709598:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f7c89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47092 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402437.709622:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f7c90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47092 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402437.709632:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:1.0:1789402437.709635:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789402437.709639:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83f400, rc 0) 00000100:00100000:1.0:1789402437.709736:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:9688:x1876324199187328:12345-192.168.203.8@tcp:101:chmod.0 Request processed in 522us (12836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402437.709754:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:1.0:1789402437.720757:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402437.720921:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199187584 00000100:00100000:2.0:1789402437.720937:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199187584 00000100:00100000:2.0:1789402437.721017:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:2.0:1789402437.721032:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:9688:x1876324199187584:12345-192.168.203.8@tcp:36:chmod.0 00010000:00010000:2.0:1789402437.721113:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402437.721163:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f7c90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47092 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.721190:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:2.0:1789402437.721215:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402437.721250:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.721267:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.721278:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402437.722051:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cafe04e8 reply state 0000000096177f80 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402437.722068:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789402437.722080:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789402437.722224:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+8:9688:x1876324199187584:12345-192.168.203.8@tcp:36:chmod.0 Request processed in 1193us (1483us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789402437.722234:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 17 00010000:00010000:3.0:1789402437.734496:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.734517:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.734526:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.734533:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dee00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402437.734539:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.734549:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.734574:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402437.734577:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789402437.734584:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.734591:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7c97 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402437.790275:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402437.790609:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199187712 00000100:00100000:2.0:1789402437.790624:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199187712 00000100:00100000:2.0:1789402437.790716:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:2.0:1789402437.790729:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:9689:x1876324199187712:12345-192.168.203.8@tcp:101:chown.0 00010000:00010000:2.0:1789402437.790763:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402437.790796:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7c9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47099 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.790881:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f7ca5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.790910:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f7ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.790925:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f7ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402437.790971:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789402437.790975:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402437.791023:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f7ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.791056:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7c9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47099 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.791078:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f7ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47099 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.791089:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8600) 00010000:00010000:2.0:1789402437.791091:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789402437.791105:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dfc00, rc 0) 00000100:00100000:2.0:1789402437.791194:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+8:9689:x1876324199187712:12345-192.168.203.8@tcp:101:chown.0 Request processed in 469us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402437.791201:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:2.0:1789402437.795750:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402437.796178:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199187840 00000100:00100000:3.0:1789402437.796209:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199187840 00000100:00100000:3.0:1789402437.796289:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:3.0:1789402437.796302:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+8:9689:x1876324199187840:12345-192.168.203.8@tcp:101:chown.0 00010000:00010000:3.0:1789402437.796382:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402437.796802:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506200/0x9403f4af875f7cac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470a0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.796901:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.796920:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.796934:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.796951:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.796958:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.796967:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797102:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f7cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797111:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f7cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797118:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f7cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402437.797226:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789402437.797237:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402437.797268:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f7cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797283:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797290:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797298:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797306:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1506400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402437.797310:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797319:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797332:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8600) 00010000:00010000:3.0:1789402437.797336:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402437.797375:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797384:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506400/0x9403f4af875f7cb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797767:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797777:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797795:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797801:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1507c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402437.797804:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797811:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797822:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c6d2ca6300) 00010000:00010000:3.0:1789402437.797825:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402437.797829:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797835:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1507c00/0x9403f4af875f7cba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797895:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c1506200/0x9403f4af875f7cac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470a0 expref: 10 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797913:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f7cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470a0 expref: 9 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.797920:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6d00) 00010000:00010000:3.0:1789402437.797922:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789402437.797925:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d800, rc 0) 00000100:00100000:0.0:1789402437.806053:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+9:9689:x1876324199187840:12345-192.168.203.8@tcp:101:chown.0 Request processed in 9737us (10302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402437.806070:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:0.0:1789402437.821430:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402437.821585:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199188096 00000100:00100000:2.0:1789402437.821598:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199188096 00000100:00100000:2.0:1789402437.821683:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:2.0:1789402437.821696:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:9689:x1876324199188096:12345-192.168.203.8@tcp:36:chown.0 00010000:00010000:2.0:1789402437.821767:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402437.821802:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f7cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470a0 expref: 9 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.821825:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6d00) 00010000:00010000:2.0:1789402437.821841:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402437.821874:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.821901:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.821914:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789402437.912289:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1789402437.912314:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1789402437.912539:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ac29c58 reply state 0000000016bd767e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402437.912556:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789402437.912576:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1789402437.912730:0:5844:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789402437.912776:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:9689:x1876324199188096:12345-192.168.203.8@tcp:36:chown.0 Request processed in 91075us (91354us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789402437.912787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 20 00010000:00010000:2.0:1789402437.912837:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.912848:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.912857:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.912865:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402437.912871:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.912880:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.912902:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402437.912906:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789402437.912913:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402437.912919:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7cc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402437.942307:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402437.942520:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199188224 00000100:00100000:2.0:1789402437.942532:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199188224 00000100:00100000:2.0:1789402437.942604:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:2.0:1789402437.942615:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:9690:x1876324199188224:12345-192.168.203.8@tcp:101:touch.500 00010000:00010000:2.0:1789402437.942676:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402437.942707:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7ccf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470a7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789402437.944011:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1235us 00010000:00010000:3.0:1789402437.974467:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.974508:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.974525:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.974545:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.974554:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.974561:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975068:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f7ce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975080:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f7ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975089:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f7ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402437.975116:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789402437.975120:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402437.975167:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f7ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975180:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975269:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975278:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975285:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402437.975292:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975301:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975317:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8600) 00010000:00010000:3.0:1789402437.975320:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402437.975326:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975333:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7cd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975377:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975385:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975392:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975398:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402437.975408:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975416:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975426:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c6d2ca6500) 00010000:00010000:3.0:1789402437.975429:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402437.975432:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975439:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7cdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975491:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7ccf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470a7 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975510:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f7ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470a7 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.975518:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6300) 00010000:00010000:3.0:1789402437.975521:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789402437.975523:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90ce00, rc 0) 00000100:00100000:3.0:1789402437.975797:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:9690:x1876324199188224:12345-192.168.203.8@tcp:101:touch.500 Request processed in 33181us (33502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402437.975859:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:1.0:1789402437.996711:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402437.996800:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199188480 00000100:00100000:3.0:1789402437.996815:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199188480 00000100:00100000:3.0:1789402437.996887:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:3.0:1789402437.996900:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:9690:x1876324199188480:12345-192.168.203.8@tcp:101:touch.500 00010000:00010000:3.0:1789402437.996959:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402437.996987:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f7ceb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470ae expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.997374:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.997396:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402437.997410:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402437.997653:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402437.997674:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402437.997684:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789402437.998793:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789402438.000531:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7d00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.000558:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.000573:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789402438.000581:0:5845:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190210 00000004:00020000:1.0:1789402438.008443:0:5845:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190210 00010000:00010000:1.0:1789402438.014490:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.014513:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.014523:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.014530:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402438.014535:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.014561:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.014580:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6300) 00010000:00010000:1.0:1789402438.014583:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402438.014589:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.014596:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f7cf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789402438.014618:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d715b38 reply state 0000000064aa1511 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402438.014627:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789402438.014700:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f7ceb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470ae expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.014719:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470ae expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.014727:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:1.0:1789402438.014729:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402438.014731:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83ec00, rc 0) 00000100:00100000:1.0:1789402438.014832:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+10:9690:x1876324199188480:12345-192.168.203.8@tcp:101:touch.500 Request processed in 17934us (18136us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789402438.014842:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 22 00010000:00010000:3.0:1789402438.021905:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.021924:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.021933:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.021939:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402438.021944:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.021952:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.021969:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff93c6d8cd8000) 00010000:00010000:3.0:1789402438.021973:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402438.021990:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.021997:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f7cf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402438.046636:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402438.047402:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199188736 00000100:00100000:0.0:1789402438.047418:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199188736 00000100:00100000:0.0:1789402438.047496:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:0.0:1789402438.047508:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+9:9690:x1876324199188736:12345-192.168.203.8@tcp:36:touch.500 00010000:00010000:0.0:1789402438.047595:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402438.047632:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7d00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470ae expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402438.047657:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:0.0:1789402438.047684:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402438.047762:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402438.047778:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402438.047788:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402438.047963:0:6712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b8dbc59 reply state 000000004971e930 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402438.047986:0:6712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789402438.048412:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+10:9690:x1876324199188736:12345-192.168.203.8@tcp:36:touch.500 Request processed in 903us (1787us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789402438.048420:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:0.0:1789402438.052826:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00010000:00010000:1.0:1789402438.053340:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.053406:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.053415:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.053423:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402438.053429:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.053437:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.053458:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c6c3a3eb00) 00010000:00010000:1.0:1789402438.053462:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402438.053468:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.053475:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7d0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402438.053643:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199188864 00000100:00100000:3.0:1789402438.053657:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199188864 00000100:00100000:3.0:1789402438.053738:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 24 00000100:00100000:3.0:1789402438.053752:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:9690:x1876324199188864:12345-192.168.203.8@tcp:101:touch.500 00010000:00010000:3.0:1789402438.053784:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402438.053808:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7d15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470b5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.053877:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7d15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470b5 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.053892:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7d15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470b5 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.053913:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c6d2ca6500) 00010000:00010000:3.0:1789402438.053916:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402438.053919:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d400, rc 0) 00000100:00100000:3.0:1789402438.054084:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+10:9690:x1876324199188864:12345-192.168.203.8@tcp:101:touch.500 Request processed in 334us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402438.054092:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 24 00000100:00100000:3.0:1789402438.059226:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402438.059325:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199188992 00000100:00100000:0.0:1789402438.059340:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199188992 00000100:00100000:0.0:1789402438.059442:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:0.0:1789402438.059454:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876324199188992:12345-192.168.203.8@tcp:8:touch.500 00010000:00080000:0.0:1789402438.059498:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:0.0:1789402438.059544:0:6690:0:(genops.c:1384:class_connect()) connect: client 4785302d-2648-4148-8042-c10a24a5dd29, cookie 0x9403f4af875f7d1c 00002000:00100000:0.0:1789402438.059561:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4785302d-2648-4148-8042-c10a24a5dd29/ffff93c6ff70e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789402438.059594:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789402438.059916:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789402438.059955:0:6690:0:(import.c:65:import_set_state_nolock()) ffff93c6ff70a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789402438.060040:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2350:x1876324199188992:12345-192.168.203.8@tcp:8:touch.500 Request processed in 586us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402438.060069:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:0.0:1789402438.063312:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402438.063602:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199189120 00000100:00100000:3.0:1789402438.063616:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199189120 00000100:00100000:3.0:1789402438.063740:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:3.0:1789402438.063754:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:0:x1876324199189120:12345-192.168.203.8@tcp:2:touch.500 00000100:00080000:0.0:1789402438.065040:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789402438.114710:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789402438.121463:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000001:00080000:2.0:1789402438.121490:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1789402438.121934:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+5:0:x1876324199189120:12345-192.168.203.8@tcp:2:touch.500 Request processed in 58175us (58627us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789402438.121947:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:0.0:1789402438.124956:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402438.125484:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199189376 00000100:00100000:1.0:1789402438.125610:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199189376 00000100:00100000:2.0:1789402438.125770:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:2.0:1789402438.125783:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+10:9690:x1876324199189376:12345-192.168.203.8@tcp:35:touch.500 00000100:00100000:2.0:1789402438.126403:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+11:9690:x1876324199189376:12345-192.168.203.8@tcp:35:touch.500 Request processed in 618us (1454us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789402438.126412:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:3.0:1789402438.135790:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402438.135924:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199189504 00000100:00100000:2.0:1789402438.135938:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199189504 00000100:00100000:2.0:1789402438.136020:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00100000:2.0:1789402438.136035:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+11:9691:x1876324199189504:12345-192.168.203.8@tcp:101:rm.0 00010000:00010000:2.0:1789402438.136069:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402438.136099:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f7d23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.136734:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f7d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.136754:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f7d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.136769:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f7d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402438.136835:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789402438.136840:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402438.136886:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f7d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.136919:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f7d23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470bc expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.136940:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f7d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470bc expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.136949:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6300) 00010000:00010000:2.0:1789402438.136952:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789402438.136957:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dec00, rc 0) 00000100:00100000:2.0:1789402438.137878:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+12:9691:x1876324199189504:12345-192.168.203.8@tcp:101:rm.0 Request processed in 1838us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402438.137891:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00100000:0.0:1789402438.155641:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402438.155842:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199189760 00000100:00100000:3.0:1789402438.155856:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199189760 00000100:00100000:3.0:1789402438.155939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 26 00000100:00100000:3.0:1789402438.155952:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+12:9691:x1876324199189760:12345-192.168.203.8@tcp:101:rm.0 00010000:00010000:3.0:1789402438.155979:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402438.156018:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7d31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470c3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402438.156145:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789402438.156440:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7d31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470c3 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.156458:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8600) 00010000:00010000:3.0:1789402438.156461:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789402438.156467:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7d31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470c3 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.156484:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c000, rc 0) 00000100:00100000:3.0:1789402438.156746:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+13:9691:x1876324199189760:12345-192.168.203.8@tcp:101:rm.0 Request processed in 796us (1119us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789402438.156756:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 26 00000100:00100000:0.0:1789402438.166892:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402438.167070:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199189888 00000100:00100000:3.0:1789402438.167084:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199189888 00000100:00100000:3.0:1789402438.167152:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:3.0:1789402438.167182:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+13:9691:x1876324199189888:12345-192.168.203.8@tcp:37:rm.0 00000100:00100000:2.0:1789402438.179436:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+13:9691:x1876324199189888:12345-192.168.203.8@tcp:37:rm.0 Request processed in 12239us (12543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402438.179454:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:0.0:1789402438.188546:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402438.188702:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199190144 00000100:00100000:2.0:1789402438.188716:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199190144 00000100:00100000:2.0:1789402438.188793:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:2.0:1789402438.188806:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+13:9691:x1876324199190144:12345-192.168.203.8@tcp:35:rm.0 00000100:00100000:2.0:1789402438.189319:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+14:9691:x1876324199190144:12345-192.168.203.8@tcp:35:rm.0 Request processed in 512us (785us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789402438.189449:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:1.0:1789402438.199578:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402438.203440:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199190400 00000100:00100000:0.0:1789402438.203461:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199190400 00000100:00100000:2.0:1789402438.204267:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00100000:2.0:1789402438.204283:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+14:9691:x1876324199190400:12345-192.168.203.8@tcp:101:rm.0 00010000:00010000:2.0:1789402438.204318:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402438.205109:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f7d3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470ca expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.205307:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7d46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.205326:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.205407:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402438.205424:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789402438.205703:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f7d3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470ca expref: 17 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.205726:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7d46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470ca expref: 16 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.205735:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6300) 00010000:00010000:2.0:1789402438.205738:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789402438.205743:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de400, rc 0) 00000100:00100000:2.0:1789402438.206178:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+16:9691:x1876324199190400:12345-192.168.203.8@tcp:101:rm.0 Request processed in 1894us (6852us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789402438.206211:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00100000:0.0:1789402438.231103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402438.231274:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199190528 00000100:00100000:3.0:1789402438.231288:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199190528 00000100:00100000:3.0:1789402438.231518:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:3.0:1789402438.231531:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+16:9691:x1876324199190528:12345-192.168.203.8@tcp:41:rm.0 00000004:00000024:3.0:1789402438.231613:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1789402438.231719:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+16:9691:x1876324199190528:12345-192.168.203.8@tcp:41:rm.0 Request processed in 190us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402438.231728:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:2.0:1789402438.234948:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402438.235114:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199190656 00000100:00100000:3.0:1789402438.235126:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199190656 00000100:00100000:3.0:1789402438.235284:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 29 00000100:00100000:3.0:1789402438.235298:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+16:9691:x1876324199190656:12345-192.168.203.8@tcp:101:rm.0 00010000:00010000:3.0:1789402438.235326:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402438.235386:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7d54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470d1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235476:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235502:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235517:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235536:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235568:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235575:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235714:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f7d69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235724:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f7d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235730:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f7d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402438.235765:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789402438.235770:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402438.235792:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f7d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235805:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f7d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235813:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235820:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235828:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235844:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402438.235849:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235858:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235872:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6300) 00010000:00010000:3.0:1789402438.235875:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402438.235882:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235889:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235903:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235909:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235916:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235921:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402438.235923:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235929:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235945:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff93c6d2ca6400) 00010000:00010000:3.0:1789402438.235948:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402438.235950:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.235956:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7d62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.236334:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7d54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470d1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.236413:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f7d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470d1 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.236421:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c6d2ca6500) 00010000:00010000:3.0:1789402438.236424:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402438.236426:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90ca00, rc 0) 00000100:00100000:3.0:1789402438.236626:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+17:9691:x1876324199190656:12345-192.168.203.8@tcp:101:rm.0 Request processed in 1329us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402438.236635:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 29 00000100:00100000:0.0:1789402438.240339:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402438.240919:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199190912 00000100:00100000:1.0:1789402438.240933:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199190912 00000100:00100000:1.0:1789402438.241111:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 30 00000100:00100000:1.0:1789402438.241126:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+17:9691:x1876324199190912:12345-192.168.203.8@tcp:36:rm.0 00010000:00010000:1.0:1789402438.241209:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789402438.241261:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f7d69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470d1 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241287:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f7d15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470b5 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241301:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c6d2ca6500) 00010000:00010000:1.0:1789402438.241321:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f7d2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470bc expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241331:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6300) 00010000:00010000:1.0:1789402438.241334:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402438.241502:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241519:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241531:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241550:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241557:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241564:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241763:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241778:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.241786:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789402438.244445:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789402438.244464:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343393119791ns, next at 344393115766ns, rc = 0 00010000:00010000:1.0:1789402438.244559:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244579:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244593:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244602:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244610:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244617:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244648:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402438.244688:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244695:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244711:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244717:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83f200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402438.244722:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244730:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244745:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:1.0:1789402438.244749:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789402438.244755:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244762:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f200/0x9403f4af875f7d7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244784:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244790:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244796:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244801:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402438.244803:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244818:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244827:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6300) 00010000:00010000:1.0:1789402438.244829:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402438.244833:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402438.244838:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7d70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789402438.244850:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001464edef reply state 000000003fa66359 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402438.244860:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789402438.245436:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402438.245447:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.245455:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402438.245458:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.245466:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.245477:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:2.0:1789402438.245480:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789402438.245483:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.245489:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7d85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.245521:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402438.245523:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402438.245525:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402438.246284:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+16:9691:x1876324199190912:12345-192.168.203.8@tcp:36:rm.0 Request processed in 5152us (5949us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789402438.246296:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 30 00000100:00100000:1.0:1789402438.255787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402438.256290:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199191168 00000100:00100000:0.0:1789402438.256305:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199191168 00000100:00100000:0.0:1789402438.256405:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:0.0:1789402438.256418:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+16:9691:x1876324199191168:12345-192.168.203.8@tcp:35:rm.0 00000100:00100000:0.0:1789402438.256738:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+17:9691:x1876324199191168:12345-192.168.203.8@tcp:35:rm.0 Request processed in 321us (966us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789402438.256747:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 5 00010000:00010000:3.0:1789402438.259551:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.259573:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.259583:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.259615:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402438.259621:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.259630:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.259651:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402438.259654:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402438.261705:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.261734:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fe00/0x9403f4af875f7d77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402438.262738:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402438.262832:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199191424 00000100:00100000:2.0:1789402438.262845:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199191424 00000100:00100000:2.0:1789402438.262915:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 31 00000100:00100000:2.0:1789402438.262928:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+16:9691:x1876324199191424:12345-192.168.203.8@tcp:36:rm.0 00010000:00010000:2.0:1789402438.263022:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789402438.263074:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f7d46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470ca expref: 16 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263099:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f7ce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470a7 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263110:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6d2ca6300) 00010000:00010000:2.0:1789402438.263130:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f7ca5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47099 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263139:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8600) 00010000:00010000:2.0:1789402438.263147:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402438.263176:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263199:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263212:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263227:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263235:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263242:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263601:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263618:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.263626:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402438.264304:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789402438.264325:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264334:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264390:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264399:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402438.264404:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264413:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264425:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402438.264428:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789402438.264433:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264440:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7d9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264463:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264476:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264482:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264487:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402438.264490:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264496:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264505:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402438.264507:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402438.264511:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402438.264517:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f7d8c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402438.264530:0:6712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009eeb1ad0 reply state 00000000d2b470d3 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402438.264539:0:6712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789402438.264659:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+15:9691:x1876324199191424:12345-192.168.203.8@tcp:36:rm.0 Request processed in 1730us (1927us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789402438.264680:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 31 00010000:00010000:3.0:1789402438.278101:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.278122:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.278132:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.278138:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dee00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402438.278144:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.278153:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.278207:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c6c30f8900) 00010000:00010000:3.0:1789402438.278211:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402438.278217:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402438.278224:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f7d93 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402439.139083:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402440.162508:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402440.419260:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224390656:0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.419330:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402440.419408:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789402440.419415:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224390272:0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.419453:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402440.419489:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224390784:0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.419516:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402440.419544:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224390400:0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.419566:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402440.419582:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224390912:0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.419609:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402440.419626:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402440.419632:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224390528:0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.419659:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402440.419691:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224390656 00000100:00100000:0.0:1789402440.419698:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224390656 00000100:00100000:0.0:1789402440.419746:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224390912 00000100:00100000:0.0:1789402440.419750:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224390912 00000100:00100000:0.0:1789402440.419769:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789402440.419777:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224390656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.419819:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224390656:12345-0@lo:400:kworker.0 Request processed in 43us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402440.419826:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789402440.419840:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789402440.419845:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224390912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.419868:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224390912:12345-0@lo:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402440.419873:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789402440.419887:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224390272 00000100:00100000:0.0:1789402440.419890:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224390272 00000100:00100000:0.0:1789402440.419909:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789402440.419914:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224390272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.419944:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224390272:12345-0@lo:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402440.419950:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789402440.419970:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224390784 00000100:00080000:1.0:1789402440.420468:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789402440.420473:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402440.420485:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224390400 00000100:00100000:1.0:1789402440.420490:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224390400 00000100:00100000:1.0:1789402440.420527:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224390528 00000100:00100000:1.0:1789402440.420530:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224390528 00000100:00100000:1.0:1789402440.420550:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789402440.420557:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224390400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402440.420622:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224390400:12345-0@lo:400:kworker.0 Request processed in 66us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402440.420628:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789402440.420641:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789402440.420656:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224390528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402440.420683:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224390528:12345-0@lo:400:kworker.0 Request processed in 36us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402440.420688:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789402440.420709:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402440.420743:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224390272:0@lo:400:kworker.0 00010000:00080000:1.0:1789402440.420759:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb8d7800 x1876324224390656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402440.420770:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224390656:0@lo:400:kworker.0 00000100:00100000:1.0:1789402440.420810:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224390528:0@lo:400:kworker.0 00000100:00100000:1.0:1789402440.420820:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224390400:0@lo:400:kworker.0 00010000:00080000:1.0:1789402440.420829:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb8d5f80 x1876324224390912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402440.420837:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224390912:0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.422194:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224390784 00000100:00100000:0.0:1789402440.422357:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789402440.422369:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224390784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402440.422453:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224390784:12345-0@lo:400:kworker.0 Request processed in 87us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402440.422461:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1789402440.422527:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402440.422583:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224390784:0@lo:400:kworker.0 00000004:00080000:1.0:1789402440.930955:0:8022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346079608101ns, next at 347079605598ns, rc = 0 00000100:00100000:1.0:1789402440.931003:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224391040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789402440.931081:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402440.931168:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224391040 00000100:00100000:1.0:1789402440.931176:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224391040 00000100:00100000:1.0:1789402440.931230:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789402440.931240:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224391040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402440.931273:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402440.931315:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224391040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402440.931322:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789402440.931386:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6ffacb480 x1876324224391040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402440.931404:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224391040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402441.187040:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402441.443094:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789402441.443131:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224391168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402441.443209:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402441.443458:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224391168 00000100:00100000:3.0:1789402441.443467:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224391168 00000100:00100000:3.0:1789402441.443517:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789402441.443527:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224391168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402441.443563:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402441.443615:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224391168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402441.443622:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789402441.443731:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e32c2300 x1876324224391168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402441.443748:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224391168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789402442.210885:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402442.276046:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402442.276119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402442.276158:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402442.276180:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402442.276222:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199191808 00000100:00100000:3.0:1789402442.276232:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199191808 00000100:00100000:0.0:1789402442.276265:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199191680 00000100:00100000:0.0:1789402442.276278:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199191680 00000100:00100000:3.0:1789402442.276318:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 59 00000100:00100000:3.0:1789402442.276331:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199191808:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402442.276449:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199191808:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 122us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402442.276458:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 59 00000100:00080000:3.0:1789402442.276502:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789402442.276507:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789402442.276718:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199191936 00000100:00100000:2.0:1789402442.276725:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199191936 00000100:00100000:2.0:1789402442.276807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 104 00000100:00100000:2.0:1789402442.276819:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199191680:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402442.276913:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 105 00000100:00100000:3.0:1789402442.276995:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199191936:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402442.277536:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199191936:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 538us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402442.277537:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199191680:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 710us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402442.277561:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 105 00000100:00100000:2.0:1789402442.277575:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 104 00000100:00100000:3.0:1789402442.277610:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199191552 00000100:00100000:3.0:1789402442.277621:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199191552 00000100:00100000:3.0:1789402442.277679:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 250 00000100:00100000:3.0:1789402442.277690:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199191552:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402442.277730:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199191552:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 41us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402442.277739:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 250 00000100:00080000:2.0:1789402442.277767:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789402442.430141:0:11621:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1789402443.017223:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1789402443.017245:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1789402443.017257:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789402443.017264:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1789402443.017415:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402443.017434:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224391296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789402443.017503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402443.017712:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224391296 00000100:00100000:0.0:1789402443.017719:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224391296 00000100:00100000:0.0:1789402443.017775:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789402443.017785:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224391296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789402443.017813:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789402443.017848:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa81d45, atime: 0x6aa81d45, ctime: 0x6aa81d45, blocks: 0x1 00010000:00010000:0.0:1789402443.017856:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.017885:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789402443.017890:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402443.017897:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.017915:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.017926:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.017934:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.017953:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789402443.018489:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876324224391296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 703us (983us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789402443.018497:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789402443.018613:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789402443.019755:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402443.019766:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.019778:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402443.019784:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.019809:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.019828:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.019836:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f7da1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.019854:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402443.019856:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402443.019858:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789402443.019899:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6ef3cb800/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789402443.019908:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224391296:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789402443.234672:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789402443.604551:0:11673:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5a34c050 20000000:00000080:0.0:1789402443.604568:0:11673:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c6f7f3e400 uarg=0000000000000000 00000001:00080000:2.0:1789402443.605734:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 20000000:01000000:0.0:1789402443.606057:0:11673:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789402443.606064:0:11673:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789402443.606070:0:11673:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789402443.607108:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789402443.607500:0:11673:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789402443.614041:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789402443.614096:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789402443.614162:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789402443.614179:0:11673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789402443.614198:0:11673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614221:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7c43 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614229:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7c51 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614236:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7c5f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614246:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47084 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614264:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4708b expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614272:0:11673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614311:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4708b expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614327:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4708b expref: 12 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402443.614370:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391424:192.168.203.8@tcp:104: 00010000:00010000:0.0:1789402443.614468:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47084 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614476:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47084 expref: 12 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402443.614491:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391552:192.168.203.8@tcp:104: 00010000:00010000:0.0:1789402443.614522:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7c5f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614763:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7c5f expref: 18 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402443.614776:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391680:0@lo:104: 00000100:00100000:0.0:1789402443.614814:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789402443.614844:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7c51 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614852:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7c51 expref: 18 pid: 5836 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402443.614860:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391808:0@lo:104: 00000100:00100000:0.0:1789402443.614881:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789402443.614942:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f7c43 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.614951:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f7c43 expref: 18 pid: 5839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402443.614959:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391936:0@lo:104: 00000100:00100000:0.0:1789402443.614981:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402443.618464:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c70007a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789402443.623737:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789402443.623764:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224391680 00000100:00100000:3.0:1789402443.623773:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224391680 00000100:00100000:3.0:1789402443.623813:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224391808 00000100:00100000:3.0:1789402443.623816:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224391808 00000100:00100000:3.0:1789402443.623827:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224391936 00000100:00100000:3.0:1789402443.623832:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224391936 00000100:00100000:3.0:1789402443.623847:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789402443.623856:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+5:11673:x1876324224391680:12345-0@lo:104: 00010000:00010000:3.0:1789402443.623873:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.623954:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789402443.623960:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+5:11673:x1876324224391680:12345-0@lo:104: Request processed in 106us (9147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402443.623979:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789402443.623999:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789402443.624005:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+4:11673:x1876324224391808:12345-0@lo:104: 00010000:00010000:3.0:1789402443.624013:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.624046:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789402443.624051:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+4:11673:x1876324224391808:12345-0@lo:104: Request processed in 47us (9170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402443.624057:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789402443.624069:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789402443.624076:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7004db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:11673:x1876324224391936:12345-0@lo:104: 00010000:00010000:3.0:1789402443.624084:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.624110:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789402443.624115:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7004db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+3:11673:x1876324224391936:12345-0@lo:104: Request processed in 41us (9134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402443.624120:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789402443.624400:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391680:0@lo:104: 00000100:00100000:1.0:1789402443.624410:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391808:0@lo:104: 00000100:00100000:1.0:1789402443.624417:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391936:0@lo:104: 00010000:00010000:0.0:1789402443.624925:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789402443.624934:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.624951:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1507200 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402443.624955:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.624965:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402443.624973:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402443.624980:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789402443.625016:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625022:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402443.625044:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625051:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1507200/0x9403f4af875f7c5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c66 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625063:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789402443.625067:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625073:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e200 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402443.625076:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625093:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402443.625100:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402443.625105:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789402443.625119:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625124:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402443.625131:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625138:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e200/0x9403f4af875f7c51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625148:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402443.625151:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625156:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82a00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402443.625159:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625165:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402443.625171:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402443.625181:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789402443.625194:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625199:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402443.625227:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625234:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7c43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f7c4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625247:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402443.625248:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402443.625250:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402443.625265:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402443.625285:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224392064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402443.625324:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402443.625398:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402443.625405:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224392192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402443.625426:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402443.625454:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224392320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402443.625477:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402443.625505:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224392064 00000100:00100000:0.0:1789402443.625512:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224392064 00010000:00010000:0.0:1789402443.625548:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7c5f expref: 19 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402443.625571:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224392192 00000100:00100000:0.0:1789402443.625580:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224392192 00010000:00010000:0.0:1789402443.625592:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7c51 expref: 20 pid: 5836 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402443.625603:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224392320 00000100:00100000:0.0:1789402443.625605:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224392320 00010000:00010000:0.0:1789402443.625614:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7c43 expref: 21 pid: 5839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402443.625638:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789402443.625645:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+21:3315:x1876324224392064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789402443.625657:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402443.625663:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7c5f expref: 21 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625674:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7c5f expref: 21 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625688:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83800/0x9403f4af875f7c66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7c5f expref: 21 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625700:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402443.625731:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+20:3315:x1876324224392064:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402443.625738:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789402443.625754:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789402443.625759:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224392192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789402443.625766:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402443.625770:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7c51 expref: 19 pid: 5836 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625789:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7c51 expref: 19 pid: 5836 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625799:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f7c58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7c51 expref: 19 pid: 5836 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625809:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402443.625830:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:3315:x1876324224392192:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402443.625837:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789402443.625849:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789402443.625855:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:3313:x1876324224392320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789402443.625861:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402443.625865:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f7c43 expref: 17 pid: 5839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625873:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f7c43 expref: 17 pid: 5839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625883:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83f800/0x9403f4af875f7c4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f7c43 expref: 17 pid: 5839 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.625891:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402443.625916:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3313:x1876324224392320:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402443.625922:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789402443.625976:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224392320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402443.625996:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224392192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402443.626012:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224392064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789402443.626291:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391424:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402443.626301:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876324224391552:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402443.626325:0:11673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402443.626893:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402443.626950:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199192064 00000100:00100000:0.0:1789402443.626957:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199192064 00010000:00010000:0.0:1789402443.626978:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4708b expref: 13 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402443.627004:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:0.0:1789402443.627012:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2352:x1876324199192064:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402443.627028:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402443.627032:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4708b expref: 13 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.627042:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4708b expref: 13 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.627057:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506000/0x9403f4af875f7c74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4708b expref: 13 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402443.627070:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402443.627122:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:2352:x1876324199192064:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 108us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402443.627130:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:0.0:1789402443.629137:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402443.631936:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199192192 00000100:00100000:3.0:1789402443.631950:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199192192 00010000:00010000:3.0:1789402443.631997:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47084 expref: 12 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402443.632037:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 34 00000100:00100000:3.0:1789402443.632047:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:2352:x1876324199192192:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402443.632062:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402443.632082:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47084 expref: 12 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632095:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47084 expref: 12 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632114:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506600/0x9403f4af875f7c6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47084 expref: 12 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632132:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632140:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632157:0:8454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632164:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632171:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632178:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632185:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402443.632189:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632197:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632227:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402443.632239:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402443.632297:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:2352:x1876324199192192:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 251us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402443.632305:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 34 00010000:00010000:2.0:1789402443.632528:0:11673:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402443.632538:0:11673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402443.632544:0:11673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f7da8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.259374:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789402444.770465:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789402444.770474:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6ff7f4000 from 7 10000000:01000000:0.0:1789402444.770478:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789402444.770530:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.770557:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.770570:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402444.770595:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224392448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789402444.770671:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402444.770723:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c70007a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402444.770804:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224392448 00000100:00100000:1.0:1789402444.770812:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224392448 00000100:00100000:1.0:1789402444.770866:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789402444.770882:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:5841:x1876324224392448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789402444.770899:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402444.770912:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83f200/0x9403f4af875f7db6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7daf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402444.770935:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83f200/0x9403f4af875f7db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7daf expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402444.770946:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83f200/0x9403f4af875f7db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7daf expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402444.770955:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83f200, rc 0) 00000100:00100000:1.0:1789402444.771026:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224392448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402444.771034:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789402444.771394:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224392448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402444.771409:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.771439:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402444.771496:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224392576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402444.771527:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402444.771559:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789402444.771893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224392576 00000100:00100000:3.0:1789402444.771900:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224392576 00000100:00100000:3.0:1789402444.771940:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789402444.771948:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224392576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402444.772200:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224392576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402444.772208:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789402444.772284:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224392576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402444.772314:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224392704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789402444.772370:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402444.772397:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402444.772690:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224392704 00000100:00100000:0.0:1789402444.772695:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224392704 00000100:00100000:0.0:1789402444.772730:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789402444.772738:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224392704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402444.772896:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224392704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402444.772902:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789402444.773006:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224392704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402444.773966:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11686:1876324224392832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402444.774135:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402444.774174:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb8d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789402444.776136:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224392832 00000100:00100000:3.0:1789402444.776160:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224392832 00000100:00100000:3.0:1789402444.776228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789402444.776239:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:11686:x1876324224392832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402444.776541:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+17:11686:x1876324224392832:12345-0@lo:502:llog_process_th.0 Request processed in 304us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402444.776550:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789402444.776939:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11686:1876324224392832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789402444.776976:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789402444.776986:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402444.776988:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789402444.777007:0:11686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c6ff7f4000 00000020:00000080:1.0:1789402444.777011:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789402444.777101:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11686:1876324224392960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402444.777145:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402444.777187:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb8d2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789402444.778696:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224392960 00000100:00100000:2.0:1789402444.778708:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224392960 00000100:00100000:2.0:1789402444.778762:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789402444.778771:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c7f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:11686:x1876324224392960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789402444.780167:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c7f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:11686:x1876324224392960:12345-0@lo:502:llog_process_th.0 Request processed in 1389us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402444.780180:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789402444.780717:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11686:1876324224392960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789402444.780753:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789402444.780761:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402444.780763:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789402444.780768:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789402444.783813:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789402444.783856:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789402444.783869:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.783882:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402444.783910:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789402444.783913:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6e61ce000 from 7 10000000:01000000:2.0:1789402444.783916:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789402444.783953:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.783961:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.783984:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402444.784313:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789402444.784397:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402444.784434:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402444.784503:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224393088 00000100:00100000:1.0:1789402444.784511:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224393088 00000100:00100000:1.0:1789402444.784560:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789402444.784569:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:5841:x1876324224393088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789402444.784583:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402444.784604:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7dc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7dbd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402444.784636:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7dbd expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402444.784648:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7dbd expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402444.784656:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83fe00, rc 0) 00000100:00100000:1.0:1789402444.784705:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224393088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402444.784712:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789402444.784802:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402444.784818:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.784827:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402444.784878:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402444.784905:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402444.784937:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c70007a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789402444.787130:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224393216 00000100:00100000:1.0:1789402444.787144:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224393216 00000100:00100000:1.0:1789402444.787201:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789402444.787211:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224393216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402444.787524:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224393216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402444.787538:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789402444.787780:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402444.787832:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402444.787875:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402444.787902:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c70007a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789402444.788087:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224393344 00000100:00100000:1.0:1789402444.788092:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224393344 00000100:00100000:1.0:1789402444.788132:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789402444.788139:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224393344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402444.788287:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224393344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402444.788294:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789402444.789745:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402444.794251:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11688:1876324224393472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402444.794333:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402444.794395:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c70007ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789402444.794459:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224393472 00000100:00100000:2.0:1789402444.794467:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224393472 00000100:00100000:2.0:1789402444.794517:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789402444.794526:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:11688:x1876324224393472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789402444.794760:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+18:11688:x1876324224393472:12345-0@lo:502:llog_process_th.0 Request processed in 235us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402444.794768:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789402444.795033:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11688:1876324224393472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789402444.795061:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402444.795070:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402444.795072:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789402444.795080:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c6e61ce000 00000020:00000080:0.0:1789402444.795082:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789402444.795158:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11688:1876324224393600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402444.795194:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402444.795214:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c70007ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789402444.795850:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224393600 00000100:00100000:2.0:1789402444.795858:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224393600 00000100:00100000:2.0:1789402444.795902:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789402444.795912:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:11688:x1876324224393600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789402444.796159:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:11688:x1876324224393600:12345-0@lo:502:llog_process_th.0 Request processed in 248us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402444.796173:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789402444.796834:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11688:1876324224393600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789402444.796865:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402444.796871:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402444.796873:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789402444.796878:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789402444.797415:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789402444.797434:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789402444.797444:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.797455:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402444.797464:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789402444.797467:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6e31a1800 from 7 10000000:01000000:2.0:1789402444.797470:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789402444.797497:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.797505:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.797515:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402444.797534:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789402444.797579:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402444.797674:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789402444.797746:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224393728 00000100:00100000:0.0:1789402444.797753:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224393728 00000100:00100000:0.0:1789402444.797785:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789402444.797793:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:5841:x1876324224393728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402444.797811:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402444.797823:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a82800/0x9403f4af875f7dd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f7dcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.797845:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a82800/0x9403f4af875f7dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f7dcb expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.797855:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a82800/0x9403f4af875f7dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f7dcb expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.797863:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82800, rc 0) 00000100:00100000:0.0:1789402444.797909:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224393728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402444.797915:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789402444.797984:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789402444.798008:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402444.798018:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402444.798068:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402444.798096:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402444.798116:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb8d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789402444.798212:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224393856 00000100:00100000:0.0:1789402444.798216:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224393856 00000100:00100000:0.0:1789402444.798246:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789402444.798251:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224393856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402444.799247:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224393856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 992us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402444.799257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789402444.800982:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402444.801037:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402444.801090:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402444.801127:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb8d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789402444.802126:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224393984 00000100:00100000:0.0:1789402444.802139:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224393984 00000100:00100000:0.0:1789402444.802201:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789402444.802210:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224393984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402444.802445:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:5841:x1876324224393984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402444.802460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789402444.803292:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8612d911-d8bf-490d-b22c-35e85a3b4473:5841:1876324224393984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402444.807330:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11690:1876324224394112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402444.807464:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402444.807509:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb8d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402444.807832:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224394112 00000100:00100000:0.0:1789402444.807840:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224394112 00000100:00100000:0.0:1789402444.807902:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789402444.807912:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:11690:x1876324224394112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402444.808147:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:11690:x1876324224394112:12345-0@lo:502:llog_process_th.0 Request processed in 237us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402444.808155:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789402444.808238:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ffacbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11690:1876324224394112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789402444.808267:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402444.808276:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402444.808284:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789402444.808292:0:11690:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c6e31a1800 00000020:00000080:3.0:1789402444.808295:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789402444.808397:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11690:1876324224394240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402444.808432:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402444.808454:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789402444.808646:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224394240 00000100:00100000:1.0:1789402444.808651:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224394240 00000100:00100000:1.0:1789402444.808677:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789402444.808684:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:11690:x1876324224394240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402444.808810:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:11690:x1876324224394240:12345-0@lo:502:llog_process_th.0 Request processed in 127us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402444.808817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789402444.808858:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8612d911-d8bf-490d-b22c-35e85a3b4473:11690:1876324224394240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789402444.808877:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789402444.808882:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402444.808884:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789402444.808889:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789402444.809249:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789402444.809268:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789402444.809278:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402444.809290:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789402444.830662:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789402444.833442:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402444.833491:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199192320 00000100:00100000:2.0:1789402444.833503:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199192320 00000100:00100000:2.0:1789402444.833562:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 266 00000100:00100000:2.0:1789402444.833573:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:5594:x1876324199192320:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402444.833604:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402444.833634:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f7dd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.833664:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f7dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470d8 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.833675:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f7dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470d8 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402444.833684:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dea00, rc 0) 00000100:00100000:2.0:1789402444.833742:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199192320:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 Request processed in 171us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402444.833749:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 266 00000100:00100000:3.0:1789402444.842118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402444.842234:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199192448 00000100:00100000:2.0:1789402444.842248:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199192448 00000100:00100000:2.0:1789402444.842302:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 267 00000100:00100000:2.0:1789402444.842311:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199192448:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402444.842606:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199192448:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 Request processed in 295us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402444.842624:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 267 00000100:00100000:3.0:1789402444.847376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402444.847470:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199192576 00000100:00100000:2.0:1789402444.847481:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199192576 00000100:00100000:2.0:1789402444.847592:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 268 00000100:00100000:2.0:1789402444.847604:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199192576:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789402444.847865:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199192576:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 Request processed in 263us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402444.847880:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 268 00000100:00100000:2.0:1789402444.857016:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402444.861696:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199192704 00000100:00100000:3.0:1789402444.861712:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199192704 00000100:00100000:3.0:1789402444.861774:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 269 00000100:00100000:3.0:1789402444.861790:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:9961:x1876324199192704:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789402444.862087:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:9961:x1876324199192704:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 301us (5078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402444.862095:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 269 00000100:00100000:3.0:1789402444.870101:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402444.870624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199192832 00000100:00100000:0.0:1789402444.870635:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199192832 00000100:00100000:0.0:1789402444.870696:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 270 00000100:00100000:0.0:1789402444.870707:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:9961:x1876324199192832:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789402444.870953:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:9961:x1876324199192832:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 247us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402444.870972:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 270 00000100:00100000:3.0:1789402444.878699:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402444.879560:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199192960 00000100:00100000:0.0:1789402444.879573:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199192960 00000100:00100000:0.0:1789402444.879639:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 271 00000100:00100000:0.0:1789402444.879648:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:5594:x1876324199192960:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402444.879664:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402444.879681:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a82600/0x9403f4af875f7de0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470df expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.879706:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a82600/0x9403f4af875f7de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470df expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.879731:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a82600/0x9403f4af875f7de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470df expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402444.879740:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82600, rc 0) 00000100:00100000:0.0:1789402444.879799:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199192960:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 Request processed in 152us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402444.879805:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 271 00000100:00100000:3.0:1789402444.885782:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402444.889076:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199193088 00000100:00100000:0.0:1789402444.889226:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199193088 00000100:00100000:1.0:1789402444.899672:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 272 00000100:00100000:1.0:1789402444.899690:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199193088:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402444.899995:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199193088:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 Request processed in 308us (14220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402444.900003:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 272 00000100:00100000:3.0:1789402444.905170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402444.906269:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199193216 00000100:00100000:1.0:1789402444.906282:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199193216 00000100:00100000:1.0:1789402444.906366:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 273 00000100:00100000:1.0:1789402444.906376:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199193216:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402444.906602:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:5594:x1876324199193216:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 Request processed in 227us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402444.906620:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 273 00000100:00100000:3.0:1789402444.924547:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402444.924662:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199193344 00000100:00100000:1.0:1789402444.924680:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199193344 00000100:00100000:1.0:1789402444.924736:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 274 00000100:00100000:1.0:1789402444.924747:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:9964:x1876324199193344:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789402444.924993:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:9964:x1876324199193344:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 246us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402444.925003:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 274 00000100:00100000:3.0:1789402444.933431:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402444.933561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199193472 00000100:00100000:1.0:1789402444.933572:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199193472 00000100:00100000:1.0:1789402444.933643:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 275 00000100:00100000:1.0:1789402444.933655:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:9964:x1876324199193472:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789402444.933911:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:9964:x1876324199193472:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 257us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402444.933919:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 275 00010000:00010000:0.0:1789402445.282628:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402445.538657:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224394496:0@lo:400:kworker.0 00000100:00100000:1.0:1789402445.538727:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402445.538834:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224394368:0@lo:400:kworker.0 00000100:00100000:2.0:1789402445.538870:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402445.538930:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224394368 00000100:00100000:2.0:1789402445.538938:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224394368 00000100:00100000:2.0:1789402445.538980:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789402445.538989:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224394368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402445.539049:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224394368:12345-0@lo:400:kworker.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402445.539055:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789402445.539099:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224394368:0@lo:400:kworker.0 00000100:00100000:2.0:1789402445.539146:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224394496 00000100:00100000:2.0:1789402445.539150:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224394496 00000100:00100000:2.0:1789402445.539178:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789402445.539186:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224394496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402445.539293:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224394624:0@lo:400:kworker.0 00000100:00100000:0.0:1789402445.539322:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402445.539371:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224394624 00000100:00100000:0.0:1789402445.539375:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224394624 00000100:00100000:0.0:1789402445.539409:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789402445.539416:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224394624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402445.539451:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224394624:12345-0@lo:400:kworker.0 Request processed in 36us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402445.539457:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1789402445.539474:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402445.539496:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224394624:0@lo:400:kworker.0 00000100:00100000:2.0:1789402445.541771:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224394496:12345-0@lo:400:kworker.0 Request processed in 2577us (3035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402445.541788:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789402445.543620:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224394496:0@lo:400:kworker.0 00000100:00100000:2.0:1789402445.548276:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789402445.548327:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402445.548363:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224394880:0@lo:400:kworker.0 00000100:00100000:0.0:1789402445.548430:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402445.548540:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224394880 00000100:00100000:1.0:1789402445.548548:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224394880 00000100:00100000:1.0:1789402445.548626:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789402445.548636:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224394880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402445.548691:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224394880:12345-0@lo:400:kworker.0 Request processed in 57us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402445.548698:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789402445.548740:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224394880:0@lo:400:kworker.0 00000100:00080000:0.0:1789402445.548802:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402445.549543:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224394752:0@lo:400:kworker.0 00000100:00100000:2.0:1789402445.549615:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402445.549722:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224394752 00000100:00100000:0.0:1789402445.549744:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224394752 00000100:00100000:0.0:1789402445.549813:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789402445.549822:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224394752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402445.549873:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224394752:12345-0@lo:400:kworker.0 Request processed in 53us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402445.549880:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1789402445.549918:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e32c2a00 x1876324224394752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402445.549932:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224394752:0@lo:400:kworker.0 00000100:00080000:2.0:1789402445.550077:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402445.550683:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224395008:0@lo:400:kworker.0 00000100:00100000:2.0:1789402445.550724:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402445.550836:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224395008 00000100:00100000:0.0:1789402445.550843:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224395008 00000100:00100000:0.0:1789402445.550893:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789402445.550900:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224395008:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789402445.550964:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789402445.551391:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224395008:12345-0@lo:400:kworker.0 Request processed in 489us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402445.551399:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789402445.551509:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789402445.551515:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6ef3cb800, transno 4294967300 00000100:00100000:2.0:1789402445.551532:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224395008:0@lo:400:kworker.0 00000040:00080000:2.0:1789402445.859077:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789402446.050595:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789402446.050628:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224395136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789402446.050713:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402446.050915:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224395136 00000100:00100000:3.0:1789402446.050924:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224395136 00000100:00100000:3.0:1789402446.050974:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789402446.050983:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224395136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789402446.051017:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402446.051071:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224395136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402446.051078:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789402446.051273:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224395136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789402446.306637:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402446.562668:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224395264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402446.562738:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402446.562930:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224395264 00000100:00100000:3.0:1789402446.562938:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224395264 00000100:00100000:3.0:1789402446.563024:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789402446.563035:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224395264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402446.563069:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402446.563127:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224395264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402446.563134:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789402446.563206:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e32c1180 x1876324224395264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402446.563225:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224395264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789402447.330573:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402447.391268:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402447.391311:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402447.391408:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402447.391416:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199193728 00000100:00100000:0.0:1789402447.391434:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402447.391436:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199193728 00000100:00100000:0.0:1789402447.391474:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199193856 00000100:00100000:0.0:1789402447.391500:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199193856 00000100:00100000:3.0:1789402447.391548:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199193984 00000100:00100000:3.0:1789402447.391554:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199193984 00000100:00100000:0.0:1789402447.391573:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 62 00000100:00100000:3.0:1789402447.391621:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 109 00000100:00100000:3.0:1789402447.391636:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199193728:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402447.391662:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199193600 00000100:00100000:2.0:1789402447.391670:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199193600 00000100:00100000:2.0:1789402447.391719:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 277 00000100:00100000:2.0:1789402447.391729:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199193600:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402447.391752:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199193728:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 118us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402447.391762:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 109 00000100:00100000:3.0:1789402447.391793:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 110 00000100:00100000:2.0:1789402447.391802:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199193600:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 71us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402447.391818:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 277 00000100:00100000:3.0:1789402447.391826:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199193984:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402447.391872:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199193984:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 51us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402447.391879:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 110 00000100:00080000:3.0:1789402447.391937:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789402447.391943:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402447.392015:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199193856:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402447.392070:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199193856:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 488us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402447.397420:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 62 00010000:00010000:0.0:1789402448.356739:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402449.378995:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402450.402816:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402450.659277:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224395392:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.659396:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402450.659453:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224395904:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.659483:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402450.659516:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402450.659521:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224395776:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.659686:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402450.659720:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224395520:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.659748:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402450.659766:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224396032:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.659785:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402450.659803:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402450.659809:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224395648:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.659858:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402450.659895:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224395904 00000100:00100000:3.0:1789402450.659906:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224395904 00000100:00100000:3.0:1789402450.659959:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224395520 00000100:00100000:3.0:1789402450.659961:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224395520 00000100:00100000:3.0:1789402450.659972:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224395648 00000100:00100000:3.0:1789402450.659973:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224395648 00000100:00100000:3.0:1789402450.659994:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789402450.660001:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224395904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660050:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224395904:12345-0@lo:400:kworker.0 Request processed in 49us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402450.660055:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789402450.660074:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789402450.660078:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224395520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660096:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224395520:12345-0@lo:400:kworker.0 Request processed in 18us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402450.660099:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789402450.660110:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789402450.660113:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224395648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660127:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224395648:12345-0@lo:400:kworker.0 Request processed in 14us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402450.660131:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789402450.660150:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224395776 00000100:00100000:3.0:1789402450.660152:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224395776 00000100:00100000:3.0:1789402450.660170:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224396032 00000100:00100000:3.0:1789402450.660172:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224396032 00000100:00100000:3.0:1789402450.660183:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789402450.660224:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224395776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660256:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224395776:12345-0@lo:400:kworker.0 Request processed in 68us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402450.660263:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789402450.660275:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789402450.660282:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224396032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660329:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224396032:12345-0@lo:400:kworker.0 Request processed in 48us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402450.660335:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789402450.660383:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789402450.660387:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402450.660390:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402450.660433:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224395648:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660443:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224395520:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660451:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224396032:0@lo:400:kworker.0 00010000:00080000:3.0:1789402450.660565:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e32c3100 x1876324224395776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402450.660590:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224395776:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660601:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224395904:0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660683:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224395392 00000100:00100000:3.0:1789402450.660687:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224395392 00000100:00100000:3.0:1789402450.660717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789402450.660724:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224395392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402450.660761:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224395392:12345-0@lo:400:kworker.0 Request processed in 37us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402450.660766:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789402450.660802:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224395392:0@lo:400:kworker.0 00000100:00100000:3.0:1789402451.170947:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224396160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402451.171048:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402451.171335:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224396160 00000100:00100000:1.0:1789402451.171388:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224396160 00000100:00100000:1.0:1789402451.171457:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789402451.171469:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224396160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402451.171515:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402451.173578:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224396160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2091us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402451.173594:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789402451.174217:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224396160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789402451.427002:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402451.683443:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789402451.683467:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224396288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402451.683554:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402451.684706:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224396288 00000100:00100000:3.0:1789402451.684718:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224396288 00000100:00100000:3.0:1789402451.684781:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789402451.684791:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224396288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402451.684829:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402451.684905:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224396288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402451.684912:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789402451.685024:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6eec00000 x1876324224396288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402451.685044:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224396288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789402452.450614:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402452.512320:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402452.512395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402452.512428:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402452.512484:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402452.512709:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199194240 00000100:00100000:1.0:1789402452.512720:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199194240 00000100:00100000:1.0:1789402452.512787:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199194496 00000100:00100000:1.0:1789402452.512791:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199194496 00000100:00100000:1.0:1789402452.512816:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 114 00000100:00100000:1.0:1789402452.512826:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199194240:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402452.512896:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199194240:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 71us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402452.512904:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 114 00000100:00100000:1.0:1789402452.512934:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 115 00000100:00100000:1.0:1789402452.512941:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199194496:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402452.512965:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199194496:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402452.512988:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 115 00000100:00100000:2.0:1789402452.513133:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199194112 00000100:00100000:2.0:1789402452.513138:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199194112 00000100:00100000:2.0:1789402452.513191:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 279 00000100:00100000:2.0:1789402452.513199:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199194112:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402452.513235:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199194368 00000100:00100000:3.0:1789402452.513240:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199194368 00000100:00100000:2.0:1789402452.513240:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199194112:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 32us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402452.513251:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 279 00000100:00100000:3.0:1789402452.513288:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 65 00000100:00100000:3.0:1789402452.513298:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199194368:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402452.513330:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199194368:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 33us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402452.513337:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 65 00000100:00080000:0.0:1789402452.513759:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789402452.513764:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789402453.474695:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402454.501778:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789402455.075152:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789402455.522684:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402455.778822:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224396800:0@lo:400:kworker.0 00000100:00100000:0.0:1789402455.778920:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402455.779019:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789402455.779026:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224396416:0@lo:400:kworker.0 00000100:00100000:0.0:1789402455.779070:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402455.779099:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224396928:0@lo:400:kworker.0 00000100:00100000:0.0:1789402455.779126:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402455.779164:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224396416 00000100:00100000:0.0:1789402455.779173:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224396416 00000100:00100000:0.0:1789402455.779228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789402455.779254:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224396416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402455.779317:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224396416:12345-0@lo:400:kworker.0 Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402455.779324:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789402455.779391:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224396928 00000100:00100000:0.0:1789402455.779395:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224396928 00000100:00100000:0.0:1789402455.779431:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789402455.779438:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224396928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402455.779469:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224396928:12345-0@lo:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402455.779475:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1789402455.779496:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402455.779526:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224396416:0@lo:400:kworker.0 00000100:00100000:0.0:1789402455.779553:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224396928:0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.779775:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224396544:0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.779812:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402455.779844:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224397056:0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.779867:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402455.779889:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402455.779895:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224396672:0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.779917:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402455.780024:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224396544 00000100:00100000:3.0:1789402455.780029:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224396544 00000100:00100000:3.0:1789402455.780116:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224396672 00000100:00100000:3.0:1789402455.780132:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224396672 00000100:00100000:3.0:1789402455.780163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789402455.780171:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224396544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.780221:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224396544:12345-0@lo:400:kworker.0 Request processed in 50us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402455.780228:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789402455.780250:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789402455.780256:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224396672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.780282:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224396672:12345-0@lo:400:kworker.0 Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402455.780288:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789402455.780310:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224396800 00000100:00100000:3.0:1789402455.780314:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224396800 00000100:00100000:3.0:1789402455.780380:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224397056 00000100:00100000:3.0:1789402455.780383:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224397056 00000100:00100000:3.0:1789402455.780403:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789402455.780410:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224396800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.780445:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224396800:12345-0@lo:400:kworker.0 Request processed in 36us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402455.780451:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789402455.780462:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789402455.780467:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224397056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.780492:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224397056:12345-0@lo:400:kworker.0 Request processed in 25us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402455.780497:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789402455.780520:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789402455.780523:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402455.780544:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402455.780575:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224396672:0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.780587:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224396544:0@lo:400:kworker.0 00000100:00100000:3.0:1789402455.780597:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224397056:0@lo:400:kworker.0 00010000:00080000:0.0:1789402455.780749:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb8d6a00 x1876324224396800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402455.780761:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224396800:0@lo:400:kworker.0 00000100:00100000:3.0:1789402456.290807:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224397184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402456.290903:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402456.291211:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224397184 00000100:00100000:0.0:1789402456.291222:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224397184 00000100:00100000:0.0:1789402456.291296:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789402456.291309:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224397184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789402456.291499:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789402456.291802:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224397184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 494us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402456.291811:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789402456.291914:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224397184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789402456.546642:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402456.803328:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789402456.803381:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224397312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402456.803483:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402456.804152:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224397312 00000100:00100000:1.0:1789402456.804165:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224397312 00000100:00100000:1.0:1789402456.804243:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789402456.804255:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224397312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789402456.804299:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402456.804404:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224397312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402456.804411:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789402456.804675:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6eec01f80 x1876324224397312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402456.804698:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224397312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789402457.575792:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402457.636815:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402457.636870:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402457.636913:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402457.637016:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199194752 00000100:00100000:2.0:1789402457.637029:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199194752 00000100:00100000:2.0:1789402457.637101:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199195008 00000100:00100000:2.0:1789402457.637104:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199195008 00000100:00100000:2.0:1789402457.637130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 119 00000100:00100000:2.0:1789402457.637140:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199194752:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402457.637233:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199194752:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 94us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402457.637251:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 119 00000100:00100000:2.0:1789402457.637274:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 120 00000100:00100000:2.0:1789402457.637280:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199195008:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402457.637317:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199195008:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 36us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402457.637323:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 120 00000100:00080000:3.0:1789402457.637499:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402457.638074:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199194624 00000100:00100000:1.0:1789402457.638084:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199194624 00000100:00100000:1.0:1789402457.638133:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 281 00000100:00100000:1.0:1789402457.638142:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199194624:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402457.638194:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199194624:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 54us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402457.638202:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 281 00000100:00100000:3.0:1789402457.642736:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402457.642956:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199194880 00000100:00100000:0.0:1789402457.642969:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199194880 00000100:00100000:0.0:1789402457.643070:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 68 00000100:00100000:0.0:1789402457.643083:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199194880:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402457.643184:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199194880:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 103us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402457.643192:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 68 00000100:00080000:3.0:1789402457.643317:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789402458.598431:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402459.620084:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402460.642783:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402460.899036:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224397568:0@lo:400:kworker.0 00000100:00100000:3.0:1789402460.899047:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224397696:0@lo:400:kworker.0 00000100:00100000:2.0:1789402460.899123:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224397440:0@lo:400:kworker.0 00000100:00100000:0.0:1789402460.899168:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224397824:0@lo:400:kworker.0 00000100:00100000:3.0:1789402460.900835:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402460.900967:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224397696 00000100:00100000:3.0:1789402460.900978:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224397696 00000100:00100000:3.0:1789402460.901189:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789402460.901206:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402460.901216:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402460.901265:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224398080:0@lo:400:kworker.0 00000100:00100000:3.0:1789402460.901288:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224397696:12345-0@lo:400:kworker.0 Request processed in 87us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402460.901297:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789402460.901309:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402460.901325:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224397568 00000100:00100000:3.0:1789402460.901330:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224397568 00000100:00100000:3.0:1789402460.901380:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789402460.901388:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224397568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402460.901406:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224398080 00000100:00100000:1.0:1789402460.901412:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224398080 00000100:00100000:3.0:1789402460.901453:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224397568:12345-0@lo:400:kworker.0 Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402460.901462:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789402460.901466:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789402460.901476:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224398080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402460.901577:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224397568:0@lo:400:kworker.0 00000100:00100000:3.0:1789402460.901615:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224397696:0@lo:400:kworker.0 00000100:00080000:3.0:1789402460.901643:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789402460.901649:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402460.901765:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402460.901856:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224397952:0@lo:400:kworker.0 00000100:00100000:2.0:1789402460.901886:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402460.901936:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224397952 00000100:00100000:2.0:1789402460.901941:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224397952 00000100:00100000:2.0:1789402460.901975:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789402460.901982:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224397952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402460.902020:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224397952:12345-0@lo:400:kworker.0 Request processed in 38us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402460.902157:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789402460.902193:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224397952:0@lo:400:kworker.0 00000100:00080000:2.0:1789402460.902222:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402460.902619:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402460.902706:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224397824 00000100:00100000:2.0:1789402460.902712:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224397824 00000100:00100000:2.0:1789402460.902762:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789402460.902770:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224397824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402460.902815:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224397824:12345-0@lo:400:kworker.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402460.902823:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789402460.902980:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224397440 00000100:00100000:3.0:1789402460.902986:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224397440 00000100:00100000:3.0:1789402460.903023:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789402460.903031:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224397440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402460.903167:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224397440:12345-0@lo:400:kworker.0 Request processed in 137us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402460.903174:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789402460.903224:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224397440:0@lo:400:kworker.0 00000100:00080000:0.0:1789402460.903384:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789402460.903414:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6eec00e00 x1876324224397824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402460.903423:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224398080:12345-0@lo:400:kworker.0 Request processed in 1945us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402460.903433:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789402460.903512:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224397824:0@lo:400:kworker.0 00000100:00100000:3.0:1789402460.904090:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224398080:0@lo:400:kworker.0 00000100:00100000:3.0:1789402461.411590:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224398208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402461.411710:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402461.411932:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224398208 00000100:00100000:1.0:1789402461.411943:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224398208 00000100:00100000:1.0:1789402461.412029:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789402461.412041:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224398208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402461.412089:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402461.412155:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224398208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402461.412162:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789402461.412241:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224398208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402461.670383:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402461.923851:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789402461.923893:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224398336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402461.924009:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402461.924440:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224398336 00000100:00100000:1.0:1789402461.924452:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224398336 00000100:00100000:1.0:1789402461.924534:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789402461.924546:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224398336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789402461.924596:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402461.924667:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224398336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402461.924674:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1789402461.924973:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6eec02d80 x1876324224398336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402461.924997:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224398336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789402462.690654:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402462.750978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402462.751027:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402462.751129:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199195136 00000100:00100000:0.0:1789402462.751140:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199195136 00000100:00100000:0.0:1789402462.751202:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 283 00000100:00100000:0.0:1789402462.751214:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2352:x1876324199195136:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402462.751293:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2352:x1876324199195136:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402462.751302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 283 00000100:00100000:3.0:1789402462.760208:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199195264 00000100:00100000:3.0:1789402462.760234:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199195264 00000100:00100000:3.0:1789402462.760319:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 124 00000100:00100000:3.0:1789402462.760329:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199195264:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402462.760432:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199195264:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 105us (9403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402462.760458:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 124 00000100:00080000:0.0:1789402462.762795:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402462.776808:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402462.776934:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199195392 00000100:00100000:3.0:1789402462.776952:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199195392 00000100:00100000:3.0:1789402462.777080:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:3.0:1789402462.777095:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2350:x1876324199195392:12345-192.168.203.8@tcp:9:kworker.0 00000020:00000080:3.0:1789402462.777135:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7d1c 00000100:00080000:3.0:1789402462.777147:0:6690:0:(import.c:65:import_set_state_nolock()) ffff93c6ff70a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789402462.777206:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789402462.777628:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+2:2350:x1876324199195392:12345-192.168.203.8@tcp:9:kworker.0 Request processed in 535us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402462.777636:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 19 00010000:00010000:1.0:1789402462.777795:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789402462.778374:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402462.778631:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402462.778779:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199195520 00000100:00100000:1.0:1789402462.778788:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199195520 00000100:00100000:1.0:1789402462.778861:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 125 00000100:00100000:1.0:1789402462.778871:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199195520:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402462.778959:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199195520:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 89us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402462.778967:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 125 00000100:00080000:0.0:1789402462.779041:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789402463.715800:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789402464.025686:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:1.0:1789402464.025696:0:7645:0:(genops.c:885:class_export_put()) final put ffff93c6ff70e000/4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:2.0:1789402464.025829:0:1377:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ff70e000/4785302d-2648-4148-8042-c10a24a5dd29 for lustre-OST0001 00000020:00000080:2.0:1789402464.025894:0:1377:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ff70a800 for lustre-OST0001 00010000:00010000:1.0:1789402464.746136:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789402465.382793:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789402465.762605:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402466.018613:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224398720:0@lo:400:kworker.0 00000100:00100000:0.0:1789402466.018681:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402466.018747:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789402466.018754:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224398592:0@lo:400:kworker.0 00000100:00100000:0.0:1789402466.018778:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402466.018800:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224399104:0@lo:400:kworker.0 00000100:00100000:2.0:1789402466.018824:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224398464:0@lo:400:kworker.0 00000100:00100000:1.0:1789402466.018828:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224398848:0@lo:400:kworker.0 00000100:00100000:0.0:1789402466.018828:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402466.018863:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402466.018865:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224398720 00000100:00100000:0.0:1789402466.018872:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224398720 00000100:00100000:2.0:1789402466.018885:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402466.018902:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224399104 00000100:00100000:1.0:1789402466.018907:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224399104 00000100:00100000:0.0:1789402466.018929:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224398592 00000100:00100000:0.0:1789402466.018933:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224398592 00000100:00100000:2.0:1789402466.018934:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224398976:0@lo:400:kworker.0 00000100:00100000:0.0:1789402466.018967:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789402466.018968:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402466.018982:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224398720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402466.019035:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224398720:12345-0@lo:400:kworker.0 Request processed in 58us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402466.019042:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789402466.019057:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224398976 00000100:00100000:0.0:1789402466.019061:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224398976 00000100:00100000:3.0:1789402466.019083:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224398848 00000100:00100000:0.0:1789402466.019085:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789402466.019089:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224398848 00000100:00100000:0.0:1789402466.019094:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224398592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402466.019128:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224398592:12345-0@lo:400:kworker.0 Request processed in 35us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402466.019132:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789402466.019137:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789402466.019145:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224398848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402466.019154:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789402466.019170:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224398976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402466.019196:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224398848:12345-0@lo:400:kworker.0 Request processed in 55us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402466.019204:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789402466.019215:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224398976:12345-0@lo:400:kworker.0 Request processed in 45us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402466.019221:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1789402466.019248:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789402466.019252:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402466.019276:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224398976:0@lo:400:kworker.0 00000100:00100000:0.0:1789402466.019280:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224398592:0@lo:400:kworker.0 00000100:00100000:0.0:1789402466.019293:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224398720:0@lo:400:kworker.0 00000100:00100000:2.0:1789402466.019311:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224398464 00000100:00100000:2.0:1789402466.019317:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224398464 00000100:00100000:3.0:1789402466.019397:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789402466.019408:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224398464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402466.019413:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789402466.019424:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224399104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402466.019468:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224398464:12345-0@lo:400:kworker.0 Request processed in 63us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402466.019475:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789402466.019484:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224399104:12345-0@lo:400:kworker.0 Request processed in 61us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402466.019491:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789402466.019517:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224398464:0@lo:400:kworker.0 00010000:00080000:1.0:1789402466.019532:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6ef3c8000 x1876324224398848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402466.019544:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224398848:0@lo:400:kworker.0 00000100:00080000:1.0:1789402466.019569:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789402466.019584:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224399104:0@lo:400:kworker.0 00000100:00100000:3.0:1789402466.530882:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402466.530904:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224399232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402466.530967:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402466.531150:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224399232 00000100:00100000:1.0:1789402466.531158:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224399232 00000100:00100000:1.0:1789402466.531205:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789402466.531213:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224399232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402466.531244:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402466.531306:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224399232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402466.531312:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789402466.531431:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224399232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402466.787715:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402467.043915:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224399360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402467.043998:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402467.044078:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224399360 00000100:00100000:3.0:1789402467.044085:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224399360 00000100:00100000:3.0:1789402467.044133:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789402467.044144:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224399360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402467.044183:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402467.044231:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224399360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402467.044239:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789402467.044288:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6eec02d80 x1876324224399360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402467.044308:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224399360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789402467.810590:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402467.870428:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402467.870490:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402467.870521:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402467.870554:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199195904 00000100:00100000:3.0:1789402467.870567:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199195904 00000100:00100000:3.0:1789402467.870636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199195776 00000100:00100000:3.0:1789402467.870640:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199195776 00000100:00100000:3.0:1789402467.870669:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 129 00000100:00100000:3.0:1789402467.870681:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199195904:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402467.870776:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199195904:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402467.870794:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 129 00000100:00100000:3.0:1789402467.870821:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 130 00000100:00100000:3.0:1789402467.870828:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199195776:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402467.870858:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199195776:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402467.870863:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 130 00000100:00080000:3.0:1789402467.870887:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402467.871273:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199195648 00000100:00100000:1.0:1789402467.871281:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199195648 00000100:00100000:1.0:1789402467.871321:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 285 00000100:00100000:1.0:1789402467.871330:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199195648:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402467.871397:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199195648:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 68us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402467.871404:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 285 00000001:02000400:0.0:1789402467.970484:0:11856:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:14:25 (1789402465) 00010000:00010000:1.0:1789402468.835133:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402469.615201:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402469.615373:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199196032 00000100:00100000:0.0:1789402469.615385:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199196032 00000100:00100000:0.0:1789402469.615476:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 32 00000100:00100000:0.0:1789402469.615488:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:10233:x1876324199196032:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402469.615510:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402469.615535:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7de7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470e6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402469.615598:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f7dee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402469.615612:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f7dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402469.615626:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f7dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402469.615659:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789402469.615675:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402469.615733:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f7dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402469.615757:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470e6 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402469.615776:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f7dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470e6 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402469.615785:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:0.0:1789402469.615788:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789402469.615792:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82e00, rc 0) 00000100:00100000:0.0:1789402469.615852:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:10233:x1876324199196032:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 366us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402469.615859:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 32 00000100:00080000:3.0:1789402469.616836:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402469.664295:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402469.664457:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199196160 00000100:00100000:3.0:1789402469.664467:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199196160 00000100:00100000:3.0:1789402469.664527:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:3.0:1789402469.664538:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:10234:x1876324199196160:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789402469.664564:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402469.664587:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7df5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470ed expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.664655:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.664670:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.664681:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.664695:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.664728:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.664736:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.664940:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c800/0x9403f4af875f7e0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.664950:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c800/0x9403f4af875f7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.664958:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c800/0x9403f4af875f7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402469.664983:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789402469.664987:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402469.665007:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c800/0x9403f4af875f7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665018:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665025:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665031:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665037:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402469.665042:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665056:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665068:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:3.0:1789402469.665071:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402469.665076:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665083:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7dfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665095:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665100:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665106:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665111:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402469.665115:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665121:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665128:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93c6d2ca6c00) 00010000:00010000:3.0:1789402469.665130:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402469.665133:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665150:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665186:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7df5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470ed expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665200:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c800/0x9403f4af875f7e0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470ed expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402469.665219:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c6d2ca6900) 00010000:00010000:3.0:1789402469.665222:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789402469.665225:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c800, rc 0) 00000100:00100000:3.0:1789402469.665294:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:10234:x1876324199196160:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 757us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402469.665301:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:2.0:1789402469.695915:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402469.696001:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199196416 00000100:00100000:1.0:1789402469.696011:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199196416 00000100:00100000:1.0:1789402469.696081:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 34 00000100:00100000:1.0:1789402469.696091:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:10234:x1876324199196416:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789402469.696112:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402469.696133:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7e11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470f4 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.696200:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.696226:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.696237:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.696310:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.696319:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.696326:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.696694:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e200/0x9403f4af875f7e26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.696705:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e200/0x9403f4af875f7e26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.696712:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e200/0x9403f4af875f7e26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789402469.696718:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000004:00200000:1.0:1789402469.703394:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789402469.703649:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703660:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703667:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703673:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402469.703678:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703698:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703714:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c6d2ca6900) 00010000:00010000:1.0:1789402469.703717:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402469.703722:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703729:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7e18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703743:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703749:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703755:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703760:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402469.703763:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703769:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703776:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93c6d8cd8a00) 00010000:00010000:1.0:1789402469.703778:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402469.703781:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.703796:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7e1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.705156:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7e11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470f4 expref: 10 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.705179:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e200/0x9403f4af875f7e26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470f4 expref: 9 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402469.705187:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:1.0:1789402469.705190:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402469.705193:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e200, rc 0) 00000100:00100000:1.0:1789402469.705366:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+9:10234:x1876324199196416:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 9251us (9435us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789402469.705376:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 34 00000100:00100000:2.0:1789402469.729273:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402469.729433:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199196544 00000100:00100000:3.0:1789402469.729443:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199196544 00000100:00100000:3.0:1789402469.729504:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 35 00000100:00100000:3.0:1789402469.729515:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+9:10234:x1876324199196544:12345-192.168.203.8@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789402469.729619:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+9:10234:x1876324199196544:12345-192.168.203.8@tcp:59:lhsmtool_posix.0 Request processed in 105us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402469.729626:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 35 00010000:00010000:2.0:1789402469.858671:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789402470.499484:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789402470.883527:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402471.138822:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789402471.138878:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224399616:0@lo:400:kworker.0 00000100:00100000:1.0:1789402471.138930:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224399744:0@lo:400:kworker.0 00000100:00100000:3.0:1789402471.138947:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402471.138980:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402471.139022:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224399616 00000100:00100000:1.0:1789402471.139035:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224399744 00000100:00100000:3.0:1789402471.139040:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224399616 00000100:00100000:1.0:1789402471.139041:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224399744 00000100:00100000:3.0:1789402471.139101:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789402471.139110:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224399616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402471.139160:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224399616:12345-0@lo:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402471.139167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789402471.139189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789402471.139195:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224399744:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789402471.139238:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402471.139510:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224399872:0@lo:400:kworker.0 00000100:00100000:0.0:1789402471.139549:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402471.139585:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224399488:0@lo:400:kworker.0 00000100:00100000:1.0:1789402471.139612:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224399872 00000100:00100000:1.0:1789402471.139618:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224399872 00000100:00100000:0.0:1789402471.139623:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402471.139667:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224399744:12345-0@lo:400:kworker.0 Request processed in 471us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402471.139676:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789402471.139680:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224399488 00000100:00100000:0.0:1789402471.139686:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224399488 00000100:00100000:1.0:1789402471.139688:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224399872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402471.139690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789402471.139720:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789402471.139730:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224399488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402471.139738:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224399616:0@lo:400:kworker.0 00000100:00100000:1.0:1789402471.139745:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224399872:12345-0@lo:400:kworker.0 Request processed in 59us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402471.139763:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789402471.139789:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402471.139808:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224399744:0@lo:400:kworker.0 00010000:00080000:1.0:1789402471.139834:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb8d5880 x1876324224399872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789402487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402471.139845:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224399872:0@lo:400:kworker.0 00000100:00100000:0.0:1789402471.139928:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224399488:12345-0@lo:400:kworker.0 Request processed in 198us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402471.139933:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224399488:0@lo:400:kworker.0 00000100:00100000:0.0:1789402471.139941:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789402471.140601:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789402471.140612:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224400128:0@lo:400:kworker.0 00000100:00100000:1.0:1789402471.140648:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402471.140679:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224400128 00000100:00100000:1.0:1789402471.140684:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224400128 00000100:00100000:3.0:1789402471.140928:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224400000:0@lo:400:kworker.0 00000100:00100000:1.0:1789402471.141018:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789402471.141027:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224400128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402471.141075:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224400128:12345-0@lo:400:kworker.0 Request processed in 50us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402471.141082:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789402471.141103:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789402471.141587:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224400128:0@lo:400:kworker.0 00000100:00100000:3.0:1789402471.141658:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402471.141717:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224400000 00000100:00100000:1.0:1789402471.141723:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224400000 00000100:00100000:1.0:1789402471.141775:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789402471.141783:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224400000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402471.141829:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224400000:12345-0@lo:400:kworker.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402471.141835:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1789402471.142708:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402471.143002:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224400000:0@lo:400:kworker.0 00000100:00100000:0.0:1789402471.652639:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402471.652664:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224400256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789402471.652749:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402471.652859:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224400256 00000100:00100000:3.0:1789402471.652868:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224400256 00000100:00100000:3.0:1789402471.652922:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789402471.652933:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224400256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789402471.653062:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402471.653117:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224400256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402471.653124:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789402471.653316:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224400256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789402471.775522:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402471.775621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199196672 00000100:00100000:0.0:1789402471.775632:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199196672 00000100:00100000:0.0:1789402471.775704:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 36 00000100:00100000:0.0:1789402471.775714:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:10277:x1876324199196672:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402471.775737:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402471.775761:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b470fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.775839:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.775853:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.775865:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.775879:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.775886:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.775892:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776218:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776227:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776234:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776240:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402471.776244:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776251:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776264:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:0.0:1789402471.776267:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402471.776272:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776278:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776289:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776295:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776301:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776312:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402471.776315:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776322:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776330:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c6c3a3e700) 00010000:00010000:0.0:1789402471.776332:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402471.776335:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776371:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776414:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7e34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470fb expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776424:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:0.0:1789402471.776426:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402471.776431:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470fb expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.776440:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83a00, rc 0) 00000100:00100000:0.0:1789402471.776499:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:10277:x1876324199196672:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 786us (985us total) trans 0 rc 301/301 00000100:00100000:0.0:1789402471.776506:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 36 00000100:00080000:2.0:1789402471.777046:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402471.819930:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402471.821112:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199196928 00000100:00100000:3.0:1789402471.821123:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199196928 00000100:00100000:3.0:1789402471.821183:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 37 00000100:00100000:3.0:1789402471.821192:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+9:10277:x1876324199196928:12345-192.168.203.8@tcp:36:lfs.0 00010000:00010000:3.0:1789402471.821254:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402471.821280:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f7dee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470e6 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.821295:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:3.0:1789402471.821304:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789402471.821539:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.821552:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.821563:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.821575:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.821582:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.821589:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402471.822666:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789402471.822678:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.822685:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.822691:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.822703:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402471.822708:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.822715:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.822727:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d2ca6c00) 00010000:00010000:3.0:1789402471.822730:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402471.822734:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.822739:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7e49 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789402471.822755:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aef0ac1c reply state 000000003f854a87 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402471.822763:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789402471.824143:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+10:10277:x1876324199196928:12345-192.168.203.8@tcp:36:lfs.0 Request processed in 2943us (4214us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789402471.824155:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 37 00010000:00010000:3.0:1789402471.827683:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.827702:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.827710:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.827731:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402471.827795:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.827870:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.827889:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c6d2ca6000) 00010000:00010000:3.0:1789402471.827892:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402471.827898:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402471.827905:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7e50 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402471.906529:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402471.951009:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402471.951127:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199197056 00000100:00100000:0.0:1789402471.951153:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199197056 00000100:00100000:0.0:1789402471.951219:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 38 00000100:00100000:0.0:1789402471.951229:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:10285:x1876324199197056:12345-192.168.203.8@tcp:101:lctl.0 00010000:00010000:0.0:1789402471.951254:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402471.951277:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7e57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47102 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.951387:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.951401:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.951426:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402471.951463:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789402471.951467:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402471.951503:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.951529:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7e57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47102 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.951546:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47102 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402471.951554:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:0.0:1789402471.951556:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789402471.951560:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82000, rc 0) 00000100:00100000:0.0:1789402471.951627:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+10:10285:x1876324199197056:12345-192.168.203.8@tcp:101:lctl.0 Request processed in 399us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402471.951633:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 38 00000100:00100000:2.0:1789402472.044817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402472.045175:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199197184 00000100:00100000:0.0:1789402472.045184:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199197184 00000100:00100000:0.0:1789402472.045242:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:0.0:1789402472.045252:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+10:10291:x1876324199197184:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402472.045271:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402472.045292:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7e65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47109 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045397:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045420:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045431:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045445:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045452:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045459:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045556:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83800/0x9403f4af875f7e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045580:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83800/0x9403f4af875f7e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045587:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83800/0x9403f4af875f7e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402472.045613:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789402472.045617:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402472.045653:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83800/0x9403f4af875f7e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045674:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045681:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045688:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045694:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402472.045698:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045705:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045722:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:0.0:1789402472.045725:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402472.045730:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045745:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045759:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045765:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045771:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045776:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402472.045779:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045785:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.045792:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c6c3a3ee00) 00010000:00010000:0.0:1789402472.045794:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402472.045796:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.046155:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.046191:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7e65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47109 expref: 12 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.046205:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83800/0x9403f4af875f7e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47109 expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.046219:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402472.046222:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789402472.046224:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83800, rc 0) 00000100:00100000:0.0:1789402472.046293:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+11:10291:x1876324199197184:12345-192.168.203.8@tcp:101:bash.0 Request processed in 1042us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402472.046301:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:1.0:1789402472.062298:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402472.062389:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199197440 00000100:00100000:0.0:1789402472.062399:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199197440 00000100:00100000:0.0:1789402472.062458:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 40 00000100:00100000:0.0:1789402472.062467:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+11:10291:x1876324199197440:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402472.062488:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402472.062508:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7e81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47110 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.062628:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.062644:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.062655:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.062718:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.062726:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.062751:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789402472.063524:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789402472.063697:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.063708:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.063716:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789402472.063723:0:5844:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023256130 00000004:00020000:0.0:1789402472.074545:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023256130 00010000:00010000:0.0:1789402472.086470:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.086488:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.086497:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.086504:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402472.086509:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.086517:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.086534:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402472.086551:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402472.086557:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.086563:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7e88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402472.086581:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a49b0c1 reply state 0000000014bbaad7 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402472.086590:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789402472.086637:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f7e81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47110 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.086653:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47110 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.086661:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:0.0:1789402472.086663:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789402472.086666:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83000, rc 0) 00000100:00100000:0.0:1789402472.086741:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:10291:x1876324199197440:12345-192.168.203.8@tcp:101:bash.0 Request processed in 24274us (24451us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789402472.086750:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 40 00010000:00010000:3.0:1789402472.092034:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.092052:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.092060:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.092067:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402472.092073:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.092081:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.092117:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c3a3ee00) 00010000:00010000:3.0:1789402472.092120:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402472.092125:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.092132:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f7e8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402472.128976:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.129139:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199197568 00000100:00100000:3.0:1789402472.129150:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199197568 00000100:00100000:3.0:1789402472.129199:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:3.0:1789402472.129206:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876324199197568:12345-192.168.203.8@tcp:8:bash.0 00010000:00080000:3.0:1789402472.129237:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:3.0:1789402472.129269:0:6691:0:(genops.c:1384:class_connect()) connect: client 4785302d-2648-4148-8042-c10a24a5dd29, cookie 0x9403f4af875f7ea4 00002000:00100000:3.0:1789402472.129280:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4785302d-2648-4148-8042-c10a24a5dd29/ffff93c6c74cc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789402472.129304:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789402472.129607:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789402472.129637:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93c6c74c9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789402472.129709:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2350:x1876324199197568:12345-192.168.203.8@tcp:8:bash.0 Request processed in 501us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402472.129717:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:2.0:1789402472.131890:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402472.131974:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199197696 00000100:00100000:1.0:1789402472.131984:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199197696 00000100:00100000:1.0:1789402472.132055:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:1.0:1789402472.132066:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:0:x1876324199197696:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:1.0:1789402472.132083:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402472.132106:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47117 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402472.132134:0:8217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402472.132153:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1789402472.132158:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402472.132166:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47117 expref: 7 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.132185:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47117 expref: 7 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.132199:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e000, rc 0) 00000100:00100000:1.0:1789402472.132252:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:0:x1876324199197696:12345-192.168.203.8@tcp:101:bash.0 Request processed in 188us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402472.132258:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00080000:2.0:1789402472.132733:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402472.144394:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.144724:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199197824 00000100:00100000:3.0:1789402472.144734:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199197824 00000100:00100000:3.0:1789402472.144795:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:3.0:1789402472.144806:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:10291:x1876324199197824:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:3.0:1789402472.144824:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402472.144850:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4711e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.144884:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47117 expref: 8 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.144893:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402472.144897:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402472.144902:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.144944:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47117 expref: 8 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.144960:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47117 expref: 8 pid: 8217 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402472.144973:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1876324224400384:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402472.145221:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789402472.157836:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.158013:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1876324224400384:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402472.158053:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.158074:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d600, rc 0) 00000100:00100000:3.0:1789402472.158132:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+8:10291:x1876324199197824:12345-192.168.203.8@tcp:101:bash.0 Request processed in 13329us (13747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402472.158160:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:2.0:1789402472.158445:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199197952 00000100:00100000:2.0:1789402472.158453:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199197952 00010000:00010000:2.0:1789402472.158485:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47117 expref: 8 pid: 8217 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402472.158528:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 35 00000100:00100000:2.0:1789402472.158537:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199197952:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402472.158560:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402472.158583:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47117 expref: 8 pid: 8217 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.158595:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47117 expref: 8 pid: 8217 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.158619:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000398577a/0x9403f4af875f7eab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47117 expref: 8 pid: 8217 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.158634:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402472.158639:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402472.158647:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.158657:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.158688:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402472.158702:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1876324224400512:192.168.203.8@tcp:105: 00000100:00100000:2.0:1789402472.158773:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e61b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789402472.162902:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789402472.162924:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224400640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402472.163007:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402472.163453:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224400640 00000100:00100000:3.0:1789402472.163462:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224400640 00000100:00100000:3.0:1789402472.164328:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789402472.164360:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224400640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402472.164387:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402472.164464:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224400640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402472.164471:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789402472.164531:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224400640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402472.164977:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402472.165107:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199198208 00000100:00100000:2.0:1789402472.165114:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199198208 00000100:00100000:2.0:1789402472.165157:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:2.0:1789402472.165166:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+13:10291:x1876324199198208:12345-192.168.203.8@tcp:35:bash.0 00000100:00100000:2.0:1789402472.165495:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+14:10291:x1876324199198208:12345-192.168.203.8@tcp:35:bash.0 Request processed in 330us (521us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789402472.165502:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:0.0:1789402472.165656:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1876324224400512:192.168.203.8@tcp:105: 00010000:00010000:0.0:1789402472.165672:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402472.165692:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199197952:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 7156us (7865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402472.165699:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 35 00000100:00100000:1.0:1789402472.343481:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.343632:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199198464 00000100:00100000:3.0:1789402472.343641:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199198464 00000100:00100000:3.0:1789402472.343714:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:3.0:1789402472.343727:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+14:10301:x1876324199198464:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:3.0:1789402472.343751:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402472.343771:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47125 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402472.343878:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789402472.344007:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7eb9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47125 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.344019:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:3.0:1789402472.344022:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789402472.344027:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47125 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.344058:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90da00, rc 0) 00000100:00100000:3.0:1789402472.344117:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+15:10301:x1876324199198464:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 393us (646us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789402472.344124:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:2.0:1789402472.355229:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402472.355395:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199198720 00000100:00100000:0.0:1789402472.355419:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199198720 00000100:00100000:0.0:1789402472.355495:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:0.0:1789402472.355506:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+15:10301:x1876324199198720:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:0.0:1789402472.355744:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+16:10301:x1876324199198720:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 239us (530us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789402472.355751:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:1.0:1789402472.465277:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.472808:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199198848 00000100:00100000:3.0:1789402472.472832:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199198848 00000100:00100000:3.0:1789402472.473134:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 42 00000100:00100000:3.0:1789402472.473151:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+16:10307:x1876324199198848:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:3.0:1789402472.473188:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402472.473218:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7ec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4712c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.473323:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7ece lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.473369:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.473385:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402472.473440:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789402472.473445:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402472.473467:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.473499:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7ec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4712c expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.473547:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4712c expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.473556:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:3.0:1789402472.473560:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789402472.473564:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c000, rc 0) 00000100:00100000:3.0:1789402472.473665:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+17:10307:x1876324199198848:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 518us (8404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402472.482009:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 42 00000100:00100000:2.0:1789402472.497512:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.497629:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199199104 00000100:00100000:3.0:1789402472.497643:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199199104 00000100:00100000:3.0:1789402472.497708:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 43 00000100:00100000:3.0:1789402472.497719:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+17:10307:x1876324199199104:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:3.0:1789402472.497748:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402472.497901:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7ed5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47133 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.498049:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f7edc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.498068:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f7edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.498082:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f7edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402472.498096:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000004:00020000:3.0:1789402472.498125:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133187 00010000:00010000:3.0:1789402472.498282:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f7ed5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47133 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.498305:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f7edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47133 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.498315:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:3.0:1789402472.498319:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402472.498323:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90dc00, rc 0) 00000100:00100000:1.0:1789402472.498713:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+19:10307:x1876324199199104:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 992us (1211us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789402472.498723:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 43 00000100:00100000:2.0:1789402472.502628:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402472.502803:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199199360 00000100:00100000:0.0:1789402472.502816:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199199360 00000100:00100000:0.0:1789402472.502894:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:0.0:1789402472.502907:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+19:10307:x1876324199199360:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402472.502952:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402472.502983:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7eea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4713a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.503115:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7ef1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.503134:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7ef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.503149:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7ef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402472.503164:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000004:00020000:0.0:1789402472.503174:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2268287991810 00010000:00010000:0.0:1789402472.503337:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7eea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4713a expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.503441:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7ef1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4713a expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.503451:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:0.0:1789402472.503454:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789402472.503459:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:0.0:1789402472.503539:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:10307:x1876324199199360:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 634us (934us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789402472.503547:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:2.0:1789402472.506851:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402472.507042:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199199488 00000100:00100000:0.0:1789402472.507055:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199199488 00000100:00100000:0.0:1789402472.507132:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:0.0:1789402472.507144:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+21:2351:x1876324199199488:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402472.507162:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402472.507194:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f7edc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47133 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.507217:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:0.0:1789402472.507223:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402472.507296:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+20:2351:x1876324199199488:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 153us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402472.507303:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:2.0:1789402472.511236:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.511337:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199199616 00000100:00100000:3.0:1789402472.511392:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199199616 00000100:00100000:3.0:1789402472.511471:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:3.0:1789402472.511483:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199199616:12345-192.168.203.8@tcp:1:lfs.0 00010000:00010000:3.0:1789402472.511544:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.511572:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.511581:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402472.511586:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402472.511592:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.511748:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.511915:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402472.511933:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1876324224400768:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402472.512097:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995300 going to sleep for 11 seconds 00000100:00100000:3.0:1789402472.527245:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1876324224400768:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402472.527296:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402472.528527:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402472.531931:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199199744 00000100:00100000:1.0:1789402472.531947:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199199744 00002000:00100000:1.0:1789402472.532000:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93c6ff631880 x1876324199199744/t0(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:388/0 lens 504/0 e 0 to 0 dl 1789402483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789402472.532011:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ff631880 with x1876324199199744 ext(0->12) 00010000:00010000:1.0:1789402472.532019:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 8 pid: 6691 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.539660:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 8 pid: 6691 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402472.539679:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c6ff631880 00000100:00100000:1.0:1789402472.539727:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:1.0:1789402472.539747:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199199744:12345-192.168.203.8@tcp:4:lfs.0 00000001:00100000:2.0:1789402472.618171:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000100:00100000:2.0:1789402472.716297:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:2352:x1876324199199744:12345-192.168.203.8@tcp:4:lfs.0 Request processed in 176542us (187760us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789402472.716323:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 0 00002000:00100000:2.0:1789402472.716364:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93c6ff631880 x1876324199199744/t4294967299(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:388/0 lens 504/448 e 0 to 0 dl 1789402483 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789402472.716377:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ff631880 with x1876324199199744 ext(0->12) 00010000:00010000:2.0:1789402472.716391:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 9 pid: 6691 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.716445:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 9 pid: 6691 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789402472.716455:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c6ff631880 00000001:00080000:2.0:1789402472.716513:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1789402472.724507:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.724756:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199199872 00000100:00100000:3.0:1789402472.724769:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199199872 00010000:00010000:3.0:1789402472.724826:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402472.724880:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 36 00000100:00100000:3.0:1789402472.724892:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199199872:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402472.724912:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789402472.724950:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789402472.724954:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789402471 00002000:00010000:3.0:1789402472.724957:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789402471 00002000:00010000:3.0:1789402472.724960:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789402471 00002000:00010000:3.0:1789402472.724962:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1789402472.724968:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.725020:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.725052:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7eb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4711e expref: 7 pid: 6691 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.725073:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402472.725079:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402472.725086:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.725096:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.725141:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402472.725188:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.725201:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402472.725215:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199199872:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 324us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402472.725231:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 36 00010000:00010000:1.0:1789402472.725255:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.725265:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.725275:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.725283:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90da00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402472.725287:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.725297:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.725311:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.725320:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c697c07b/0x9403f4af875f7eff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402472.725426:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199199616:12345-192.168.203.8@tcp:1:lfs.0 Request processed in 213946us (214206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402472.725434:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:1.0:1789402472.732674:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402472.733677:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199200128 00000100:00100000:0.0:1789402472.733693:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199200128 00000100:00100000:0.0:1789402472.733770:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:0.0:1789402472.733782:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+20:10307:x1876324199200128:12345-192.168.203.8@tcp:35:lfs.0 00000004:00010000:0.0:1789402472.733883:0:5848:0:(mdt_open.c:2006:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7ef1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4713a expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789402472.734529:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789402472.734599:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789402472.737778:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789402472.737901:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.737930:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47110 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.737940:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.737999:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47110 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402472.738462:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47110 expref: 24 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402472.738771:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff632300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876324224400896:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402472.738977:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d139ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789402472.744709:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402472.745515:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199200256 00000100:00100000:1.0:1789402472.745528:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199200256 00000100:00100000:0.0:1789402472.745549:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff632300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876324224400896:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402472.745583:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47110 expref: 25 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.745586:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402472.745648:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 37 00000100:00100000:1.0:1789402472.745659:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+25:2351:x1876324199200256:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402472.745678:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402472.745687:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47110 expref: 25 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.745702:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47110 expref: 25 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.745730:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47110 expref: 25 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.745750:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:1.0:1789402472.745756:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.745767:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.745777:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.745814:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402472.745874:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.745883:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402472.745904:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+24:2351:x1876324199200256:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 244us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402472.745914:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 37 00000001:00080000:0.0:1789402472.746231:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789402472.746883:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789402472.747056:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224401024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789402472.750905:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402472.751106:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224401024 00000100:00100000:3.0:1789402472.751122:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224401024 00000100:00100000:3.0:1789402472.751238:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789402472.751250:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876324224401024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789402472.751434:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876324224401024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 186us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402472.751442:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402472.754959:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9dd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402472.755008:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224401024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789402472.756990:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789402472.757094:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224401152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789402472.757169:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402472.757266:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789402472.760827:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224401152 00000100:00100000:0.0:1789402472.760842:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224401152 00000100:00100000:0.0:1789402472.760908:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789402472.760919:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876324224401152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789402472.761218:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1876324224401152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 300us (4048us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789402472.761226:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402472.761370:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224401152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789402472.761446:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789402472.761489:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.761499:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.761508:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.761514:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402472.761518:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.761526:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.761541:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:1.0:1789402472.761544:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789402472.761561:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.761567:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f7f06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789402472.761887:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789402472.762092:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789402472.762104:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377910759663ns, next at 378910757692ns, rc = 0 00000001:00080000:1.0:1789402472.762110:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789402472.762144:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:1.0:1789402472.762147:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789402472.762154:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7ef1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4713a expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402472.762260:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+27:10307:x1876324199200128:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 28479us (29603us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789402472.762268:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 8 00000020:00080000:1.0:1789402472.762272:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789402472.768434:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402472.768495:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199200384 00000100:00100000:1.0:1789402472.768509:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199200384 00000100:00100000:1.0:1789402472.768566:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:1.0:1789402472.768586:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+27:10307:x1876324199200384:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402472.768609:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402472.768631:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7f0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47141 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.768688:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7f0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47141 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.768734:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7f0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47141 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.768756:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:1.0:1789402472.768759:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789402472.768762:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e000, rc 0) 00000100:00100000:1.0:1789402472.768822:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+28:10307:x1876324199200384:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 238us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402472.768829:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:2.0:1789402472.774204:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402472.775684:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199200640 00000100:00100000:1.0:1789402472.775709:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199200640 00000100:00100000:1.0:1789402472.775778:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:1.0:1789402472.775789:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+28:10307:x1876324199200640:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:1.0:1789402472.776007:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+29:10307:x1876324199200640:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 219us (1816us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789402472.776015:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:2.0:1789402472.908573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402472.908699:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199200896 00000100:00100000:0.0:1789402472.908724:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199200896 00000100:00100000:0.0:1789402472.908803:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 46 00000100:00100000:0.0:1789402472.908817:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+29:10317:x1876324199200896:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402472.908870:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402472.908900:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47148 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402472.909020:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789402472.909181:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47148 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.909198:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:0.0:1789402472.909201:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789402472.909208:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47148 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.909223:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:0.0:1789402472.909304:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+30:10317:x1876324199200896:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 490us (746us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789402472.909311:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 46 00000100:00100000:2.0:1789402472.915494:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402472.915607:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199201024 00000100:00100000:1.0:1789402472.915628:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199201024 00000100:00100000:1.0:1789402472.915718:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:1.0:1789402472.915728:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+30:10317:x1876324199201024:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:1.0:1789402472.915826:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.915844:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.915877:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.915894:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.915901:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.915907:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.915999:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916008:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916015:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789402472.916059:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916072:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916078:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916086:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916101:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402472.916105:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916112:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916123:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:1.0:1789402472.916126:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402472.916131:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916136:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f7f22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916151:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916157:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916162:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916167:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83f800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402472.916170:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916176:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916194:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6d8cd8700) 00010000:00010000:1.0:1789402472.916196:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402472.916199:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916205:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f7f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916220:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916227:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916232:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916237:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402472.916240:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916246:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916253:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:1.0:1789402472.916255:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402472.916258:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402472.916264:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f7f30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402472.916411:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+30:10317:x1876324199201024:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 683us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402472.916419:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:2.0:1789402472.919161:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402472.919871:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199201280 00000100:00100000:1.0:1789402472.919882:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199201280 00000100:00100000:1.0:1789402472.919945:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:1.0:1789402472.919955:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+30:10317:x1876324199201280:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:1.0:1789402472.920170:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+31:10317:x1876324199201280:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 216us (1016us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789402472.920178:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00010000:00010000:1.0:1789402472.930567:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402472.982187:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.982439:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199201536 00000100:00100000:3.0:1789402472.982451:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199201536 00000100:00100000:3.0:1789402472.982523:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:3.0:1789402472.982535:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+31:10320:x1876324199201536:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:3.0:1789402472.982567:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402472.982597:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4714f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.982690:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.982708:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.982722:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.982748:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.982756:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.982763:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.982906:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.982915:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983061:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789402472.983069:0:5845:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:3.0:1789402472.983076:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000004:00020000:3.0:1789402472.983086:0:5845:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:3.0:1789402472.983214:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983222:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983229:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983235:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402472.983240:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983247:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983260:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:3.0:1789402472.983263:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402472.983269:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983275:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7f3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983291:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983306:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983311:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983316:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402472.983319:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983325:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983332:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6d2ca6c00) 00010000:00010000:3.0:1789402472.983335:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402472.983338:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983426:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7f45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983482:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4714f expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983497:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4714f expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402472.983505:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402472.983507:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402472.983515:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90cc00, rc 0) 00000100:00100000:3.0:1789402472.983596:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+33:10320:x1876324199201536:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1063us (1425us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789402472.983607:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:2.0:1789402472.990619:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402472.990754:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199201664 00000100:00100000:0.0:1789402472.990764:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199201664 00000100:00100000:0.0:1789402472.990826:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:0.0:1789402472.990837:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+33:10320:x1876324199201664:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:0.0:1789402472.990915:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.990950:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.990966:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.991016:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.991024:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.991032:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.991039:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402472.991044:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.991053:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.991068:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402472.991072:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789402472.991077:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402472.991085:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402472.991180:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+33:10320:x1876324199201664:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 343us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402472.991432:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:1.0:1789402472.992074:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402472.992111:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402472.992317:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199201792 00000100:00100000:3.0:1789402472.992326:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199201792 00000100:00100000:3.0:1789402472.992408:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 287 00000100:00100000:3.0:1789402472.992419:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199201792:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402472.992479:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2354:x1876324199201792:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 62us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402472.992486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 287 00000100:00100000:0.0:1789402472.992940:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199201920 00000100:00100000:0.0:1789402472.992946:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199201920 00000100:00100000:0.0:1789402472.992994:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 134 00000100:00100000:0.0:1789402472.993014:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199201920:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402472.993061:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2354:x1876324199201920:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 49us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402472.993068:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 134 00000100:00080000:2.0:1789402472.993524:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402473.004645:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402473.004699:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199202176 00000100:00100000:0.0:1789402473.004710:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199202176 00000100:00100000:0.0:1789402473.004799:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:0.0:1789402473.004812:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+33:10320:x1876324199202176:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:0.0:1789402473.005049:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+34:10320:x1876324199202176:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 239us (412us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789402473.005057:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00080000:0.0:1789402473.005089:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402473.307599:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402473.310120:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199202432 00000100:00100000:0.0:1789402473.310143:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199202432 00000100:00100000:0.0:1789402473.310222:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 50 00000100:00100000:0.0:1789402473.310234:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+34:10351:x1876324199202432:12345-192.168.203.8@tcp:101:cat.0 00010000:00010000:0.0:1789402473.310261:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402473.310286:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47156 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.310451:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.310468:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.310480:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402473.310508:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000004:00020000:0.0:1789402473.310517:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199065198593 00010000:00010000:0.0:1789402473.335722:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47156 expref: 37 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.335750:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47156 expref: 36 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.335759:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402473.335762:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789402473.335766:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83000, rc 0) 00000100:00100000:0.0:1789402473.335893:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+36:10351:x1876324199202432:12345-192.168.203.8@tcp:101:cat.0 Request processed in 25660us (28303us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789402473.335901:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 50 00000100:00100000:1.0:1789402473.350554:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402473.350654:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199202560 00000100:00100000:0.0:1789402473.350664:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199202560 00000100:00100000:0.0:1789402473.350732:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:0.0:1789402473.350743:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+36:2352:x1876324199202560:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402473.350760:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402473.350783:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7f68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47156 expref: 36 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.350802:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402473.350808:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402473.350861:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+35:2352:x1876324199202560:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 120us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402473.350883:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:1.0:1789402473.354738:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402473.354827:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199202816 00000100:00100000:0.0:1789402473.354838:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199202816 00000100:00100000:0.0:1789402473.354894:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:0.0:1789402473.354906:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+35:10351:x1876324199202816:12345-192.168.203.8@tcp:35:cat.0 00000100:00100000:0.0:1789402473.355298:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+36:10351:x1876324199202816:12345-192.168.203.8@tcp:35:cat.0 Request processed in 392us (567us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789402473.355306:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:1.0:1789402473.427031:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402473.427332:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199203072 00000100:00100000:0.0:1789402473.427380:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199203072 00000100:00100000:0.0:1789402473.427474:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 51 00000100:00100000:0.0:1789402473.427486:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+36:10357:x1876324199203072:12345-192.168.203.8@tcp:101:dd.0 00010000:00010000:0.0:1789402473.427512:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402473.427516:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789402473.427544:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f7ece lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4712c expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.427568:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402473.427574:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402473.427590:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7f76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4715d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.427692:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.427707:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4714f expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.427729:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.428006:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4714f expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.428021:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4714f expref: 36 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402473.428036:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224401280:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402473.428123:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9dd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402473.433640:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402473.433750:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224401280:192.168.203.8@tcp:104: 00010000:00010000:0.0:1789402473.433780:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402473.433849:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199203200 00000100:00100000:3.0:1789402473.433868:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199203200 00010000:00010000:3.0:1789402473.433935:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4714f expref: 37 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402473.433983:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 38 00000100:00100000:3.0:1789402473.433995:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+37:2352:x1876324199203200:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402473.434015:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402473.434035:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4714f expref: 37 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.434049:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4714f expref: 37 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.434082:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4714f expref: 37 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.434123:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402473.434128:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.434138:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.434146:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.434181:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402473.434265:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+36:2352:x1876324199203200:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 272us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402473.434273:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 38 00010000:00010000:0.0:1789402473.435214:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.435231:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402473.435255:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000004:00020000:0.0:1789402473.435275:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:0.0:1789402473.435476:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7f76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4715d expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.435498:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4715d expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.435527:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402473.435530:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789402473.435534:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:0.0:1789402473.435611:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+36:10357:x1876324199203072:12345-192.168.203.8@tcp:101:dd.0 Request processed in 8126us (8588us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789402473.435620:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 51 00000100:00100000:1.0:1789402473.439705:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402473.439963:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199203456 00000100:00100000:3.0:1789402473.439979:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199203456 00000100:00100000:3.0:1789402473.440314:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 52 00000100:00100000:3.0:1789402473.440329:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+36:10357:x1876324199203456:12345-192.168.203.8@tcp:36:dd.0 00010000:00010000:3.0:1789402473.440790:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.440814:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.440828:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789402473.440891:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1789402473.440935:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e55c8feb reply state 00000000e5bdb616 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402473.440956:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789402473.441102:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+39:10357:x1876324199203456:12345-192.168.203.8@tcp:36:dd.0 Request processed in 775us (1402us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789402473.441110:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 52 00000020:00080000:3.0:1789402473.441116:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789402473.444838:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.444858:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.444866:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.444873:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402473.444878:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.444887:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.444907:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402473.444910:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402473.444916:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.444975:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789402473.770425:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000004:00080000:3.0:1789402473.770496:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789402473.770520:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c6eed1e540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789402473.770525:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e0a4d700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c6eed1ea80 00000020:00080000:3.0:1789402473.770528:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e0a4df00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c6fb61a000 00000001:00080000:3.0:1789402473.770563:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000020:00080000:3.0:1789402473.770731:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789402473.770881:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789402473.770908:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224401408:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789402473.771012:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402473.771116:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224401408 00000100:00100000:3.0:1789402473.771127:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224401408 00000100:00100000:3.0:1789402473.771196:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789402473.771208:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224401408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789402473.771240:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789402473.771282:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa81d67, atime: 0x6aa81d67, ctime: 0x6aa81d67, blocks: 0xb 00010000:00010000:3.0:1789402473.771292:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.771312:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1789402473.771317:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402473.771324:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.771378:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.771401:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.771421:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.771444:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789402473.772015:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224401408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 807us (1001us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789402473.772024:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789402473.772057:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789402473.772072:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402473.772078:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.772088:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402473.772094:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.772105:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.772127:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.772136:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032210281/0x9403f4af875f7f92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.772174:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402473.772176:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402473.772178:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789402473.772225:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6fb1f9880/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789402473.772233:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224401408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789402473.784279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402473.784382:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199203584 00000100:00100000:3.0:1789402473.784405:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199203584 00000100:00100000:3.0:1789402473.784484:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00100000:3.0:1789402473.784497:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+11:10371:x1876324199203584:12345-192.168.203.8@tcp:101:stat.0 00010000:00010000:3.0:1789402473.784530:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402473.784567:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47164 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.784655:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.784674:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.784687:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.784703:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.784710:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.784741:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.785085:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.785100:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4715d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.785110:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.785151:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4715d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.785169:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4715d expref: 12 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402473.785185:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224401536:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402473.785307:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e62703c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402473.789256:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402473.790315:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199203840 00000100:00100000:0.0:1789402473.790333:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199203840 00000100:00100000:0.0:1789402473.790463:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:0.0:1789402473.790475:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+13:5591:x1876324199203840:12345-192.168.203.8@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789402473.791180:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224401536:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402473.791232:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402473.792188:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:5591:x1876324199203840:12345-192.168.203.8@tcp:35:ldlm_bl.0 Request processed in 1706us (2940us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789402473.792202:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:1.0:1789402473.803021:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402473.808812:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199203968 00000100:00100000:0.0:1789402473.808835:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199203968 00010000:00010000:0.0:1789402473.808918:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4715d expref: 14 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402473.809202:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:0.0:1789402473.809214:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199203968:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402473.809234:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402473.809242:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4715d expref: 14 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.809257:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4715d expref: 14 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.809305:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7f7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4715d expref: 14 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.809325:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402473.809331:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.809385:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.809410:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.809459:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402473.809546:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809557:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402473.809624:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789402473.809629:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402473.809747:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402473.809758:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+13:2351:x1876324199203968:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 545us (6752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402473.809766:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 39 00010000:00010000:2.0:1789402473.809772:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809784:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809791:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809799:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809806:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402473.809820:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809831:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809842:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:2.0:1789402473.809845:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402473.809850:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809856:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f7fa0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809872:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809878:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809883:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809888:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402473.809892:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809898:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809905:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6d2ca6c00) 00010000:00010000:2.0:1789402473.809907:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402473.809915:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809921:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f7fa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809977:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f7f99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47164 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.809996:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47164 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402473.810005:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:2.0:1789402473.810008:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402473.810010:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c200, rc 0) 00000100:00100000:2.0:1789402473.810044:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+12:10371:x1876324199203584:12345-192.168.203.8@tcp:101:stat.0 Request processed in 25551us (25782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402473.810052:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00100000:1.0:1789402473.923948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402473.924242:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199204224 00000100:00100000:0.0:1789402473.924256:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199204224 00000100:00100000:0.0:1789402473.924335:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 54 00000100:00100000:0.0:1789402473.924402:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+12:10377:x1876324199204224:12345-192.168.203.8@tcp:36:truncate.0 00010000:00010000:0.0:1789402473.924495:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402473.924537:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f7fae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47164 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402473.924561:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402473.924567:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402473.925089:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402473.925109:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402473.925131:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789402473.925197:0:6712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789402473.925223:0:6712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067ddd28b reply state 0000000079787b01 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402473.925235:0:6712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789402473.925571:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+14:10377:x1876324199204224:12345-192.168.203.8@tcp:36:truncate.0 Request processed in 1221us (1645us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789402473.925581:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 54 00000020:00080000:1.0:1789402473.925597:0:6712:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789402473.929066:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.929087:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.929114:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.929120:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402473.929125:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.929134:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.929153:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402473.929156:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402473.929162:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402473.929169:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f7fb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402473.954649:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402474.083041:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402474.083464:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199204352 00000100:00100000:0.0:1789402474.083494:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199204352 00000100:00100000:0.0:1789402474.083576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 55 00000100:00100000:0.0:1789402474.083590:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+13:10391:x1876324199204352:12345-192.168.203.8@tcp:101:stat.0 00010000:00010000:0.0:1789402474.083625:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402474.083657:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7fbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4716b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.083748:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.083766:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.083779:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.083795:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.083802:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.083809:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084165:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084176:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084196:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402474.084243:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789402474.084249:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402474.084278:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084292:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084301:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084309:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084316:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084323:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402474.084328:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084337:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084408:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402474.084412:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402474.084418:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084435:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f7fc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084451:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084457:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084463:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084468:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402474.084471:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084477:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084484:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402474.084487:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402474.084490:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084495:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084534:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7fbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4716b expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084549:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4716b expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.084563:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402474.084565:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789402474.084568:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83600, rc 0) 00000100:00100000:0.0:1789402474.084670:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:10391:x1876324199204352:12345-192.168.203.8@tcp:101:stat.0 Request processed in 1082us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402474.084680:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 55 00000100:00100000:1.0:1789402474.236169:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402474.236577:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199204608 00000100:00100000:3.0:1789402474.236589:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199204608 00000100:00100000:3.0:1789402474.236668:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 56 00000100:00100000:3.0:1789402474.236690:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+14:10401:x1876324199204608:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:3.0:1789402474.236723:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402474.236752:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47172 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402474.236874:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789402474.237029:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7fd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47172 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.237068:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:3.0:1789402474.237072:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789402474.237079:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47172 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.237096:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90de00, rc 0) 00000100:00100000:3.0:1789402474.237183:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+15:10401:x1876324199204608:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 497us (1030us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789402474.237192:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 56 00000100:00100000:1.0:1789402474.248573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402474.248794:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199204864 00000100:00100000:0.0:1789402474.248808:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199204864 00000100:00100000:0.0:1789402474.248889:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:0.0:1789402474.248901:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+15:10401:x1876324199204864:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:0.0:1789402474.249567:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+16:10401:x1876324199204864:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 663us (1006us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789402474.249578:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:2.0:1789402474.355223:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402474.355404:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199205120 00000100:00100000:0.0:1789402474.355420:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199205120 00000100:00100000:0.0:1789402474.355620:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 57 00000100:00100000:0.0:1789402474.355634:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+16:10407:x1876324199205120:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402474.355672:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402474.355701:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7fe6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47179 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.355862:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.355882:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4716b expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.355909:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.355965:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4716b expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.355982:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4716b expref: 17 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402474.355998:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224401664:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402474.356134:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789402474.365522:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402474.365720:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199205248 00000100:00100000:2.0:1789402474.365733:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199205248 00010000:00010000:2.0:1789402474.365795:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4716b expref: 18 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402474.365912:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 40 00000100:00100000:2.0:1789402474.365925:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+18:2351:x1876324199205248:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402474.365945:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402474.365954:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4716b expref: 18 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.365996:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4716b expref: 18 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.366187:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:2.0:1789402474.366195:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.366207:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.366217:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f7fd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4716b expref: 18 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.366218:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402474.366252:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224401664:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402474.366253:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402474.366289:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.366302:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.366310:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402474.366329:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+17:2351:x1876324199205248:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 405us (886us total) trans 0 rc 0/0 00000004:00200000:0.0:1789402474.366337:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:2.0:1789402474.366338:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 40 00000004:00020000:0.0:1789402474.366418:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:0.0:1789402474.367319:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f7fe6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47179 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.367399:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47179 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.367409:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402474.367412:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789402474.367414:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83c00, rc 0) 00000100:00100000:0.0:1789402474.367601:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+17:10407:x1876324199205120:12345-192.168.203.8@tcp:101:bash.0 Request processed in 11968us (12390us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789402474.367611:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 57 00000100:00100000:1.0:1789402474.371651:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402474.371752:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199205504 00000100:00100000:3.0:1789402474.371767:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199205504 00000100:00100000:3.0:1789402474.371845:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 58 00000100:00100000:3.0:1789402474.372015:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+17:10407:x1876324199205504:12345-192.168.203.8@tcp:36:bash.0 00010000:00010000:3.0:1789402474.372729:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.372755:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.372770:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789402474.372838:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789402474.373003:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac334725 reply state 000000009822dd51 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402474.373014:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789402474.373640:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+20:10407:x1876324199205504:12345-192.168.203.8@tcp:36:bash.0 Request processed in 1626us (2113us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789402474.373651:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 58 00000020:00080000:3.0:1789402474.373657:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789402474.384001:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.384023:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.384033:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.384076:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90de00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402474.384082:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.384092:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.384114:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402474.384117:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402474.384123:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.384131:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f7ffb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402474.384210:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402474.384531:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199205632 00000100:00100000:2.0:1789402474.384544:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199205632 00000100:00100000:2.0:1789402474.384877:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 59 00000100:00100000:2.0:1789402474.384891:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+19:10407:x1876324199205632:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:2.0:1789402474.384926:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402474.384951:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8002 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47180 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.385055:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.385091:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47179 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.385101:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.385142:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47179 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.385159:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47179 expref: 20 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402474.385176:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224401792:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402474.386077:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d139a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789402474.388110:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224401792:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402474.388154:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402474.390237:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402474.390409:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199205760 00000100:00100000:3.0:1789402474.390423:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199205760 00010000:00010000:3.0:1789402474.390498:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47179 expref: 21 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402474.390582:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:3.0:1789402474.390595:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+21:2352:x1876324199205760:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402474.390616:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402474.390625:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47179 expref: 21 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.390638:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47179 expref: 21 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.390665:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f7fed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47179 expref: 21 pid: 5844 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.390685:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402474.390691:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.390701:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.390709:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.390756:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402474.390828:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+20:2352:x1876324199205760:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 234us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402474.390837:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 41 00010000:00010000:2.0:1789402474.391491:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.391504:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402474.391565:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789402474.391570:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402474.391594:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.391652:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8002 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47180 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.391673:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47180 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.391682:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:2.0:1789402474.391685:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402474.391688:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de000, rc 0) 00000100:00100000:2.0:1789402474.391744:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+19:10407:x1876324199205632:12345-192.168.203.8@tcp:101:bash.0 Request processed in 6857us (7540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402474.391753:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 59 00000100:00100000:1.0:1789402474.401029:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402474.401306:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199206016 00000100:00100000:0.0:1789402474.401331:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199206016 00000100:00100000:0.0:1789402474.401443:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:0.0:1789402474.401463:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+19:10407:x1876324199206016:12345-192.168.203.8@tcp:35:bash.0 00000100:00100000:2.0:1789402474.402266:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+20:10407:x1876324199206016:12345-192.168.203.8@tcp:35:bash.0 Request processed in 808us (1249us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789402474.402277:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:1.0:1789402474.501276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402474.501431:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199206272 00000100:00100000:2.0:1789402474.501445:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199206272 00000100:00100000:2.0:1789402474.501528:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 60 00000100:00100000:2.0:1789402474.501542:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+20:10417:x1876324199206272:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402474.501579:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402474.501608:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47187 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402474.501741:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789402474.501903:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8010 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47187 expref: 22 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.501941:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:2.0:1789402474.501944:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789402474.501952:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47187 expref: 22 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.501970:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de800, rc 0) 00000100:00100000:2.0:1789402474.502055:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+21:10417:x1876324199206272:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 517us (794us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1789402474.502072:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 60 00000100:00100000:1.0:1789402474.511488:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402474.511643:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199206400 00000100:00100000:0.0:1789402474.511657:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199206400 00000100:00100000:0.0:1789402474.511883:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 61 00000100:00100000:0.0:1789402474.511897:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:10417:x1876324199206400:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:0.0:1789402474.512015:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512036:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512051:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512070:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512099:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512107:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512538:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512550:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512558:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402474.512614:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512631:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512639:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512648:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512655:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402474.512660:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512668:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512691:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402474.512694:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402474.512721:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512729:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f801e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512743:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512750:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512756:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512762:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402474.512765:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512771:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512778:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402474.512781:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402474.512783:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512790:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512819:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512826:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512832:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512838:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402474.512841:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512847:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512854:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402474.512857:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402474.512860:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.512865:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f802c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402474.512961:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:10417:x1876324199206400:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 1064us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402474.512970:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 61 00000100:00100000:1.0:1789402474.516304:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402474.516431:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199206656 00000100:00100000:0.0:1789402474.516443:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199206656 00000100:00100000:0.0:1789402474.516512:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:0.0:1789402474.516543:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+21:10417:x1876324199206656:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:0.0:1789402474.516992:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+22:10417:x1876324199206656:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 451us (702us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789402474.517001:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:1.0:1789402474.562020:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402474.562876:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199206912 00000100:00100000:2.0:1789402474.562892:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199206912 00000100:00100000:2.0:1789402474.562992:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 62 00000100:00100000:2.0:1789402474.563004:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+22:10420:x1876324199206912:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402474.563038:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402474.563112:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4718e expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.563212:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.563230:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.563245:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.563263:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.563287:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.563295:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.563765:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.563779:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.563787:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789402474.563795:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:2.0:1789402474.580023:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00020000:2.0:1789402474.580114:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:2.0:1789402474.580240:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580251:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580259:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580266:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402474.580270:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580278:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580310:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:2.0:1789402474.580312:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402474.580318:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580324:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f803a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580541:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580549:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580555:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580562:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402474.580565:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580571:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580580:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c30f8700) 00010000:00010000:2.0:1789402474.580582:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402474.580586:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580591:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580678:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4718e expref: 25 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580696:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4718e expref: 24 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.580704:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:2.0:1789402474.580706:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402474.580709:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de400, rc 0) 00000100:00100000:2.0:1789402474.580779:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+24:10420:x1876324199206912:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 17776us (18773us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789402474.580788:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 62 00000100:00100000:1.0:1789402474.591669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402474.592029:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402474.592827:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199207168 00000100:00100000:0.0:1789402474.592841:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199207168 00000100:00100000:0.0:1789402474.592944:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:0.0:1789402474.592956:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+24:2352:x1876324199207168:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402474.592975:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402474.593008:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4718e expref: 24 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.593033:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:0.0:1789402474.593040:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402474.593135:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+23:2352:x1876324199207168:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 181us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402474.593145:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:3.0:1789402474.593758:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199207040 00000100:00100000:3.0:1789402474.593908:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199207040 00000100:00100000:3.0:1789402474.593960:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 63 00000100:00100000:3.0:1789402474.593976:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+23:10420:x1876324199207040:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:3.0:1789402474.594371:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.594406:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.594422:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.594637:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.594646:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.594654:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.594661:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90de00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402474.594667:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.594676:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.594688:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402474.594692:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789402474.594698:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.594719:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402474.594981:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+23:10420:x1876324199207040:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 1008us (3323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402474.594992:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 63 00000100:00100000:1.0:1789402474.603641:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402474.610380:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199207424 00000100:00100000:0.0:1789402474.610412:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199207424 00000100:00100000:0.0:1789402474.610504:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:0.0:1789402474.610518:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+23:10420:x1876324199207424:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:0.0:1789402474.610866:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+24:10420:x1876324199207424:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 350us (7240us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789402474.610876:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:1.0:1789402474.770335:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402474.770701:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199207680 00000100:00100000:3.0:1789402474.770716:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199207680 00000100:00100000:3.0:1789402474.770793:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 64 00000100:00100000:3.0:1789402474.770805:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+24:10438:x1876324199207680:12345-192.168.203.8@tcp:101:cat.0 00010000:00010000:3.0:1789402474.770841:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402474.770871:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f805d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47195 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.771025:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f8064 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.771043:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f8064 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.771675:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f8064 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402474.771699:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00020000:3.0:1789402474.771711:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602069505 00010000:00010000:3.0:1789402474.771897:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f805d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47195 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.771935:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f8064 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47195 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.771965:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402474.771968:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789402474.771972:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d200, rc 0) 00000100:00100000:3.0:1789402474.772696:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+26:10438:x1876324199207680:12345-192.168.203.8@tcp:101:cat.0 Request processed in 1885us (2369us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789402474.772709:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 64 00000100:00100000:3.0:1789402474.798664:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402474.798930:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199207808 00000100:00100000:2.0:1789402474.798944:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199207808 00000100:00100000:2.0:1789402474.799076:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 65 00000100:00100000:2.0:1789402474.799089:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+26:10439:x1876324199207808:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402474.799125:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402474.799212:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4719c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.799308:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.799327:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.799397:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402474.799479:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789402474.799483:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402474.799509:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.799545:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4719c expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.799567:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4719c expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.799576:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:2.0:1789402474.799579:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789402474.799584:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df600, rc 0) 00000100:00100000:2.0:1789402474.799669:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+27:10439:x1876324199207808:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 584us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402474.799677:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 65 00000100:00100000:1.0:1789402474.804985:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402474.805094:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199208192 00000100:00100000:2.0:1789402474.805108:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199208192 00000100:00100000:2.0:1789402474.805179:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:2.0:1789402474.805191:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+27:10439:x1876324199208192:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:2.0:1789402474.805675:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+28:10439:x1876324199208192:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 484us (704us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789402474.805684:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:1.0:1789402474.810120:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402474.810278:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199208320 00000100:00100000:3.0:1789402474.810292:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199208320 00000100:00100000:3.0:1789402474.810431:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:3.0:1789402474.810445:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+28:10439:x1876324199208320:12345-192.168.203.8@tcp:103:lfs.0 00010000:00010000:3.0:1789402474.810466:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789402474.810503:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8009 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47180 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.810531:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f8064 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47195 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.810544:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f7f0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47141 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402474.810556:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d8cd8a00) 00010000:00010000:3.0:1789402474.810573:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402474.810651:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+25:10439:x1876324199208320:12345-192.168.203.8@tcp:103:lfs.0 Request processed in 208us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402474.810682:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:3.0:1789402474.821895:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402474.822139:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199208448 00000100:00100000:2.0:1789402474.822153:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199208448 00000100:00100000:2.0:1789402474.822250:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 66 00000100:00100000:2.0:1789402474.822264:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+25:10439:x1876324199208448:12345-192.168.203.8@tcp:58:lfs.0 00010000:00010000:2.0:1789402474.822482:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.822504:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402474.822520:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789402474.823259:0:6712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789402474.823507:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789402474.823586:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789402474.823740:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+25:10439:x1876324199208448:12345-192.168.203.8@tcp:58:lfs.0 Request processed in 1473us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402474.823753:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 66 00000100:00100000:1.0:1789402474.855297:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402474.855798:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199208576 00000100:00100000:0.0:1789402474.855833:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199208576 00000100:00100000:0.0:1789402474.855923:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 67 00000100:00100000:0.0:1789402474.855935:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+25:10441:x1876324199208576:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402474.855965:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402474.855995:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8087 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471a3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856084:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856101:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856118:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856133:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856140:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856147:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856529:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856539:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856547:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402474.856604:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789402474.856610:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402474.856636:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856650:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856659:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856666:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856674:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856680:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402474.856685:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856694:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856720:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402474.856723:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402474.856729:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856736:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f808e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856762:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856768:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856773:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856778:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402474.856781:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856786:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856793:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402474.856795:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402474.856798:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856804:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856840:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8087 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471a3 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856855:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471a3 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402474.856873:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c30f8700) 00010000:00010000:0.0:1789402474.856875:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789402474.856877:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83a00, rc 0) 00000100:00100000:0.0:1789402474.856966:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+26:10441:x1876324199208576:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1032us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402474.856974:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 67 00010000:00010000:0.0:1789402474.979868:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789402475.629731:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789402475.629740:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789402475.629802:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789402475.629809:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789402475.629945:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e32c3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224401920:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789402475.630052:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e62703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402475.646140:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e32c3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224401920:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789402475.647245:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402475.647318:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199208704 00000100:00100000:2.0:1789402475.647329:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199208704 00000100:00100000:2.0:1789402475.647414:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00100000:2.0:1789402475.647426:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4785302d-2648-4148-8042-c10a24a5dd29+26:10453:x1876324199208704:12345-192.168.203.8@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789402475.647512:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4785302d-2648-4148-8042-c10a24a5dd29+26:10453:x1876324199208704:12345-192.168.203.8@tcp:900:lhsmtool_posix.0 Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402475.647521:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00080000:2.0:1789402475.647542:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402475.649879:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402475.650052:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199208832 00000100:00100000:2.0:1789402475.650061:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199208832 00000100:00100000:2.0:1789402475.650123:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 68 00000100:00100000:2.0:1789402475.650133:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+26:10453:x1876324199208832:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789402475.650161:0:6712:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789402475.650268:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+26:10453:x1876324199208832:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 135us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402475.650275:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 68 00000100:00100000:1.0:1789402475.656559:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402475.658900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199208960 00000100:00100000:0.0:1789402475.658914:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199208960 00000100:00100000:1.0:1789402475.659866:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:1.0:1789402475.659884:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+26:10453:x1876324199208960:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789402475.659976:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.659994:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660005:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660059:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660068:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660075:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660102:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660110:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660127:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402475.660164:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789402475.660169:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402475.660180:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660191:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660197:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660204:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660209:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402475.660213:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660219:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660230:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:1.0:1789402475.660233:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402475.660238:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660244:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f80a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660265:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660270:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660275:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660279:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402475.660282:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660286:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660293:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff93c6d8cd8000) 00010000:00010000:1.0:1789402475.660295:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402475.660298:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660304:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660318:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660324:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660330:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660364:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402475.660368:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660384:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660393:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c30f8700) 00010000:00010000:1.0:1789402475.660395:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402475.660398:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.660404:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402475.660492:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+26:10453:x1876324199208960:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 Request processed in 614us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402475.660502:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:2.0:1789402475.670623:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402475.670673:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199209216 00000100:00100000:2.0:1789402475.670682:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199209216 00000100:00100000:2.0:1789402475.670739:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 70 00000100:00100000:2.0:1789402475.670749:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+26:10453:x1876324199209216:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402475.670768:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402475.670789:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f80b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471aa expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.670886:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.670902:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.670914:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402475.670926:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00020000:2.0:1789402475.670934:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00000040:00080000:0.0:1789402475.676939:0:12006:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789402475.676948:0:12006:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789402475.677308:0:12006:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789402475.677314:0:12006:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789402475.699700:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.699714:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.699736:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.699743:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dee00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402475.699747:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.699755:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.699777:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c30f8700) 00010000:00010000:2.0:1789402475.699781:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789402475.699787:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.699794:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.699859:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f80b8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471aa expref: 28 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.699870:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:2.0:1789402475.699872:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789402475.699877:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f80b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471aa expref: 28 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.699886:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de200, rc 0) 00000100:00100000:2.0:1789402475.701080:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+27:10453:x1876324199209216:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 30325us (30462us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789402475.701105:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 70 00000100:00100000:0.0:1789402475.718588:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402475.718709:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199209344 00000100:00100000:3.0:1789402475.718720:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199209344 00000100:00100000:3.0:1789402475.718790:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 71 00000100:00100000:3.0:1789402475.718800:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+27:10453:x1876324199209344:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789402475.718837:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789402475.719225:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+27:10453:x1876324199209344:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 154us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402475.719234:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 71 00000100:00100000:1.0:1789402475.779783:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402475.781619:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199209600 00000100:00100000:0.0:1789402475.781643:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199209600 00000100:00100000:3.0:1789402475.781976:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 72 00000100:00100000:3.0:1789402475.781994:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+27:10453:x1876324199209600:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789402475.782024:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402475.782028:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789402475.782158:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4719c expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.782179:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:3.0:1789402475.782197:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789402475.782216:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f80cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471b1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789402475.785158:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789402475.786988:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f80d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.787015:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f80d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.787030:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f80d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789402475.787111:0:5846:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:3.0:1789402475.787131:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:3.0:1789402475.787209:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f80cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b1 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.787236:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f80d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b1 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.787247:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:3.0:1789402475.787251:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402475.787256:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d200, rc 0) 00000100:00100000:3.0:1789402475.787414:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+28:10453:x1876324199209600:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 5423us (7640us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789402475.787425:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 72 00000100:00100000:2.0:1789402475.829848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402475.830951:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199209856 00000100:00100000:1.0:1789402475.830970:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199209856 00000100:00100000:1.0:1789402475.831060:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 73 00000100:00100000:1.0:1789402475.831077:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+28:10453:x1876324199209856:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789402475.831157:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402475.831195:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f80d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b1 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.831216:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:1.0:1789402475.831242:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402475.831273:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.831289:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.831300:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.840594:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.840618:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.840631:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841138:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841148:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841155:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841161:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402475.841166:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841173:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841196:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:1.0:1789402475.841199:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402475.841205:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841211:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f80e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841224:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841231:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841236:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841243:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402475.841246:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841252:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841259:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2606454c (ffff93c6d8cd8000) 00010000:00010000:1.0:1789402475.841261:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402475.841265:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.841271:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f80e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2606454c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402475.842033:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+27:10453:x1876324199209856:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 10954us (12187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789402475.842043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 73 00000100:00100000:0.0:1789402475.851424:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402475.851498:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199209984 00000100:00100000:2.0:1789402475.851516:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199209984 00000100:00100000:2.0:1789402475.851592:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 74 00000100:00100000:2.0:1789402475.851616:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+27:10453:x1876324199209984:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402475.851638:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402475.851661:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f80f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471b8 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.851699:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.851713:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.851725:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.851825:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f80f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b8 expref: 29 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.851842:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b8 expref: 28 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.851850:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:2.0:1789402475.851853:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789402475.851857:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dee00, rc 0) 00000100:00100000:2.0:1789402475.851930:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+28:10453:x1876324199209984:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 329us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402475.851937:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 74 00000100:00100000:3.0:1789402475.877647:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402475.881263:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199210240 00000100:00100000:0.0:1789402475.881287:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199210240 00000100:00100000:0.0:1789402475.881409:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 75 00000100:00100000:0.0:1789402475.881422:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+28:10453:x1876324199210240:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789402475.881538:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402475.881559:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402475.881576:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789402475.882055:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1789402475.882072:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381030727545ns, next at 382030722684ns, rc = 0 00000004:00010000:0.0:1789402475.882208:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b1ac9cc reply state 00000000358b4167 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402475.882220:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789402475.882409:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+30:10453:x1876324199210240:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 987us (4776us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789402475.882422:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 75 00010000:00010000:3.0:1789402475.892553:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.892594:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.892604:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.892612:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402475.892619:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.892631:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402475.892631:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00010000:00010000:3.0:1789402475.892655:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:3.0:1789402475.892659:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789402475.892665:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.892672:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f80fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402475.892675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199210368 00000100:00100000:0.0:1789402475.892689:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199210368 00000100:00100000:0.0:1789402475.892779:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 76 00000100:00100000:0.0:1789402475.892794:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+29:10453:x1876324199210368:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402475.892837:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402475.892861:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471bf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.893179:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471bf expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.893213:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471bf expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402475.893237:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:1.0:1789402475.893240:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789402475.893244:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83400, rc 0) 00000100:00100000:1.0:1789402475.893325:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+30:10453:x1876324199210368:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 534us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402475.893333:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 76 00000100:00100000:1.0:1789402475.896437:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402475.896491:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199210496 00000100:00100000:3.0:1789402475.896509:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199210496 00000100:00100000:3.0:1789402475.896574:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00100000:3.0:1789402475.896587:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876324199210496:12345-192.168.203.8@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789402475.896629:0:8217:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:3.0:1789402475.896666:0:8217:0:(genops.c:1384:class_connect()) connect: client 4785302d-2648-4148-8042-c10a24a5dd29, cookie 0x9403f4af875f810c 00002000:00100000:3.0:1789402475.896680:0:8217:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4785302d-2648-4148-8042-c10a24a5dd29/ffff93c6d1685800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789402475.897707:0:8217:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789402475.897936:0:8217:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789402475.897975:0:8217:0:(import.c:65:import_set_state_nolock()) ffff93c6ffaaf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789402475.898049:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2350:x1876324199210496:12345-192.168.203.8@tcp:8:lhsmtool_posix.0 Request processed in 1463us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402475.898059:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00100000:3.0:1789402475.903821:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402475.903941:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199210624 00000100:00100000:1.0:1789402475.903967:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199210624 00000100:00100000:1.0:1789402475.904060:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 26 00000100:00100000:1.0:1789402475.904073:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:0:x1876324199210624:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789402475.904469:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789402475.942835:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1789402475.942875:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000100:00100000:3.0:1789402475.943183:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:0:x1876324199210624:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 39105us (39369us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789402475.943198:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 26 00000100:00100000:0.0:1789402475.948065:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402475.948182:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199210880 00000100:00100000:1.0:1789402475.948195:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199210880 00000100:00100000:1.0:1789402475.948271:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:1.0:1789402475.948285:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+30:10453:x1876324199210880:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789402475.948747:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+31:10453:x1876324199210880:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 464us (694us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789402475.948756:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:3.0:1789402475.954637:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402475.954734:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199211136 00000100:00100000:2.0:1789402475.954744:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199211136 00000100:00100000:2.0:1789402475.954806:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 77 00000100:00100000:2.0:1789402475.954817:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+31:10453:x1876324199211136:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789402475.954941:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+31:10453:x1876324199211136:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 125us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402475.954948:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 77 00000100:00100000:1.0:1789402475.957655:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402475.957764:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199211264 00000100:00100000:3.0:1789402475.957777:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199211264 00000100:00100000:3.0:1789402475.957854:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 78 00000100:00100000:3.0:1789402475.957868:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+31:10453:x1876324199211264:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789402475.957897:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402475.957926:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8113 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471c6 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.958050:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f811a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.958068:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f811a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.958083:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f811a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402475.958127:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402475.958170:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f811a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.958200:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f8113 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471c6 expref: 33 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.958239:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f811a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471c6 expref: 32 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.958248:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:3.0:1789402475.958252:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789402475.958256:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d200, rc 0) 00000100:00100000:3.0:1789402475.958322:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+32:10453:x1876324199211264:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 457us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402475.958329:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 78 00000100:00100000:1.0:1789402475.966226:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402475.966577:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199211392 00000100:00100000:3.0:1789402475.966592:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199211392 00000100:00100000:3.0:1789402475.966670:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00100000:3.0:1789402475.966684:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199211392:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789402475.966711:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402475.966743:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471cd expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789402475.966782:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa81d6b, blocks: 0x1 00010000:00010000:3.0:1789402475.966809:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1789402475.966815:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402475.966827:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471cd expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.966851:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471cd expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.966887:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c200, rc 0) 00000100:00100000:3.0:1789402475.966968:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199211392:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 286us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402475.966976:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00100000:2.0:1789402475.975707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402475.975822:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199211648 00000100:00100000:1.0:1789402475.975836:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199211648 00000100:00100000:1.0:1789402475.975910:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 79 00000100:00100000:1.0:1789402475.975926:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+32:10453:x1876324199211648:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789402475.976079:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+32:10453:x1876324199211648:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 156us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402475.976087:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 79 00000100:00100000:3.0:1789402475.979990:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402475.980553:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199211776 00000100:00100000:0.0:1789402475.980570:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199211776 00000100:00100000:0.0:1789402475.980649:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:0.0:1789402475.980665:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:10453:x1876324199211776:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402475.980690:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402475.980715:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471d4 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402475.980771:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471cd expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402475.980783:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402475.980787:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402475.980793:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402475.980837:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471cd expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402475.980853:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471cd expref: 7 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402475.980869:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1876324224402048:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402475.981009:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789402475.988761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402475.991487:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1876324224402048:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402475.991544:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402475.991573:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:2.0:1789402475.991662:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:10453:x1876324199211776:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 11002us (11686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402475.991674:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:0.0:1789402475.995220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199211904 00000100:00100000:0.0:1789402475.995241:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199211904 00010000:00010000:0.0:1789402475.995303:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471cd expref: 7 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402475.995649:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 42 00000100:00100000:3.0:1789402475.995673:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199211904:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402475.995775:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402475.995806:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471cd expref: 7 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.995825:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471cd expref: 7 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.995849:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf1df15a/0x9403f4af875f8121 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471cd expref: 7 pid: 6689 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.995865:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402475.995869:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402475.995877:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.995886:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402475.996790:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402475.996808:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c700271880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876324224402176:192.168.203.8@tcp:105: 00000100:00100000:3.0:1789402475.997124:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789402476.004227:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c700271880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876324224402176:192.168.203.8@tcp:105: 00010000:00010000:3.0:1789402476.004256:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402476.004313:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199211904:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 8651us (16618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402476.004323:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 42 00000100:00100000:2.0:1789402476.006021:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402476.006670:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199212032 00000100:00100000:3.0:1789402476.006683:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199212032 00002000:00100000:3.0:1789402476.006806:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93c6ff632300 x1876324199212032/t0(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:392/0 lens 504/0 e 0 to 0 dl 1789402487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789402476.006818:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ff632300 with x1876324199212032 ext(0->8) 00002000:00010000:3.0:1789402476.006825:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6ff632300 00000100:00100000:3.0:1789402476.006855:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:3.0:1789402476.006867:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199212032:12345-192.168.203.8@tcp:4:lhsmtool_posix.0 00010000:00010000:1.0:1789402476.007713:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402476.007820:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199212032:12345-192.168.203.8@tcp:4:lhsmtool_posix.0 Request processed in 950us (1807us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789402476.007830:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 0 00002000:00100000:3.0:1789402476.007840:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93c6ff632300 x1876324199212032/t4294967302(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:392/0 lens 504/448 e 0 to 0 dl 1789402487 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789402476.007862:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ff632300 with x1876324199212032 ext(0->8) 00002000:00010000:3.0:1789402476.007866:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6ff632300 00000100:00100000:0.0:1789402476.012000:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402476.012282:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199212160 00000100:00100000:2.0:1789402476.012298:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199212160 00000100:00100000:0.0:1789402476.013748:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 80 00000100:00100000:0.0:1789402476.013772:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+32:10453:x1876324199212160:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789402476.086109:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1789402476.086128:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:3.0:1789402476.086173:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1789402476.086247:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1789402476.086264:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789402476.086277:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789402476.086711:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789402476.086732:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224402304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789402476.086803:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402476.086833:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+13:10453:x1876324199212160:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 Request processed in 73061us (74831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402476.086848:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 80 00000100:00100000:0.0:1789402476.087014:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224402304 00000100:00100000:0.0:1789402476.087025:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224402304 00000100:00100000:0.0:1789402476.087105:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789402476.087115:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224402304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789402476.088599:0:8217:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789402476.088609:0:8217:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789402475 00002000:00010000:0.0:1789402476.088612:0:8217:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789402476.088615:0:8217:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789402475 -> 1789402475 00002000:00010000:0.0:1789402476.088618:0:8217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789402476.088706:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1876324224402304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1589us (1900us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789402476.088717:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789402476.088825:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789402476.089386:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c7003da680/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789402476.089402:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224402304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789402476.090429:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402476.091389:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199212288 00000100:00100000:0.0:1789402476.091402:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199212288 00000100:00100000:0.0:1789402476.091523:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 30 00000100:00100000:0.0:1789402476.091537:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+8:2354:x1876324199212288:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789402476.136681:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789402476.136714:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789402476.137089:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199212288:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 Request processed in 45546us (46659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402476.137104:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 30 00000100:00100000:3.0:1789402476.140240:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402476.140400:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199212544 00000100:00100000:0.0:1789402476.140415:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199212544 00000100:00100000:0.0:1789402476.140480:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 81 00000100:00100000:0.0:1789402476.140491:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+13:10453:x1876324199212544:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789402476.140560:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402476.140594:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d200/0x9403f4af875f811a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471c6 expref: 13 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.140619:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:0.0:1789402476.140625:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402476.140688:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.140875:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.140890:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402476.141266:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ca31a0b reply state 000000004a16dbf5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402476.141278:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789402476.141801:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+14:10453:x1876324199212544:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 1305us (1570us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789402476.141811:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 81 00010000:00010000:3.0:1789402476.143541:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.143560:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.143568:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.143575:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402476.143581:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.143613:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.143634:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:3.0:1789402476.143638:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402476.143646:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.143653:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f812f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402476.145698:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402476.146060:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199212672 00000100:00100000:0.0:1789402476.146074:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199212672 00000100:00100000:0.0:1789402476.146150:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 31 00000100:00100000:0.0:1789402476.146163:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199212672:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789402476.146536:0:8217:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789402476.146541:0:8217:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789402475 -> 1789402473 00002000:00010000:0.0:1789402476.146543:0:8217:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789402471 00002000:00010000:0.0:1789402476.146546:0:8217:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789402475 -> 1789402473 00002000:00010000:0.0:1789402476.146548:0:8217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789402476.146624:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:2353:x1876324199212672:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 463us (941us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789402476.146632:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 31 00000100:00100000:1.0:1789402476.150008:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402476.150093:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199212928 00000100:00100000:3.0:1789402476.150107:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199212928 00000100:00100000:3.0:1789402476.150231:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 82 00000100:00100000:3.0:1789402476.150244:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+13:10453:x1876324199212928:12345-192.168.203.8@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789402476.150339:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.150403:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b8 expref: 13 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.150414:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.150460:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b8 expref: 13 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.150475:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b8 expref: 13 pid: 6712 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402476.150509:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c700273800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224402432:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402476.150620:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e2786900 going to sleep for 11 seconds 00000100:00100000:1.0:1789402476.155005:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402476.155136:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199213056 00000100:00100000:0.0:1789402476.155168:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199213056 00010000:00010000:0.0:1789402476.155225:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b8 expref: 14 pid: 6712 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402476.155282:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 43 00000100:00100000:0.0:1789402476.155295:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:2352:x1876324199213056:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402476.155313:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402476.155321:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b8 expref: 14 pid: 6712 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.155336:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b8 expref: 14 pid: 6712 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.155417:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:0.0:1789402476.155425:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.155436:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.155444:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.155467:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402476.155531:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:2352:x1876324199213056:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 240us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402476.155540:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 43 00010000:00010000:3.0:1789402476.155719:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f80f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471b8 expref: 13 pid: 6712 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402476.155753:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c700273800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224402432:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402476.155793:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.155805:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.155811:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.155850:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.155859:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.155867:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.155874:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402476.155879:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.155888:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.155918:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:3.0:1789402476.155922:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789402476.155927:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.155933:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8136 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402476.155983:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+12:10453:x1876324199212928:12345-192.168.203.8@tcp:55:lhsmtool_posix.0 Request processed in 5742us (5988us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789402476.155992:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 82 00000100:00100000:0.0:1789402476.159640:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402476.159766:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199213184 00000100:00100000:2.0:1789402476.159779:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199213184 00000100:00100000:2.0:1789402476.159850:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 32 00000100:00100000:2.0:1789402476.159863:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:2353:x1876324199213184:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789402476.159945:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.159972:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.159982:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402476.159988:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402476.159994:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.160039:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.160055:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 7 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402476.160101:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1876324224402560:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402476.160206:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402476.164525:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1876324224402560:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402476.164566:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402476.166640:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402476.167167:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199213312 00000100:00100000:2.0:1789402476.167180:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199213312 00010000:00010000:2.0:1789402476.167230:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 8 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402476.167281:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:2.0:1789402476.167292:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+8:2351:x1876324199213312:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402476.167311:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402476.167381:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 8 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.167398:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 8 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.167424:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a44fd408/0x9403f4af875f8128 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471d4 expref: 8 pid: 6691 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.167444:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402476.167457:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402476.167464:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.167475:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.167500:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402476.167557:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199213312:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 266us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402476.167564:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 44 00010000:00010000:0.0:1789402476.167706:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.167729:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.167758:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.167768:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.167777:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.167784:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfc00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402476.167789:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.167799:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.167813:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.167821:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001819076/0x9403f4af875f813d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402476.167888:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199213184:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 Request processed in 8029us (8263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402476.167897:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 32 00000100:00100000:1.0:1789402476.171287:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402476.171499:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199213568 00000100:00100000:2.0:1789402476.171513:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199213568 00000100:00100000:2.0:1789402476.171606:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 83 00000100:00100000:2.0:1789402476.171617:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+12:10453:x1876324199213568:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789402476.171790:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.171812:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.171828:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.172145:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.172158:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471bf expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.172187:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.172226:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471bf expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.172242:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471bf expref: 13 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402476.172259:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224402688:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402476.173971:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9ddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402476.178131:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402476.178296:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199213696 00000100:00100000:0.0:1789402476.178308:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199213696 00010000:00010000:0.0:1789402476.178441:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471bf expref: 14 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402476.178479:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:0.0:1789402476.178490:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199213696:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402476.178509:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402476.178517:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471bf expref: 14 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.178536:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471bf expref: 14 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.178563:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:0.0:1789402476.178570:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.178582:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.178591:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.178635:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402476.178647:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8105 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471bf expref: 14 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402476.178709:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+13:2351:x1876324199213696:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 220us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402476.178717:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:2.0:1789402476.178976:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224402688:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402476.179002:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.179078:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.179085:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789402476.179324:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1789402476.179965:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789402476.180106:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1789402476.180309:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1876324224402816:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789402476.180448:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402476.182044:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c14c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402476.182100:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224402816 00000100:00100000:0.0:1789402476.182111:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224402816 00000100:00100000:0.0:1789402476.182253:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789402476.182267:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876324224402816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789402476.182431:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876324224402816:12345-0@lo:1000:mdt00_000.0 Request processed in 166us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402476.182439:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789402476.182632:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789402476.182639:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c7003da680, transno 4294967303 00000100:00100000:2.0:1789402476.182658:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1876324224402816:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789402476.183976:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789402476.184086:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1876324224402944:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789402476.184296:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402476.184764:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c8e53f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789402476.184880:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224402944 00000100:00100000:3.0:1789402476.184891:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224402944 00000100:00100000:3.0:1789402476.185013:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789402476.185025:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876324224402944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789402476.185578:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876324224402944:12345-0@lo:1000:mdt00_000.0 Request processed in 552us (1279us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789402476.185589:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789402476.185850:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1876324224402944:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789402476.185967:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.185981:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.185990:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.185997:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402476.186002:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186011:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186031:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:2.0:1789402476.186035:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789402476.186059:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186066:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f814b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186118:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186125:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186132:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186137:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402476.186140:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186146:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186153:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c30f8700) 00010000:00010000:2.0:1789402476.186156:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789402476.186234:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186241:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8080 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186268:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186286:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471a3 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186302:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186440:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471a3 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402476.186460:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471a3 expref: 16 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402476.186477:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6f8fdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224403072:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402476.186623:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c8e53f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789402476.191483:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402476.191585:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199213824 00000100:00100000:3.0:1789402476.191599:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199213824 00010000:00010000:3.0:1789402476.191649:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471a3 expref: 17 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402476.191709:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 46 00000100:00100000:3.0:1789402476.191722:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+17:2352:x1876324199213824:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402476.191906:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402476.191928:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471a3 expref: 17 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.191943:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471a3 expref: 17 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.191972:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c30f8700) 00010000:00010000:3.0:1789402476.191978:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.191989:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.191999:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.192023:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402476.192094:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+17:2352:x1876324199213824:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 374us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402476.192103:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 46 00010000:00010000:2.0:1789402476.194550:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f809c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471a3 expref: 16 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402476.194582:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6f8fdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224403072:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402476.194861:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.194988:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195002:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195018:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195026:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195033:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195039:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402476.195044:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195077:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195096:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c30f8700) 00010000:00010000:0.0:1789402476.195100:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402476.195106:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195112:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8152 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195126:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195133:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195139:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195144:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402476.195147:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195152:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195234:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c30f8700) 00010000:00010000:0.0:1789402476.195237:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789402476.195240:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.195256:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8144 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402476.195660:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+15:10453:x1876324199213568:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 24040us (24381us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789402476.195674:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 83 00000020:00080000:0.0:1789402476.195681:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789402476.198524:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789402476.198536:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789402476.198574:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789402476.198581:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789402476.199731:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402476.199827:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199214080 00000100:00100000:2.0:1789402476.199838:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199214080 00000100:00100000:2.0:1789402476.199963:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:2.0:1789402476.199976:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+15:10453:x1876324199214080:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789402476.203784:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789402476.203913:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789402476.204011:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.204033:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.204048:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.204059:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.204066:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.204072:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402476.204104:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789402476.204264:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+17:10453:x1876324199214080:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 4285us (4676us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789402476.204289:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 20 00000020:00080000:0.0:1789402476.204296:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789402476.204593:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402476.204602:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.204610:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82e00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402476.204615:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.204625:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.204653:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c6c3a3ee00) 00010000:00010000:3.0:1789402476.204657:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789402476.204663:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.204669:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8159 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402476.204689:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402476.204692:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402476.204694:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402476.258812:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224403456:0@lo:400:kworker.0 00000100:00100000:3.0:1789402476.258856:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224403200:0@lo:400:kworker.0 00000100:00100000:1.0:1789402476.258915:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402476.258921:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402476.258991:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224403328:0@lo:400:kworker.0 00000100:00100000:0.0:1789402476.259095:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224403584:0@lo:400:kworker.0 00000100:00100000:3.0:1789402476.259229:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224403712:0@lo:400:kworker.0 00000100:00100000:1.0:1789402476.259259:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224403456 00000100:00100000:3.0:1789402476.259264:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402476.259271:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224403456 00000100:00100000:3.0:1789402476.259306:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224403200 00000100:00100000:3.0:1789402476.259311:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224403200 00000100:00100000:1.0:1789402476.259364:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224403712 00000100:00100000:3.0:1789402476.259384:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789402476.259397:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224403200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402476.259397:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224403712 00000100:00100000:1.0:1789402476.259432:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789402476.259440:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224403456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402476.259485:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224403200:12345-0@lo:400:kworker.0 Request processed in 91us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402476.259494:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789402476.259499:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876324224403456:12345-0@lo:400:kworker.0 Request processed in 57us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402476.259508:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789402476.259525:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789402476.259533:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224403712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402476.259567:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224403200:0@lo:400:kworker.0 00000100:00100000:1.0:1789402476.259570:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224403712:12345-0@lo:400:kworker.0 Request processed in 37us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402476.259580:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789402476.259589:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224403712:0@lo:400:kworker.0 00000100:00080000:1.0:1789402476.259602:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402476.259630:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876324224403456:0@lo:400:kworker.0 00000100:00100000:1.0:1789402476.268587:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402476.268906:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224403584 00000100:00100000:0.0:1789402476.268920:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224403584 00000100:00100000:2.0:1789402476.269061:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402476.269128:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789402476.269143:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1876324224403584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402476.269233:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1876324224403584:12345-0@lo:400:kworker.0 Request processed in 94us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402476.269241:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789402476.269572:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224403328 00000100:00100000:3.0:1789402476.269578:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224403328 00000100:00100000:3.0:1789402476.269641:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789402476.269648:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224403328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402476.269690:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224403328:12345-0@lo:400:kworker.0 Request processed in 44us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402476.269696:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789402476.270225:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402476.270257:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224403328:0@lo:400:kworker.0 00000100:00100000:1.0:1789402476.270267:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224403584:0@lo:400:kworker.0 00000100:00100000:3.0:1789402476.774652:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402476.774685:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224403840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402476.774862:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402476.775245:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224403840 00000100:00100000:0.0:1789402476.775257:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224403840 00000100:00100000:0.0:1789402476.775330:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789402476.775388:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224403840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789402476.775432:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789402476.775497:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224403840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402476.775505:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789402476.775891:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224403840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789402477.027426:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402477.296019:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c700271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224403968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402477.296118:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402477.296731:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224403968 00000100:00100000:3.0:1789402477.296744:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224403968 00000100:00100000:3.0:1789402477.296812:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789402477.296824:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224403968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402477.296872:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402477.296954:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224403968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402477.296962:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789402477.297067:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c700271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224403968:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789402477.789009:0:12057:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789402477.789023:0:12057:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789402477.789067:0:12057:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789402477.789076:0:12057:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1789402477.916778:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:2.0:1789402477.916802:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789402478.007121:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.007455:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199214336 00000100:00100000:0.0:1789402478.007469:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199214336 00000100:00100000:0.0:1789402478.007565:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 84 00000100:00100000:0.0:1789402478.007577:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+17:10471:x1876324199214336:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402478.007610:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402478.007637:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8160 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471db expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.007801:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8167 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.007819:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8167 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.007834:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8167 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402478.007847:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789402478.008012:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8160 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471db expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.008037:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8167 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471db expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.008046:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402478.008050:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789402478.008054:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82e00, rc 0) 00000100:00100000:0.0:1789402478.008130:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+19:10471:x1876324199214336:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 555us (1022us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789402478.008138:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 84 00000100:00080000:1.0:1789402478.008514:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402478.011271:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402478.011418:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199214464 00000100:00100000:3.0:1789402478.011433:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199214464 00000100:00100000:3.0:1789402478.011513:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 85 00000100:00100000:3.0:1789402478.011525:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+19:10471:x1876324199214464:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:3.0:1789402478.011628:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.011650:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.011666:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.011708:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.011717:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.011724:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012254:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012266:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012273:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789402478.012329:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012497:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012505:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012513:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012520:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402478.012524:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012539:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012554:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:3.0:1789402478.012558:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402478.012564:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012571:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012582:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012588:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012595:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012600:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90de00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402478.012603:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012609:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012617:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6d2ca6300) 00010000:00010000:3.0:1789402478.012619:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402478.012622:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012639:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f817c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012657:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012663:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012669:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012674:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402478.012677:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012682:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012690:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6d2ca6d00) 00010000:00010000:3.0:1789402478.012692:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402478.012695:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.012701:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d600/0x9403f4af875f8183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402478.012822:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+19:10471:x1876324199214464:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 1296us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402478.012833:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 85 00010000:00010000:3.0:1789402478.051473:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402478.073624:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.074501:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199214720 00000100:00100000:0.0:1789402478.074516:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199214720 00000100:00100000:0.0:1789402478.074588:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 86 00000100:00100000:0.0:1789402478.074600:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+19:10474:x1876324199214720:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402478.074628:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402478.074664:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f818a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471e2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.075918:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.075944:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.075959:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.075979:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.075987:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.075994:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.079774:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.079797:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.079810:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789402478.079819:0:5845:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:0.0:1789402478.079828:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000004:00020000:0.0:1789402478.079838:0:5845:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:0.0:1789402478.079960:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.079968:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.079976:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.079983:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402478.079987:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.081866:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.081901:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402478.081905:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402478.081915:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.081924:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.081943:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.081951:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.081958:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.081965:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402478.081987:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.081995:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.082433:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c3a3ea00) 00010000:00010000:0.0:1789402478.082436:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402478.082440:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.082447:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8198 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.093468:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f818a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e2 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.093516:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e2 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.093528:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:1.0:1789402478.093531:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402478.093535:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83c00, rc 0) 00000100:00100000:1.0:1789402478.093827:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+21:10474:x1876324199214720:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 19226us (20212us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789402478.093839:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 86 00000100:00100000:0.0:1789402478.115960:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.116023:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.116074:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.116197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199214848 00000100:00100000:1.0:1789402478.116210:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199214848 00000100:00100000:1.0:1789402478.116280:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 289 00000100:00100000:1.0:1789402478.116302:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199214848:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402478.116432:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199214848:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 142us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402478.116441:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 289 00000100:00100000:1.0:1789402478.116485:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199215232 00000100:00100000:1.0:1789402478.116489:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199215232 00000100:00100000:1.0:1789402478.116539:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 138 00000100:00100000:1.0:1789402478.116548:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199215232:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402478.116586:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199215232:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 39us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402478.116592:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 138 00000100:00080000:1.0:1789402478.116611:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402478.117430:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199214976 00000100:00100000:3.0:1789402478.117441:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199214976 00000100:00100000:3.0:1789402478.117580:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 76 00000100:00100000:3.0:1789402478.117592:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199214976:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402478.117649:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199214976:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 60us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402478.117657:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 76 00000100:00100000:0.0:1789402478.117876:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.117989:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402478.118006:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199215104 00000100:00100000:2.0:1789402478.118012:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199215104 00000100:00100000:2.0:1789402478.118150:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 77 00000100:00100000:2.0:1789402478.118161:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199215104:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402478.118206:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199215104:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 47us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402478.118214:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 77 00000100:00100000:1.0:1789402478.119008:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199215360 00000100:00100000:1.0:1789402478.119027:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199215360 00000100:00100000:1.0:1789402478.119078:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 87 00000100:00100000:1.0:1789402478.119088:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:10474:x1876324199215360:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:1.0:1789402478.119167:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.119188:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.119203:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.119237:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.119244:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.119252:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.119259:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402478.119265:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.119274:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.119289:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:1.0:1789402478.119292:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789402478.119298:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.119321:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f81ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402478.119411:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:10474:x1876324199215360:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 324us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402478.119420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 87 00000100:00080000:1.0:1789402478.119443:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789402478.119449:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789402478.124879:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.125195:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199215616 00000100:00100000:1.0:1789402478.125208:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199215616 00000100:00100000:1.0:1789402478.125325:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:1.0:1789402478.125338:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:10474:x1876324199215616:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:1.0:1789402478.125689:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+22:10474:x1876324199215616:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 352us (824us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789402478.125697:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:1.0:1789402478.177777:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.178783:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199215872 00000100:00100000:0.0:1789402478.178801:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199215872 00000100:00100000:0.0:1789402478.178875:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 88 00000100:00100000:0.0:1789402478.178896:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+22:9993:x1876324199215872:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402478.178930:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402478.178958:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471e9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.179105:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.179145:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e2 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.179156:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.179219:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e2 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.179237:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e2 expref: 23 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402478.179255:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003db100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224404096:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402478.184934:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e259c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789402478.187329:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.187600:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003db100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224404096:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402478.187639:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402478.188719:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199216000 00000100:00100000:2.0:1789402478.188735:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199216000 00010000:00010000:2.0:1789402478.188807:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e2 expref: 24 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402478.188864:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:2.0:1789402478.188876:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+24:2352:x1876324199216000:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402478.188897:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402478.188905:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e2 expref: 24 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402478.188939:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e2 expref: 24 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402478.188985:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f819f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e2 expref: 24 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402478.189006:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:2.0:1789402478.189012:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402478.189028:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402478.189036:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402478.189082:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402478.189651:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+23:2352:x1876324199216000:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 704us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402478.189663:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 47 00010000:00010000:1.0:1789402478.190495:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.190510:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402478.190536:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000004:00020000:1.0:1789402478.190587:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:1.0:1789402478.190785:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e9 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.190809:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e9 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.190819:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:1.0:1789402478.190822:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789402478.190826:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83000, rc 0) 00000100:00100000:1.0:1789402478.190901:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+23:9993:x1876324199215872:12345-192.168.203.8@tcp:101:bash.0 Request processed in 12009us (13134us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789402478.190910:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 88 00000100:00100000:3.0:1789402478.192553:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.192718:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199216256 00000100:00100000:1.0:1789402478.192731:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199216256 00000100:00100000:1.0:1789402478.193861:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 89 00000100:00100000:1.0:1789402478.193879:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+23:9993:x1876324199216256:12345-192.168.203.8@tcp:36:bash.0 00010000:00010000:1.0:1789402478.196833:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.196867:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.196882:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789402478.197117:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1789402478.197173:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b9b082a reply state 00000000fa89c660 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402478.197210:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789402478.197571:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1789402478.197742:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+27:9993:x1876324199216256:12345-192.168.203.8@tcp:36:bash.0 Request processed in 3861us (5194us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789402478.197754:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 89 00000020:00080000:1.0:1789402478.197761:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789402478.200978:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.201000:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.201009:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.201016:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402478.201022:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.201031:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.201051:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:3.0:1789402478.201055:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402478.201061:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.201424:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f81c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402478.204380:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.205943:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199216384 00000100:00100000:1.0:1789402478.206063:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199216384 00000100:00100000:0.0:1789402478.206604:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 90 00000100:00100000:0.0:1789402478.206619:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+26:9993:x1876324199216384:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402478.206651:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402478.206682:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f81d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471f0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.207325:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f81d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f0 expref: 27 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.207371:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f81d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f0 expref: 27 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.207421:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402478.207424:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789402478.207428:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83600, rc 0) 00000100:00100000:0.0:1789402478.207520:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+27:9993:x1876324199216384:12345-192.168.203.8@tcp:101:bash.0 Request processed in 903us (3194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402478.207527:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 90 00000100:00100000:0.0:1789402478.215254:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402478.215670:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199216512 00000100:00100000:3.0:1789402478.215685:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199216512 00000100:00100000:3.0:1789402478.215788:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:3.0:1789402478.215799:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:9993:x1876324199216512:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:3.0:1789402478.215822:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402478.215849:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471f7 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789402478.215883:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa81d69, atime: 0x6aa81d67, ctime: 0x6aa81d69, blocks: 0xb 00010000:00010000:3.0:1789402478.215919:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1789402478.215925:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402478.215935:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f7 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.215956:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f7 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.215976:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d600, rc 0) 00000100:00100000:3.0:1789402478.216055:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:9993:x1876324199216512:12345-192.168.203.8@tcp:101:bash.0 Request processed in 258us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402478.216063:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:2.0:1789402478.224239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.224415:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199216640 00000100:00100000:1.0:1789402478.224427:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199216640 00002000:00010000:1.0:1789402478.224481:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789402478.224488:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c7006d4a80 with x1876324199216640 ext(0->18446744073709551615) 00002000:00010000:1.0:1789402478.224503:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c7006d4a80. 00000100:00100000:1.0:1789402478.224539:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00100000:1.0:1789402478.224552:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199216640:12345-192.168.203.8@tcp:10:bash.0 00002000:00010000:1.0:1789402478.224945:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789402478.224949:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789402473 -> 1789402477 00002000:00010000:1.0:1789402478.224952:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789402471 -> 1789402471 00002000:00010000:1.0:1789402478.224955:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789402473 -> 1789402477 00002000:00010000:1.0:1789402478.224957:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789402478.225045:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199216640:12345-192.168.203.8@tcp:10:bash.0 Request processed in 495us (820us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789402478.225054:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 1 00002000:00010000:1.0:1789402478.225058:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789402478.225061:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c7006d4a80 with x1876324199216640 ext(0->18446744073709551615) 00002000:00010000:1.0:1789402478.225066:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c7006d4a80. 00000100:00100000:1.0:1789402478.341562:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.341802:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199216768 00000100:00100000:0.0:1789402478.341817:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199216768 00000100:00100000:0.0:1789402478.341895:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 91 00000100:00100000:0.0:1789402478.341908:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+27:10488:x1876324199216768:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:0.0:1789402478.342024:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.342057:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.342072:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.342093:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.342101:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.342109:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.342520:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.342531:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.342539:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402478.342949:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343095:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343103:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343110:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343117:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402478.343122:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343131:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343146:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402478.343150:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402478.343156:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343176:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f81de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343193:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343199:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343205:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343211:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402478.343214:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343220:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343229:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c3a3ea00) 00010000:00010000:0.0:1789402478.343231:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402478.343234:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343240:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f81e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343256:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343262:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343274:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343279:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402478.343282:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343289:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343297:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402478.343300:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402478.343303:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.343309:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f81ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402478.344386:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+27:10488:x1876324199216768:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 2466us (2824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402478.344402:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 91 00000100:00100000:0.0:1789402478.450999:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.451091:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199217024 00000100:00100000:1.0:1789402478.451104:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199217024 00000100:00100000:1.0:1789402478.451171:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 92 00000100:00100000:1.0:1789402478.451182:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+27:10491:x1876324199217024:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402478.451209:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402478.451237:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f81f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b471fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.451324:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.451378:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.451392:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.451409:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.451416:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.451423:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.451815:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452058:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452077:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789402478.452086:0:5846:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:1.0:1789402478.452094:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00020000:1.0:1789402478.452104:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:1.0:1789402478.452211:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452219:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452226:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452233:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83f400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402478.452237:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452246:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452258:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:1.0:1789402478.452261:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402478.452266:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452272:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f81fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452286:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452298:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452304:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452309:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402478.452312:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452318:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452324:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6d8cd8000) 00010000:00010000:1.0:1789402478.452326:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402478.452329:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452335:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8201 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452452:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f81f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471fe expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452467:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471fe expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.452476:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:1.0:1789402478.452479:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789402478.452487:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83ea00, rc 0) 00000100:00100000:1.0:1789402478.453118:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+29:10491:x1876324199217024:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1934us (2125us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789402478.453129:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 92 00000100:00100000:2.0:1789402478.470013:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.470122:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199217152 00000100:00100000:1.0:1789402478.470135:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199217152 00000100:00100000:1.0:1789402478.470212:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 93 00000100:00100000:1.0:1789402478.470223:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+29:10491:x1876324199217152:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:1.0:1789402478.470319:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.470340:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e9 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.470403:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.470447:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e9 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.470462:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e9 expref: 29 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402478.470478:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224404224:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402478.470592:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402478.480134:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224404224:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402478.480177:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402478.484412:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.484638:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199217408 00000100:00100000:1.0:1789402478.484652:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199217408 00000100:00100000:1.0:1789402478.484724:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:1.0:1789402478.484737:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+30:5591:x1876324199217408:12345-192.168.203.8@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789402478.485176:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+31:5591:x1876324199217408:12345-192.168.203.8@tcp:35:ldlm_bl.0 Request processed in 440us (834us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789402478.485185:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:3.0:1789402478.492071:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.493412:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199217536 00000100:00100000:0.0:1789402478.493431:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199217536 00010000:00010000:0.0:1789402478.493494:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e9 expref: 31 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402478.493548:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:0.0:1789402478.493560:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700270000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+31:2352:x1876324199217536:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402478.493599:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402478.493607:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e9 expref: 31 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.493624:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e9 expref: 31 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.493655:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f81bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471e9 expref: 31 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.493677:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402478.493694:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.493707:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.493717:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.493749:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402478.493836:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700270000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+30:2352:x1876324199217536:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 277us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402478.493845:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 48 00010000:00010000:1.0:1789402478.495296:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.495315:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.495402:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.495411:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.495419:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.495425:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402478.495431:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.495438:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.495481:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:1.0:1789402478.495484:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789402478.495491:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.495498:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402478.495598:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+29:10491:x1876324199217152:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 25372us (25595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402478.495609:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 93 00000100:00100000:3.0:1789402478.499036:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.499195:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199217792 00000100:00100000:1.0:1789402478.499210:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199217792 00000100:00100000:1.0:1789402478.499285:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:1.0:1789402478.499298:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+29:10491:x1876324199217792:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:1.0:1789402478.499647:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+30:10491:x1876324199217792:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 350us (627us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789402478.499655:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:0.0:1789402478.629339:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402478.629737:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199218048 00000100:00100000:3.0:1789402478.629751:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199218048 00000100:00100000:3.0:1789402478.629820:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 94 00000100:00100000:3.0:1789402478.629831:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+30:10502:x1876324199218048:12345-192.168.203.8@tcp:101:cat.0 00010000:00010000:3.0:1789402478.629862:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402478.629888:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f821d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47205 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.629976:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.629993:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.630006:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.630032:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.630039:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.630045:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.630693:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f8232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.630706:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f8232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.630727:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f8232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789402478.630735:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000004:00200000:3.0:1789402478.655749:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00000004:00020000:3.0:1789402478.655799:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023255553 00010000:00010000:3.0:1789402478.655979:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.655992:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656001:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656007:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402478.656022:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656031:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656052:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:3.0:1789402478.656054:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402478.656067:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656073:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656092:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656117:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656124:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656129:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402478.656133:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656139:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656148:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6d2ca6800) 00010000:00010000:3.0:1789402478.656151:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402478.656154:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.656160:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f822b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.672044:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f821d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47205 expref: 33 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.672460:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f8232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47205 expref: 32 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.672473:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:3.0:1789402478.672477:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402478.672501:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90cc00, rc 0) 00000100:00100000:3.0:1789402478.675419:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+32:10502:x1876324199218048:12345-192.168.203.8@tcp:101:cat.0 Request processed in 45570us (46074us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789402478.675436:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 94 00000100:00100000:3.0:1789402478.682942:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.683072:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199218304 00000100:00100000:1.0:1789402478.683086:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199218304 00000100:00100000:1.0:1789402478.683157:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 24 00000100:00100000:1.0:1789402478.683169:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+32:10502:x1876324199218304:12345-192.168.203.8@tcp:35:cat.0 00000100:00100000:1.0:1789402478.684669:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+33:10502:x1876324199218304:12345-192.168.203.8@tcp:35:cat.0 Request processed in 1491us (1779us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789402478.684691:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 24 00000100:00100000:2.0:1789402478.707711:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.707809:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199218560 00000100:00100000:0.0:1789402478.707823:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199218560 00000100:00100000:0.0:1789402478.707896:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 95 00000100:00100000:0.0:1789402478.707908:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+33:10503:x1876324199218560:12345-192.168.203.8@tcp:36:rm.0 00010000:00010000:0.0:1789402478.708018:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789402478.708055:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90cc00/0x9403f4af875f8232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47205 expref: 33 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708094:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471fe expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708108:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f81d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f0 expref: 31 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708120:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402478.708133:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402478.708159:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708176:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708189:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708219:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708227:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708235:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708614:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708623:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.708630:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789402478.709392:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789402478.709406:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383858062019ns, next at 384858057830ns, rc = 0 00010000:00010000:0.0:1789402478.709485:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709499:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709509:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709517:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709525:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709532:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709560:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789402478.709588:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709602:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709610:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709617:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402478.709622:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709631:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.709636:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402478.709644:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:0.0:1789402478.709647:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789402478.709650:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709652:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.709657:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402478.709659:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f824e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.709661:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.709667:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.709675:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:1.0:1789402478.709678:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789402478.709681:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709687:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.709690:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709693:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.709696:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8255 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709699:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402478.709707:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.709712:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402478.709713:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.709714:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402478.709715:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402478.709722:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402478.709724:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402478.709727:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.709734:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8240 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402478.709744:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018b59b1e reply state 00000000261470c5 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402478.709754:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789402478.709874:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+32:10503:x1876324199218560:12345-192.168.203.8@tcp:36:rm.0 Request processed in 1963us (2174us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789402478.709883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 95 00010000:00010000:3.0:1789402478.714142:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.714166:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.714174:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.714181:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402478.714187:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.714195:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.714442:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c3a3ea00) 00010000:00010000:3.0:1789402478.714446:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402478.714454:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.714462:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8247 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402478.756444:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402478.756568:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199218816 00000100:00100000:1.0:1789402478.756581:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199218816 00000100:00100000:1.0:1789402478.756662:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 96 00000100:00100000:1.0:1789402478.756675:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+31:10509:x1876324199218816:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:1.0:1789402478.756710:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402478.756740:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f825c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4720c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.756898:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.756940:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.756954:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.756972:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.756979:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.756985:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789402478.757724:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789402478.757934:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.757948:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.757957:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789402478.757965:0:5846:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023256130 00000004:00020000:1.0:1789402478.757978:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023256130 00010000:00010000:1.0:1789402478.758006:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.758014:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.758034:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.758041:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402478.758046:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.758055:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.758071:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:1.0:1789402478.758075:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402478.758081:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.758088:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8263 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789402478.758104:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1b4f95c reply state 00000000962d5611 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402478.758113:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789402478.758151:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f825c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4720c expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.758167:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4720c expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.758174:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:1.0:1789402478.758176:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402478.758185:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e600, rc 0) 00000100:00100000:1.0:1789402478.758288:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+34:10509:x1876324199218816:12345-192.168.203.8@tcp:101:bash.0 Request processed in 1615us (1859us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789402478.758299:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 96 00010000:00010000:3.0:1789402478.761703:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.761750:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.761759:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.761766:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83f400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402478.761771:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.761780:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.761801:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6d8cd8000) 00010000:00010000:3.0:1789402478.761805:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402478.761811:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402478.761817:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f826a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402478.789703:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.789929:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199218944 00000100:00100000:0.0:1789402478.789943:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199218944 00000100:00100000:0.0:1789402478.790014:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 34 00000100:00100000:0.0:1789402478.790026:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199218944:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402478.790052:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402478.790102:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47213 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789402478.790140:0:8217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402478.790190:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1789402478.790713:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402478.790728:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47213 expref: 6 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.790760:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47213 expref: 6 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.790777:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83000, rc 0) 00000100:00100000:0.0:1789402478.790864:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199218944:12345-192.168.203.8@tcp:101:bash.0 Request processed in 839us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402478.790873:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 34 00000100:00100000:2.0:1789402478.795170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.795654:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199219072 00000100:00100000:0.0:1789402478.795668:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199219072 00000100:00100000:0.0:1789402478.795742:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 35 00000100:00100000:0.0:1789402478.795756:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:10509:x1876324199219072:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402478.795783:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402478.795808:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4721a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.795864:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47213 expref: 7 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.795875:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402478.795880:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402478.795895:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.795962:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47213 expref: 7 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.795978:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47213 expref: 7 pid: 8217 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402478.795996:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1876324224404352:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402478.796512:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e259c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789402478.803658:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402478.805286:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1876324224404352:192.168.203.8@tcp:104: 00010000:00010000:0.0:1789402478.805339:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402478.805496:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:1.0:1789402478.805536:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199219200 00000100:00100000:1.0:1789402478.805550:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199219200 00010000:00010000:1.0:1789402478.805599:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47213 expref: 8 pid: 8217 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402478.805656:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:1.0:1789402478.805669:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199219200:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402478.805687:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402478.805717:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47213 expref: 8 pid: 8217 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.805732:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47213 expref: 8 pid: 8217 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.805763:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f827f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47213 expref: 8 pid: 8217 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.805782:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402478.805787:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402478.805797:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.805809:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402478.805866:0:8454:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402478.805885:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8454:1876324224404480:192.168.203.8@tcp:105: 00000100:00100000:0.0:1789402478.806962:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:10509:x1876324199219072:12345-192.168.203.8@tcp:101:bash.0 Request processed in 11199us (11807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402478.806976:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 35 00000100:00100000:1.0:1789402478.809028:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789402478.811860:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402478.812055:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199219456 00000100:00100000:3.0:1789402478.812068:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199219456 00000100:00100000:3.0:1789402478.812149:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00100000:3.0:1789402478.812170:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+33:10509:x1876324199219456:12345-192.168.203.8@tcp:35:bash.0 00000100:00100000:1.0:1789402478.812415:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8454:1876324224404480:192.168.203.8@tcp:105: 00010000:00010000:1.0:1789402478.812446:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402478.812988:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199219200:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 6849us (8873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402478.813004:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:3.0:1789402478.814997:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+34:10509:x1876324199219456:12345-192.168.203.8@tcp:35:bash.0 Request processed in 2818us (3149us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789402478.815024:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00100000:2.0:1789402479.020436:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.020697:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199219584 00000100:00100000:1.0:1789402479.020711:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199219584 00000100:00100000:1.0:1789402479.020780:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 97 00000100:00100000:1.0:1789402479.020790:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+34:10525:x1876324199219584:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402479.020819:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402479.020855:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f828d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47221 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.020932:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8294 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.020949:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.020965:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402479.021026:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789402479.021029:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402479.021050:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.021094:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f828d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47221 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.021115:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47221 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.021124:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:1.0:1789402479.021128:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789402479.021132:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e000, rc 0) 00000100:00100000:1.0:1789402479.021502:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+35:10525:x1876324199219584:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 712us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402479.021511:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 97 00000100:00100000:0.0:1789402479.032935:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.033068:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199219840 00000100:00100000:1.0:1789402479.033082:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199219840 00000100:00100000:1.0:1789402479.033168:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 98 00000100:00100000:1.0:1789402479.033181:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+35:10525:x1876324199219840:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402479.033209:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402479.033236:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f829b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47228 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.033423:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f82a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.033463:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f82a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.033478:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f82a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402479.033493:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000004:00020000:1.0:1789402479.033505:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133187 00010000:00010000:1.0:1789402479.033678:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f829b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47228 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.033701:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f82a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47228 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.033711:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:1.0:1789402479.033715:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402479.033720:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e800, rc 0) 00000100:00100000:1.0:1789402479.033801:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+37:10525:x1876324199219840:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 623us (882us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789402479.033810:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 98 00000100:00100000:3.0:1789402479.045696:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402479.045766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402479.046072:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199220224 00000100:00100000:0.0:1789402479.046085:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199220224 00000100:00100000:0.0:1789402479.046164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:0.0:1789402479.046177:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700272a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+37:2352:x1876324199220224:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402479.046196:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402479.046225:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f82a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47228 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.046262:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:0.0:1789402479.046267:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402479.046335:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700272a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+36:2352:x1876324199220224:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 160us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402479.046398:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:1.0:1789402479.046570:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199220096 00000100:00100000:1.0:1789402479.046577:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199220096 00000100:00100000:1.0:1789402479.046620:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 99 00000100:00100000:1.0:1789402479.046629:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+36:10525:x1876324199220096:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402479.046654:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402479.046672:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f82b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4722f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.046799:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f82b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.046816:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f82b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.046829:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f82b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402479.046842:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000004:00020000:1.0:1789402479.046850:0:5845:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2268287991810 00010000:00010000:1.0:1789402479.046993:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f82b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4722f expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.047010:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f82b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4722f expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.047018:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:1.0:1789402479.047021:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789402479.047024:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83f800, rc 0) 00000100:00100000:1.0:1789402479.047055:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+38:10525:x1876324199220096:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 429us (1289us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789402479.047061:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 99 00000100:00100000:2.0:1789402479.061775:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402479.069209:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199220352 00000100:00100000:0.0:1789402479.069231:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199220352 00000100:00100000:0.0:1789402479.069328:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 36 00000100:00100000:0.0:1789402479.069378:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199220352:12345-192.168.203.8@tcp:1:lfs.0 00010000:00010000:0.0:1789402479.069444:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.069471:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.069482:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789402479.069487:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789402479.069493:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.069539:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.069558:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 6 pid: 6691 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402479.069602:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876324224404608:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402479.069724:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e259c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789402479.075148:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402479.076754:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876324224404608:192.168.203.8@tcp:104: 00010000:00010000:0.0:1789402479.076796:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.077309:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402479.077394:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199220480 00000100:00100000:1.0:1789402479.077406:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199220480 00002000:00100000:1.0:1789402479.077478:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93c700271f80 x1876324199220480/t0(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:395/0 lens 504/0 e 0 to 0 dl 1789402490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789402479.077491:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c700271f80 with x1876324199220480 ext(0->8) 00010000:00010000:1.0:1789402479.077518:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 7 pid: 6691 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.077536:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 7 pid: 6691 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402479.077545:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c700271f80 00000100:00100000:1.0:1789402479.077625:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00100000:1.0:1789402479.077637:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199220480:12345-192.168.203.8@tcp:4:lfs.0 00000100:00100000:1.0:1789402479.078670:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4785302d-2648-4148-8042-c10a24a5dd29+9:2351:x1876324199220480:12345-192.168.203.8@tcp:4:lfs.0 Request processed in 1029us (3532us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789402479.078681:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 1 00002000:00100000:1.0:1789402479.078691:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93c700271f80 x1876324199220480/t4294967302(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:395/0 lens 504/448 e 0 to 0 dl 1789402490 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789402479.078701:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c700271f80 with x1876324199220480 ext(0->8) 00010000:00010000:1.0:1789402479.078709:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 9 pid: 6691 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.078727:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 9 pid: 6691 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402479.078735:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c700271f80 00000100:00100000:3.0:1789402479.087508:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402479.088220:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199220608 00000100:00100000:0.0:1789402479.088237:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199220608 00010000:00010000:0.0:1789402479.088294:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 9 pid: 6691 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402479.088402:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 50 00000100:00100000:0.0:1789402479.088415:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:2353:x1876324199220608:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402479.088437:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789402479.088463:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789402479.088466:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789402478 00002000:00010000:0.0:1789402479.088468:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789402478 00002000:00010000:0.0:1789402479.088470:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789402478 00010000:00010000:0.0:1789402479.088477:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 9 pid: 6691 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.088491:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 9 pid: 6691 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.088540:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8286 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4721a expref: 9 pid: 6691 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.088563:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789402479.088568:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789402479.088575:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.088585:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.088619:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402479.088685:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+8:2353:x1876324199220608:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 272us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402479.088694:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 50 00010000:00010000:3.0:1789402479.088830:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.088841:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.088871:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.088891:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.088901:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.088910:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83c00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402479.088915:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.088924:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.088938:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.088953:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f82c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402479.089166:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199220352:12345-192.168.203.8@tcp:1:lfs.0 Request processed in 19828us (27407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402479.089175:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 36 00000100:00100000:3.0:1789402479.093654:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402479.093765:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199220864 00000100:00100000:2.0:1789402479.093779:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199220864 00000100:00100000:2.0:1789402479.093858:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 26 00000100:00100000:2.0:1789402479.093871:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+38:10525:x1876324199220864:12345-192.168.203.8@tcp:35:lfs.0 00000004:00010000:2.0:1789402479.093986:0:5848:0:(mdt_open.c:2006:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f82b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4722f expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789402479.094300:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1789402479.094405:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1789402479.094792:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1789402479.094859:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.094878:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4720c expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.094888:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.094934:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4720c expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.094953:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4720c expref: 42 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402479.094971:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876324224404736:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402479.095092:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2db2780 going to sleep for 11 seconds 00000100:00100000:2.0:1789402479.104637:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876324224404736:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402479.104690:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402479.105211:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402479.105307:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199220992 00000100:00100000:0.0:1789402479.105317:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199220992 00010000:00010000:0.0:1789402479.105415:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4720c expref: 43 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402479.105460:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 51 00000100:00100000:0.0:1789402479.105470:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+43:2352:x1876324199220992:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402479.105490:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402479.105498:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4720c expref: 43 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.105536:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4720c expref: 43 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.105564:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8271 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4720c expref: 43 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.105586:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:0.0:1789402479.105592:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.105603:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.105611:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.105646:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402479.105725:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+42:2352:x1876324199220992:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 255us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402479.105733:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 51 00010000:00010000:2.0:1789402479.106568:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.106582:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789402479.106768:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789402479.107050:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1789402479.107193:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224404864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789402479.107271:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402479.107318:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c2db2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789402479.108075:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224404864 00000100:00100000:0.0:1789402479.108087:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224404864 00000100:00100000:0.0:1789402479.108158:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789402479.108169:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876324224404864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789402479.108281:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876324224404864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 113us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402479.108289:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789402479.109815:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402479.110581:0:5848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789402479.110593:0:5848:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1789402479.110622:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6fb1f9880, transno 4294967301 00000100:00100000:2.0:1789402479.110653:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224404864:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789402479.111316:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789402479.111479:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224404992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789402479.111566:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402479.111610:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e6214e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402479.111860:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224404992 00000100:00100000:0.0:1789402479.111873:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224404992 00000100:00100000:0.0:1789402479.111953:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789402479.111966:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876324224404992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789402479.112205:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876324224404992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 241us (638us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789402479.112213:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789402479.112415:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa974000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224404992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789402479.112493:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1789402479.112544:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.112572:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.112581:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.112588:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dee00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402479.112594:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.112605:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.112624:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:2.0:1789402479.112628:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789402479.112634:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.112640:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f82cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789402479.113426:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789402479.113522:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789402479.113534:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384262190006ns, next at 385262187353ns, rc = 0 00000001:00080000:2.0:1789402479.113543:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789402479.113584:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:2.0:1789402479.113588:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789402479.113599:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f82b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4722f expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402479.114212:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+45:10525:x1876324199220864:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 20339us (20568us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789402479.114225:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 26 00000020:00080000:2.0:1789402479.114231:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789402479.122665:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.126156:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199221120 00000100:00100000:1.0:1789402479.126179:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199221120 00000100:00100000:1.0:1789402479.126275:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 100 00000100:00100000:1.0:1789402479.126305:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+45:10525:x1876324199221120:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402479.126634:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402479.127509:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f82d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47236 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.127608:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f82d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47236 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.127626:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f82d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47236 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.127648:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:0.0:1789402479.127652:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789402479.127656:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:0.0:1789402479.127766:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+46:10525:x1876324199221120:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1463us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402479.127776:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 100 00000100:00100000:2.0:1789402479.130858:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.131063:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199221376 00000100:00100000:1.0:1789402479.131077:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199221376 00000100:00100000:1.0:1789402479.131152:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00100000:1.0:1789402479.131165:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+46:10525:x1876324199221376:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:1.0:1789402479.131548:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+47:10525:x1876324199221376:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 384us (705us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789402479.131559:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00100000:1.0:1789402479.209480:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402479.209585:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199221504 00000100:00100000:0.0:1789402479.209599:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199221504 00000100:00100000:0.0:1789402479.209676:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 101 00000100:00100000:0.0:1789402479.209689:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+47:10535:x1876324199221504:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:0.0:1789402479.209790:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.209833:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.209848:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.209867:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.209875:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.209893:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210024:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210034:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210041:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402479.210096:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210112:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210119:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210138:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210145:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402479.210150:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210160:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210173:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402479.210177:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402479.210182:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210189:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210203:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210209:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210214:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210217:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402479.210220:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210236:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210245:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c3a3eb00) 00010000:00010000:0.0:1789402479.210247:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402479.210250:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210255:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210270:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210276:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210281:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210286:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402479.210289:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210294:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210300:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:0.0:1789402479.210303:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402479.210306:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.210321:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402479.210782:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+47:10535:x1876324199221504:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 1090us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402479.210793:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 101 00000100:00100000:3.0:1789402479.271192:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402479.271390:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199221760 00000100:00100000:0.0:1789402479.271404:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199221760 00000100:00100000:0.0:1789402479.271480:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 102 00000100:00100000:0.0:1789402479.271491:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+47:10538:x1876324199221760:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402479.271517:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402479.271544:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4723d expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.271642:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.271661:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.271676:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.271704:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.271713:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.271749:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.271921:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.271930:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.271939:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789402479.271947:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:0.0:1789402479.271954:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000004:00020000:0.0:1789402479.271975:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:0.0:1789402479.272104:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272113:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272120:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272126:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402479.272132:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272140:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272154:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402479.272163:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402479.272170:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272177:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f82f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272195:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272200:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272206:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272211:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402479.272214:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272220:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272229:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c3a3eb00) 00010000:00010000:0.0:1789402479.272231:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402479.272235:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272241:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f82fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272291:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f82ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4723d expref: 50 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272320:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4723d expref: 49 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.272328:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:0.0:1789402479.272331:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789402479.272333:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83a00, rc 0) 00000100:00100000:0.0:1789402479.272667:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+49:10538:x1876324199221760:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1176us (1488us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789402479.272677:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 102 00000100:00100000:3.0:1789402479.275442:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402479.275686:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199221888 00000100:00100000:0.0:1789402479.275699:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199221888 00000100:00100000:0.0:1789402479.275778:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 103 00000100:00100000:0.0:1789402479.275791:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+49:10538:x1876324199221888:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:0.0:1789402479.276151:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.276176:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.276192:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.276224:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.276233:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.276267:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.276274:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402479.276279:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.276289:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.276303:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:0.0:1789402479.276306:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789402479.276312:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402479.276319:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402479.276464:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+49:10538:x1876324199221888:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 673us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402479.276472:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 103 00000100:00100000:1.0:1789402479.283573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402479.283692:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199222144 00000100:00100000:2.0:1789402479.283705:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199222144 00000100:00100000:2.0:1789402479.284017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:2.0:1789402479.284031:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+49:10538:x1876324199222144:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:2.0:1789402479.284408:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+50:10538:x1876324199222144:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 379us (851us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789402479.284417:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:3.0:1789402479.374863:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.375224:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199222400 00000100:00100000:1.0:1789402479.375239:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199222400 00000100:00100000:1.0:1789402479.375320:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 104 00000100:00100000:1.0:1789402479.375334:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+50:10548:x1876324199222400:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:1.0:1789402479.375419:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402479.375423:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789402479.375457:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47221 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.375482:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:1.0:1789402479.375489:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402479.375506:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8319 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47244 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.375771:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.375805:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4723d expref: 50 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.375815:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.375862:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4723d expref: 50 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.375880:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4723d expref: 50 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402479.375898:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224405120:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402479.376128:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789402479.380844:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224405120:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402479.380887:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402479.386174:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402479.391169:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199222528 00000100:00100000:3.0:1789402479.391192:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199222528 00010000:00010000:3.0:1789402479.391259:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4723d expref: 51 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402479.391434:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 52 00000100:00100000:3.0:1789402479.391448:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+51:2352:x1876324199222528:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402479.391468:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402479.391477:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4723d expref: 51 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.391492:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4723d expref: 51 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.391545:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4723d expref: 51 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.391568:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402479.391575:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.391585:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.391593:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.391726:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402479.391807:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+50:2352:x1876324199222528:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 361us (5644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402479.391816:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 52 00010000:00010000:1.0:1789402479.394990:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.395011:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402479.395042:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000004:00020000:1.0:1789402479.395077:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:1.0:1789402479.396469:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8319 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47244 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.396527:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47244 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.396539:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402479.396542:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789402479.396546:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e600, rc 0) 00000100:00100000:1.0:1789402479.396652:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+50:10548:x1876324199222400:12345-192.168.203.8@tcp:101:bash.0 Request processed in 21319us (21803us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789402479.396663:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 104 00000100:00100000:3.0:1789402479.402538:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.402780:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199222784 00000100:00100000:1.0:1789402479.402793:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199222784 00000100:00100000:1.0:1789402479.402861:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 105 00000100:00100000:1.0:1789402479.402874:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+50:10548:x1876324199222784:12345-192.168.203.8@tcp:36:bash.0 00010000:00010000:1.0:1789402479.403621:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.403646:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.403660:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789402479.404040:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789402479.405063:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075d755fb reply state 00000000a850206b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402479.405081:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789402479.405382:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+53:10548:x1876324199222784:12345-192.168.203.8@tcp:36:bash.0 Request processed in 2505us (2852us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789402479.405392:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 105 00000020:00080000:1.0:1789402479.405399:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789402479.413542:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.413567:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.413577:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.413584:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402479.413590:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.413621:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.413642:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402479.413645:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402479.413652:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.413659:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f832e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402479.414315:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402479.415021:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199222912 00000100:00100000:3.0:1789402479.415035:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199222912 00000100:00100000:3.0:1789402479.415121:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 106 00000100:00100000:3.0:1789402479.415133:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+52:10548:x1876324199222912:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:1.0:1789402479.415578:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402479.415610:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4724b expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.415769:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.415788:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47244 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.415799:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.415844:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47244 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.415863:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47244 expref: 53 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402479.415892:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224405248:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402479.416240:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402479.420721:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224405248:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402479.420762:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402479.428657:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402479.433388:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199223040 00000100:00100000:3.0:1789402479.433413:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199223040 00010000:00010000:3.0:1789402479.433485:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47244 expref: 54 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402479.433553:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00100000:3.0:1789402479.433566:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+54:2351:x1876324199223040:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402479.433585:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402479.433593:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47244 expref: 54 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.433609:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47244 expref: 54 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.433653:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f8320 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47244 expref: 54 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.433673:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402479.433752:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.433763:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.433772:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.433930:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402479.434022:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+53:2351:x1876324199223040:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 458us (5380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402479.434031:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 53 00010000:00010000:1.0:1789402479.438791:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.438816:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402479.439045:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789402479.439050:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402479.439221:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.439284:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4724b expref: 53 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.439317:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4724b expref: 52 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.439329:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402479.439332:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402479.439337:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83fa00, rc 0) 00000100:00100000:1.0:1789402479.440426:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+52:10548:x1876324199222912:12345-192.168.203.8@tcp:101:bash.0 Request processed in 25285us (26110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402479.440439:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 106 00000100:00100000:0.0:1789402479.447783:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402479.447950:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199223296 00000100:00100000:2.0:1789402479.447978:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199223296 00000100:00100000:2.0:1789402479.448052:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 29 00000100:00100000:2.0:1789402479.448074:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+52:10548:x1876324199223296:12345-192.168.203.8@tcp:35:bash.0 00000100:00100000:2.0:1789402479.448918:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+53:10548:x1876324199223296:12345-192.168.203.8@tcp:35:bash.0 Request processed in 842us (1145us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789402479.448929:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 29 00000100:00100000:2.0:1789402479.579833:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.580013:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199223424 00000100:00100000:1.0:1789402479.580026:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199223424 00000100:00100000:1.0:1789402479.580100:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 107 00000100:00100000:1.0:1789402479.580110:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+53:10554:x1876324199223424:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402479.580140:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402479.580187:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47252 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.580270:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f834a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.580286:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f834a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.580301:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f834a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402479.580400:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789402479.580404:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402479.580428:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f834a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.580457:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47252 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.580478:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f834a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47252 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.580486:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:1.0:1789402479.580489:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789402479.580494:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e800, rc 0) 00000100:00100000:1.0:1789402479.580574:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+54:10554:x1876324199223424:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 465us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402479.580582:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 107 00000100:00100000:3.0:1789402479.582742:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.582872:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199223552 00000100:00100000:1.0:1789402479.582901:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199223552 00000100:00100000:1.0:1789402479.582974:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 108 00000100:00100000:1.0:1789402479.582985:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+54:10554:x1876324199223552:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402479.583010:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402479.583036:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f8351 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47259 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583114:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583131:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583144:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583164:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583172:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583179:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583299:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583309:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583316:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402479.583411:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789402479.583417:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402479.583440:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583455:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583465:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583472:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583480:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583488:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402479.583493:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583503:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583518:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:1.0:1789402479.583521:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402479.583527:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583535:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8358 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583561:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583568:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583575:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583581:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402479.583584:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583590:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583597:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6d8cd8b00) 00010000:00010000:1.0:1789402479.583599:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402479.583602:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583608:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f835f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583646:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f8351 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583661:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.583679:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402479.583682:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402479.583684:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e000, rc 0) 00000100:00100000:1.0:1789402479.584076:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+55:10554:x1876324199223552:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1090us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402479.584085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 108 00000100:00100000:3.0:1789402479.601793:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.601876:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199223808 00000100:00100000:1.0:1789402479.601894:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199223808 00000100:00100000:1.0:1789402479.601968:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 109 00000100:00100000:1.0:1789402479.601980:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+55:10554:x1876324199223808:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402479.602007:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402479.602037:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f836d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47260 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.602173:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.602192:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4724b expref: 56 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.602201:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.602209:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.602251:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.602287:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 56 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402479.602304:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224405376:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402479.602469:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4724b expref: 56 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.602479:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4724b expref: 56 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402479.602488:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224405504:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402479.602514:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6eed1ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789402479.603057:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.603661:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199223936 00000100:00100000:1.0:1789402479.603672:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199223936 00010000:00010000:1.0:1789402479.603735:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 57 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402479.603773:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 54 00000100:00100000:1.0:1789402479.603783:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+57:2354:x1876324199223936:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402479.603799:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402479.603807:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 57 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.603820:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 57 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.603863:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402479.603868:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.603887:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.603894:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402479.603939:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+57:2354:x1876324199223936:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 157us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402479.603947:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 54 00010000:00010000:1.0:1789402479.608168:0:5844:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.8@tcp) returned -22 from blocking AST (req@00000000f17f2e80 x1876324224405376) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 56 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.608202:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47259 expref: 56 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402479.608224:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224405376:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402479.613181:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402479.613460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199224064 00000100:00100000:3.0:1789402479.613474:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199224064 00010000:00010000:3.0:1789402479.613526:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4724b expref: 56 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402479.613578:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 55 00000100:00100000:3.0:1789402479.613590:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+56:2351:x1876324199224064:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402479.613629:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402479.613637:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4724b expref: 56 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.613652:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4724b expref: 56 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.613681:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402479.613687:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.613698:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.613707:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402479.613742:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402479.613817:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+56:2351:x1876324199224064:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 228us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402479.613825:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 55 00010000:00010000:1.0:1789402479.615324:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f833c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4724b expref: 55 pid: 6712 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402479.615383:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224405504:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402479.615414:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402479.615423:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.615456:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.615463:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402479.615489:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00020000:1.0:1789402479.615513:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2208192008195 00010000:00010000:1.0:1789402479.615705:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f836d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47260 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.616758:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47260 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.616775:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402479.616778:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789402479.616782:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83ec00, rc 0) 00000100:00100000:1.0:1789402479.616874:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+55:10554:x1876324199223808:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 14894us (15094us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789402479.616892:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 109 00000100:00100000:2.0:1789402479.626519:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.626625:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199224320 00000100:00100000:1.0:1789402479.626638:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199224320 00000100:00100000:1.0:1789402479.626733:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:1.0:1789402479.626747:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+55:10554:x1876324199224320:12345-192.168.203.8@tcp:103:lfs.0 00010000:00010000:1.0:1789402479.626768:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402479.626801:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f82d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47236 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.626851:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402479.626859:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402479.626938:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+54:10554:x1876324199224320:12345-192.168.203.8@tcp:103:lfs.0 Request processed in 194us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402479.626947:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:3.0:1789402479.633525:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402479.633643:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199224448 00000100:00100000:2.0:1789402479.633658:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199224448 00000100:00100000:2.0:1789402479.633793:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 110 00000100:00100000:2.0:1789402479.633824:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+54:10554:x1876324199224448:12345-192.168.203.8@tcp:58:lfs.0 00010000:00010000:2.0:1789402479.634227:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.634252:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402479.634269:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789402479.634597:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789402479.637120:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+54:10554:x1876324199224448:12345-192.168.203.8@tcp:58:lfs.0 Request processed in 898us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402479.637143:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 110 00000100:00100000:3.0:1789402479.641064:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402479.666646:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199224576 00000100:00100000:1.0:1789402479.666667:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199224576 00000100:00100000:1.0:1789402479.666864:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 111 00000100:00100000:1.0:1789402479.666878:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+54:10554:x1876324199224576:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402479.666905:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402479.666934:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8389 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47267 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.667009:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.667022:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8389 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47267 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.667045:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.667061:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8389 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47267 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.667077:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402479.667096:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789402479.667101:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8389 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47267 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402479.667110:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83f800, rc 0) 00000100:00100000:1.0:1789402479.667200:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+55:10554:x1876324199224576:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 324us (26151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402479.667208:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 111 00010000:00010000:1.0:1789402480.098825:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789402480.290853:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789402480.290867:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789402480.290924:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789402480.290931:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789402480.291116:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003db100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224405632:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789402480.291268:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e259c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789402480.303707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402480.303832:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199224704 00000100:00100000:1.0:1789402480.303845:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199224704 00000100:00100000:1.0:1789402480.303958:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 112 00000100:00100000:1.0:1789402480.303972:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+56:10555:x1876324199224704:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789402480.304015:0:6712:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1789402480.304506:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402480.304779:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+56:10555:x1876324199224704:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 806us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402480.304791:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 112 00000100:00100000:0.0:1789402480.305511:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003db100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224405632:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789402480.312843:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402480.313322:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199224832 00000100:00100000:1.0:1789402480.313337:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199224832 00000100:00100000:1.0:1789402480.313467:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 113 00000100:00100000:1.0:1789402480.313479:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+55:10555:x1876324199224832:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789402480.313583:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313605:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313619:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313652:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313659:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313677:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313704:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313713:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313721:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402480.313767:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789402480.313771:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402480.313787:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313799:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313806:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313814:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313829:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402480.313835:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313844:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313856:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:1.0:1789402480.313859:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402480.313865:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313881:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8390 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313896:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313902:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313908:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313913:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402480.313916:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.313922:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.314526:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff93c6d8cd8b00) 00010000:00010000:1.0:1789402480.314529:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402480.314534:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.314540:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8397 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.314563:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.314570:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.314576:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.314581:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83f400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402480.314585:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.314591:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.314598:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402480.314601:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402480.314604:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.314609:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f839e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402480.314741:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+55:10555:x1876324199224832:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 Request processed in 1260us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402480.314750:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 113 00000100:00100000:2.0:1789402480.321696:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402480.321816:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199225088 00000100:00100000:1.0:1789402480.321828:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199225088 00000100:00100000:1.0:1789402480.321912:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 114 00000100:00100000:1.0:1789402480.321924:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+55:10555:x1876324199225088:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789402480.321962:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402480.321992:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4726e expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.322146:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.322164:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.322179:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402480.322194:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00020000:1.0:1789402480.322203:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:1.0:1789402480.336455:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.336478:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.336488:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.336514:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402480.336520:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.336530:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.336549:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402480.336552:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789402480.336558:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.336565:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.336642:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4726e expref: 57 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.336654:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:1.0:1789402480.336656:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789402480.336660:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4726e expref: 57 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.336671:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e600, rc 0) 00000100:00100000:1.0:1789402480.336773:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+56:10555:x1876324199225088:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 14850us (15103us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789402480.336783:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 114 00000100:00100000:2.0:1789402480.340332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402480.341336:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199225216 00000100:00100000:1.0:1789402480.341399:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199225216 00000100:00100000:1.0:1789402480.341495:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 115 00000100:00100000:1.0:1789402480.341510:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+56:10555:x1876324199225216:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789402480.341564:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789402480.341837:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+56:10555:x1876324199225216:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 330us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402480.341846:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 115 00000100:00100000:3.0:1789402480.394194:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402480.395025:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199225472 00000100:00100000:2.0:1789402480.395042:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199225472 00000100:00100000:2.0:1789402480.395133:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 116 00000100:00100000:2.0:1789402480.395147:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+56:10555:x1876324199225472:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402480.395177:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402480.395183:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789402480.395222:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f834a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47252 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.395251:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:2.0:1789402480.395257:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402480.395297:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47275 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789402480.395922:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789402480.410200:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f83c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.410224:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.410238:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789402480.410249:0:5844:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:2.0:1789402480.410279:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:2.0:1789402480.410378:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47275 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.410400:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f83c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47275 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.410409:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:2.0:1789402480.410412:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402480.410415:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df600, rc 0) 00000100:00100000:2.0:1789402480.410491:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+57:10555:x1876324199225472:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 15346us (16312us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789402480.410500:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 116 00000100:00100000:3.0:1789402480.417802:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402480.422298:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199225728 00000100:00100000:1.0:1789402480.422328:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199225728 00000100:00100000:1.0:1789402480.422559:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 117 00000100:00100000:1.0:1789402480.422572:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+57:10555:x1876324199225728:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789402480.422662:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402480.422700:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f83c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47275 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.422726:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6c30f8400) 00010000:00010000:1.0:1789402480.422739:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402480.422768:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.422786:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.422797:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.422815:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.422846:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.422852:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423276:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423286:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423293:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423299:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402480.423304:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423313:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423323:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:1.0:1789402480.423326:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402480.423331:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423336:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423384:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423468:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423474:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423479:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402480.423482:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423488:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423497:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa89cb937 (ffff93c6d8cd8b00) 00010000:00010000:1.0:1789402480.423499:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402480.423502:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.423508:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa89cb937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402480.423699:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+56:10555:x1876324199225728:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 1126us (5911us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789402480.423708:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 117 00000100:00100000:3.0:1789402480.430248:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402480.431707:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199225856 00000100:00100000:1.0:1789402480.431724:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199225856 00000100:00100000:1.0:1789402480.431813:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 118 00000100:00100000:1.0:1789402480.431826:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+56:10555:x1876324199225856:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789402480.431854:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402480.431975:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4727c expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.432027:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.432042:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.432129:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.432260:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f83dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4727c expref: 58 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.432284:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4727c expref: 57 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.432294:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:1.0:1789402480.432297:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789402480.432302:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e600, rc 0) 00000100:00100000:1.0:1789402480.432642:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+57:10555:x1876324199225856:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 816us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402480.432651:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 118 00000100:00100000:3.0:1789402480.437805:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402480.439415:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199226112 00000100:00100000:2.0:1789402480.439431:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199226112 00000100:00100000:3.0:1789402480.439879:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 119 00000100:00100000:3.0:1789402480.439924:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+57:10555:x1876324199226112:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789402480.440292:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.440315:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.440332:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789402480.440907:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1789402480.440920:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385589575611ns, next at 386589571938ns, rc = 0 00000004:00010000:3.0:1789402480.442204:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055443be8 reply state 000000006f22b93f transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.442223:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789402480.442686:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+59:10555:x1876324199226112:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 2761us (4889us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789402480.442699:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 119 00010000:00010000:1.0:1789402480.451852:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.451875:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.451884:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.451915:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90de00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402480.451920:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.451929:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.451949:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00010000:00010000:1.0:1789402480.451949:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:1.0:1789402480.451952:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789402480.451959:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.451965:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90de00/0x9403f4af875f83eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.452083:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199226240 00000100:00100000:2.0:1789402480.452112:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199226240 00000100:00100000:2.0:1789402480.452533:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 120 00000100:00100000:2.0:1789402480.452548:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+58:10555:x1876324199226240:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402480.452579:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402480.452602:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47283 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.452675:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47283 expref: 59 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.452691:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47283 expref: 59 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.452713:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:2.0:1789402480.452790:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789402480.452794:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de600, rc 0) 00000100:00100000:2.0:1789402480.452915:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+59:10555:x1876324199226240:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 371us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402480.452923:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 120 00000100:00100000:3.0:1789402480.461233:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402480.461405:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199226368 00000100:00100000:0.0:1789402480.461421:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199226368 00000100:00080000:2.0:1789402480.461494:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789402480.461514:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 37 00000100:00100000:0.0:1789402480.461527:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+8:2351:x1876324199226368:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789402480.461930:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+9:2351:x1876324199226368:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 404us (710us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789402480.461939:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 37 00000100:00100000:1.0:1789402480.464496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402480.464577:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199226624 00000100:00100000:2.0:1789402480.464589:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199226624 00000100:00100000:3.0:1789402480.464860:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 30 00000100:00100000:3.0:1789402480.464883:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+59:10555:x1876324199226624:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789402480.465197:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+60:10555:x1876324199226624:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 325us (713us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789402480.465204:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 30 00000100:00100000:3.0:1789402480.467245:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402480.467469:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199226880 00000100:00100000:0.0:1789402480.467481:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199226880 00000100:00100000:0.0:1789402480.467551:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 121 00000100:00100000:0.0:1789402480.467564:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+60:10555:x1876324199226880:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789402480.467711:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+60:10555:x1876324199226880:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 149us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402480.467720:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 121 00000100:00100000:0.0:1789402480.469915:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402480.475252:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199227008 00000100:00100000:2.0:1789402480.475276:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199227008 00000100:00100000:2.0:1789402480.475398:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 122 00000100:00100000:2.0:1789402480.475412:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+60:10555:x1876324199227008:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402480.475442:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402480.475472:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f83f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4728a expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.475591:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8400 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.475611:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.475627:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402480.475672:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402480.475695:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.476017:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f83f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4728a expref: 62 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.476045:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4728a expref: 61 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.476054:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:2.0:1789402480.476057:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789402480.476061:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df400, rc 0) 00000100:00100000:3.0:1789402480.476921:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+61:10555:x1876324199227008:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 1505us (7011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402480.476955:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 122 00000100:00100000:3.0:1789402480.481491:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402480.481827:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199227136 00000100:00100000:0.0:1789402480.481840:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199227136 00000100:00100000:0.0:1789402480.481912:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 38 00000100:00100000:0.0:1789402480.481924:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:2354:x1876324199227136:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402480.481950:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402480.481977:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47291 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789402480.482037:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa81d6f, blocks: 0x1 00010000:00010000:0.0:1789402480.482145:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1789402480.482151:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402480.482307:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47291 expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.482331:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47291 expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.482638:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83000, rc 0) 00000100:00100000:0.0:1789402480.483229:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+10:2354:x1876324199227136:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 1301us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402480.483239:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 38 00000100:00100000:0.0:1789402480.485787:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402480.492582:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199227392 00000100:00100000:3.0:1789402480.492602:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199227392 00000100:00100000:3.0:1789402480.492699:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 123 00000100:00100000:3.0:1789402480.492712:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+61:10555:x1876324199227392:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789402480.492864:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+61:10555:x1876324199227392:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 154us (7088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402480.492883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 123 00000100:00100000:2.0:1789402480.497245:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402480.502290:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199227520 00000100:00100000:0.0:1789402480.502309:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199227520 00000100:00100000:0.0:1789402480.502415:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:0.0:1789402480.502428:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+10:10555:x1876324199227520:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402480.502452:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402480.502478:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47298 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.502523:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47291 expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.502555:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402480.502560:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402480.502566:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.502608:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47291 expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.502623:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47291 expref: 11 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402480.502639:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1876324224405760:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402480.502769:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e259c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789402480.509686:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402480.509882:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199227648 00000100:00100000:3.0:1789402480.509895:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199227648 00010000:00010000:3.0:1789402480.509957:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47291 expref: 12 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.510018:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 56 00000100:00100000:3.0:1789402480.510030:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+12:2352:x1876324199227648:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402480.510060:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402480.510089:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47291 expref: 12 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.510208:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47291 expref: 12 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.510243:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402480.510248:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402480.510277:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.510289:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.510650:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.510673:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876324224405888:192.168.203.8@tcp:105: 00010000:00010000:0.0:1789402480.515146:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088de64ad/0x9403f4af875f8407 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47291 expref: 12 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402480.515181:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1876324224405760:192.168.203.8@tcp:104: 00010000:00010000:0.0:1789402480.515228:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.515252:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83600, rc 0) 00000100:00100000:0.0:1789402480.515412:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+11:10555:x1876324199227520:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 12986us (18185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402480.515445:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:2.0:1789402480.516533:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e6270240 going to sleep for 11 seconds 00000100:00100000:2.0:1789402480.518772:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876324224405888:192.168.203.8@tcp:105: 00010000:00010000:2.0:1789402480.518809:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402480.518886:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+10:2352:x1876324199227648:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 8848us (9205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402480.518919:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 56 00000100:00100000:3.0:1789402480.520430:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402480.520537:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199227776 00000100:00100000:0.0:1789402480.520549:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199227776 00002000:00100000:0.0:1789402480.520619:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93c6e31bdc00 x1876324199227776/t0(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:396/0 lens 504/0 e 0 to 0 dl 1789402491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789402480.520632:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6e31bdc00 with x1876324199227776 ext(0->12) 00002000:00010000:0.0:1789402480.520639:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6e31bdc00 00000100:00100000:0.0:1789402480.520677:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:0.0:1789402480.520688:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4785302d-2648-4148-8042-c10a24a5dd29+10:2352:x1876324199227776:12345-192.168.203.8@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789402480.521467:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4785302d-2648-4148-8042-c10a24a5dd29+12:2352:x1876324199227776:12345-192.168.203.8@tcp:4:lhsmtool_posix.0 Request processed in 772us (1040us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789402480.521480:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 2 00002000:00100000:0.0:1789402480.521491:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93c6e31bdc00 x1876324199227776/t4294967308(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:396/0 lens 504/448 e 0 to 0 dl 1789402491 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789402480.521503:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6e31bdc00 with x1876324199227776 ext(0->12) 00002000:00010000:0.0:1789402480.521507:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6e31bdc00 00000100:00100000:3.0:1789402480.524792:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402480.525108:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199227904 00000100:00100000:2.0:1789402480.525123:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199227904 00000100:00100000:2.0:1789402480.525200:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 124 00000100:00100000:2.0:1789402480.525213:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+61:10555:x1876324199227904:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789402480.593922:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967390 is committed 00000004:00080000:2.0:1789402480.594074:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1789402480.595483:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+59:10555:x1876324199227904:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 Request processed in 70260us (70695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402480.595501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 124 00000001:00080000:2.0:1789402480.595850:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:2.0:1789402480.595904:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:2.0:1789402480.595919:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789402480.595954:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c6c2db2780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789402480.595960:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6fb315900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c6d8742540 00000020:00080000:2.0:1789402480.595963:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6fb315700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c6fb671c00 00000020:00080000:2.0:1789402480.596005:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c6c12ed540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789402480.596008:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e61c1300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c6c12edf00 00000020:00080000:2.0:1789402480.596010:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e61c1100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c6f1fa7800 00000001:00080000:2.0:1789402480.596023:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1789402480.596031:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:3.0:1789402480.596243:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789402480.596263:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224406016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789402480.596335:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402480.596434:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224406016 00000100:00100000:3.0:1789402480.596445:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224406016 00000100:00100000:3.0:1789402480.596502:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789402480.596513:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1876324224406016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789402480.596548:0:8217:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1789402480.596592:0:8217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa81d6e, atime: 0x6aa81d6e, ctime: 0x6aa81d6e, blocks: 0x1 00010000:00010000:3.0:1789402480.596602:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.596645:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:3.0:1789402480.596650:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402480.596658:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.596678:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.596691:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.596701:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.596720:0:8217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789402480.597650:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1876324224406016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1133us (1310us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789402480.597661:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789402480.597697:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402480.597706:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.597718:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402480.597723:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.597747:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.597769:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.597777:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8415 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.597801:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402480.597803:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402480.597805:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789402480.597851:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6ff642a00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789402480.597859:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224406016:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1789402480.600319:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789402480.600788:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789402480.604846:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402480.604997:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199228032 00000100:00100000:0.0:1789402480.605009:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199228032 00000100:00100000:1.0:1789402480.605063:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224406144:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789402480.605076:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:0.0:1789402480.605086:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+12:2351:x1876324199228032:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789402480.605122:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402480.605179:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224406144 00000100:00100000:0.0:1789402480.605183:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224406144 00000100:00100000:0.0:1789402480.605219:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789402480.605225:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1876324224406144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789402480.605259:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789402480.605289:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.605313:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f7 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.605323:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789402480.605329:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789402480.605334:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.605401:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f7 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.605418:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f7 expref: 12 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402480.605431:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1876324224406272:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402480.605497:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c4aba6c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789402480.605679:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789402480.606181:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224406400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789402480.606225:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402480.606262:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789402480.606269:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789402480.606480:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224406400 00000100:00100000:1.0:1789402480.606487:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224406400 00000100:00100000:1.0:1789402480.606587:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789402480.606597:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224406400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789402480.607239:0:12073:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789402480.607246:0:12073:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789402479 00002000:00010000:1.0:1789402480.607249:0:12073:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789402480.607251:0:12073:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789402479 -> 1789402479 00002000:00010000:1.0:1789402480.607253:0:12073:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789402480.607323:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3313:x1876324224406400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 726us (1097us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789402480.607332:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:1.0:1789402480.607649:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6fb46b800/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789402480.607657:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224406400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789402480.613037:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1876324224406272:192.168.203.8@tcp:104: 00010000:00010000:0.0:1789402480.613080:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402480.618196:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402480.618767:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199228160 00000100:00100000:2.0:1789402480.618782:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199228160 00010000:00010000:2.0:1789402480.618839:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f7 expref: 13 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.618891:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 57 00000100:00100000:2.0:1789402480.618903:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+13:2352:x1876324199228160:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402480.618954:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402480.618961:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f7 expref: 13 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.618978:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f7 expref: 13 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.619009:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032210281/0x9403f4af875f81d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471f7 expref: 13 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.619031:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402480.619036:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402480.619044:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.619056:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.619090:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402480.619158:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+12:2352:x1876324199228160:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 257us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402480.619167:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 57 00010000:00010000:2.0:1789402480.619203:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.619214:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.619231:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.619240:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.619256:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789402480.619948:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3316:x1876324224406144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14719us (14822us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789402480.619959:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1789402480.620371:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402480.620382:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.620406:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402480.620411:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.620424:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.620446:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.620454:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052fed5c0/0x9403f4af875f841c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.620488:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402480.620490:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402480.620491:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789402480.620539:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c5c282dc00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789402480.620547:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224406144:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789402480.668913:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1789402480.668960:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1789402480.670526:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199228032:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 Request processed in 65425us (65680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402480.670543:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:0.0:1789402480.681546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402480.681783:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199228416 00000100:00100000:1.0:1789402480.681797:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199228416 00000100:00100000:1.0:1789402480.681920:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 125 00000100:00100000:1.0:1789402480.681944:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+15:10555:x1876324199228416:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789402480.682027:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402480.682063:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4728a expref: 15 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.682088:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:1.0:1789402480.682094:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402480.682135:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.682154:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.682166:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402480.685825:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f4d4669 reply state 000000003ade8c9a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.685851:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789402480.686320:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+16:10555:x1876324199228416:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 4373us (4784us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789402480.686331:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 125 00010000:00010000:3.0:1789402480.693410:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.693434:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.693442:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402480.693452:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00010000:00010000:3.0:1789402480.693471:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402480.693478:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.693488:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.693509:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:3.0:1789402480.693513:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402480.693519:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.693526:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83fa00/0x9403f4af875f8423 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402480.693546:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199228544 00000100:00100000:1.0:1789402480.693559:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199228544 00000100:00100000:1.0:1789402480.693672:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:1.0:1789402480.693685:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199228544:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789402480.693983:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789402480.693988:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789402479 -> 1789402478 00002000:00010000:1.0:1789402480.693990:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789402478 00002000:00010000:1.0:1789402480.693993:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789402479 -> 1789402478 00002000:00010000:1.0:1789402480.693995:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789402480.694081:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199228544:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 398us (634us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789402480.694089:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:0.0:1789402480.696034:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402480.696139:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199228800 00000100:00100000:3.0:1789402480.696151:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199228800 00000100:00100000:3.0:1789402480.696264:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 126 00000100:00100000:3.0:1789402480.696276:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+15:10555:x1876324199228800:12345-192.168.203.8@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789402480.696520:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.696542:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4727c expref: 15 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.696552:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.696599:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4727c expref: 15 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.696633:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4727c expref: 15 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.696652:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224406528:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402480.697031:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402480.700611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402480.700905:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224406528:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402480.700945:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402480.701117:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199228928 00000100:00100000:1.0:1789402480.701127:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199228928 00010000:00010000:1.0:1789402480.701176:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4727c expref: 16 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402480.701269:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 58 00000100:00100000:1.0:1789402480.701281:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+16:2352:x1876324199228928:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402480.701304:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402480.701312:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4727c expref: 16 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.701325:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4727c expref: 16 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.701427:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f83e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4727c expref: 16 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.701447:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:1.0:1789402480.701452:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.701463:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.701472:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.701508:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402480.701576:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+15:2352:x1876324199228928:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 297us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402480.701584:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 58 00010000:00010000:3.0:1789402480.701640:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.701649:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.701697:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.701705:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.701713:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.701719:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402480.701724:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.701732:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.701751:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:3.0:1789402480.701753:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789402480.701759:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.701765:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f842a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.701811:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+14:10555:x1876324199228800:12345-192.168.203.8@tcp:55:lhsmtool_posix.0 Request processed in 5538us (5790us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789402480.701820:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 126 00000100:00100000:0.0:1789402480.704625:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402480.705004:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199229056 00000100:00100000:3.0:1789402480.705017:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199229056 00000100:00100000:3.0:1789402480.705085:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:3.0:1789402480.705096:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+7:2354:x1876324199229056:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789402480.705151:0:12073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.705175:0:12073:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.705185:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402480.705191:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402480.705196:0:12073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.705237:0:12073:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.705272:0:12073:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 7 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.705290:0:12073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff641f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12073:1876324224406656:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402480.705421:0:12073:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402480.708401:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402480.708568:0:12073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff641f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12073:1876324224406656:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402480.708607:0:12073:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.708786:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199229184 00000100:00100000:2.0:1789402480.708795:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199229184 00010000:00010000:2.0:1789402480.708844:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 8 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.708898:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 59 00000100:00100000:2.0:1789402480.708909:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199229184:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402480.708929:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402480.708978:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 8 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.708992:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 8 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.709021:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f840e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47298 expref: 8 pid: 6690 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.709042:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402480.709047:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402480.709053:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.709064:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.709103:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402480.709171:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199229184:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 262us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402480.709179:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 59 00010000:00010000:1.0:1789402480.709294:0:12073:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.709305:0:12073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.709369:0:12073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.709380:0:12073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.709409:0:12073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.709417:0:12073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402480.709422:0:12073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.709433:0:12073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.709447:0:12073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402480.709455:0:12073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8431 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402480.709513:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199229056:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 Request processed in 4419us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402480.709521:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:0.0:1789402480.712961:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402480.713068:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199229440 00000100:00100000:3.0:1789402480.713080:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199229440 00000100:00100000:3.0:1789402480.713150:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 127 00000100:00100000:3.0:1789402480.713163:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+14:10555:x1876324199229440:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789402480.713272:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.713294:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.713310:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.713636:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.713650:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47283 expref: 15 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.713685:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.713726:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47283 expref: 15 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.713741:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47283 expref: 15 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.713758:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224406784:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402480.713867:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402480.716947:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224406784:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402480.716989:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402480.718648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402480.719788:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199229568 00000100:00100000:2.0:1789402480.719808:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199229568 00010000:00010000:2.0:1789402480.719896:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47283 expref: 16 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.719950:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 60 00000100:00100000:2.0:1789402480.719962:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+16:2351:x1876324199229568:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402480.720002:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402480.720011:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47283 expref: 16 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.720025:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47283 expref: 16 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.720052:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f83f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47283 expref: 16 pid: 6712 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.720072:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:2.0:1789402480.720078:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.720089:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.720098:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.720140:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402480.720218:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+15:2351:x1876324199229568:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 257us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402480.720226:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 60 00010000:00010000:0.0:1789402480.720864:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.720883:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789402480.721136:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789402480.722315:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789402480.722581:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789402480.723133:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1876324224406912:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789402480.723231:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402480.723281:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d95eda80 going to sleep for 11 seconds 00000100:00100000:2.0:1789402480.724053:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224406912 00000100:00100000:2.0:1789402480.724067:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224406912 00000100:00100000:2.0:1789402480.724144:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789402480.724156:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1876324224406912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789402480.724276:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1876324224406912:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402480.724301:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789402480.725017:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789402480.725027:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1789402480.725060:0:5845:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93c6fb46b800 x1876324224406400/t4294967309(4294967309) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789402496 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789402480.725077:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1876324224406912:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789402480.726636:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789402480.726987:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1876324224407040:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789402480.727072:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402480.727170:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1fc9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789402480.727228:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224407040 00000100:00100000:2.0:1789402480.727241:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224407040 00000100:00100000:2.0:1789402480.727402:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789402480.727414:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1876324224407040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789402480.727898:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5845:x1876324224407040:12345-0@lo:1000:mdt00_001.0 Request processed in 484us (824us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789402480.727907:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789402480.731220:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1876324224407040:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789402480.731297:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731310:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731319:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731325:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402480.731330:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731367:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731386:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6d8cd8b00) 00010000:00010000:2.0:1789402480.731389:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789402480.731406:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731412:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f843f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731482:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731488:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731495:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731500:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402480.731503:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731514:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731524:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:2.0:1789402480.731527:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789402480.731535:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8389 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47267 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731549:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8389 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47267 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731559:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47267 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.731612:0:5845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47267 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.731639:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec03100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224407168:192.168.203.8@tcp:105: 00000100:00100000:0.0:1789402480.737798:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789402480.742607:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec03100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224407168:192.168.203.8@tcp:105: 00000100:00100000:0.0:1789402480.742607:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00010000:00010000:2.0:1789402480.742651:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742666:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8382 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742709:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742726:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742741:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742755:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742762:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742770:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742777:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402480.742795:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742824:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742840:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:2.0:1789402480.742843:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402480.742848:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.742852:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199229696 00010000:00010000:2.0:1789402480.742855:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8446 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.742863:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199229696 00010000:00010000:2.0:1789402480.742865:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742871:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742878:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742882:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402480.742885:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742890:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742898:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:2.0:1789402480.742901:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789402480.742903:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.742919:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8438 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.742954:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 31 00000100:00100000:3.0:1789402480.742964:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+19:10554:x1876324199229696:12345-192.168.203.8@tcp:49:lfs.0 00000100:00100000:3.0:1789402480.743259:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+19:10554:x1876324199229696:12345-192.168.203.8@tcp:49:lfs.0 Request processed in 294us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402480.743268:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 31 00000100:00100000:2.0:1789402480.743295:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+18:10555:x1876324199229440:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 30135us (30349us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789402480.743303:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 127 00000020:00080000:2.0:1789402480.743307:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789402480.746733:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789402480.746744:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789402480.747663:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402480.747713:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000040:00080000:1.0:1789402480.747949:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789402480.747963:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789402480.748130:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199230208 00000100:00100000:2.0:1789402480.748144:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199230208 00000100:00100000:2.0:1789402480.748216:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 128 00000100:00100000:2.0:1789402480.748228:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:10554:x1876324199230208:12345-192.168.203.8@tcp:58:lfs.0 00000040:00080000:2.0:1789402480.748747:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789402480.748852:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:10554:x1876324199230208:12345-192.168.203.8@tcp:58:lfs.0 Request processed in 624us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402480.748861:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 128 00000100:00100000:0.0:1789402480.749311:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199229952 00000100:00100000:0.0:1789402480.749320:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199229952 00000100:00100000:0.0:1789402480.749417:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 32 00000100:00100000:0.0:1789402480.749428:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:10555:x1876324199229952:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789402480.750106:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789402480.750233:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789402480.750296:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.750316:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.750330:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.750384:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.750392:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.750398:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.750426:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789402480.750528:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+20:10555:x1876324199229952:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 1098us (2869us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789402480.750546:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 32 00000020:00080000:0.0:1789402480.750553:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789402480.751578:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402480.751603:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.751614:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83c00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402480.751619:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.751629:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.751649:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c6c3a3e900) 00010000:00010000:3.0:1789402480.751652:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789402480.751659:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.751671:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f844d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402480.751695:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402480.751697:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402480.751699:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402480.787039:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402480.787771:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199230336 00000100:00100000:2.0:1789402480.787785:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199230336 00000100:00100000:2.0:1789402480.788287:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 129 00000100:00100000:2.0:1789402480.788302:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+20:10558:x1876324199230336:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402480.788389:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402480.788432:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8454 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4729f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788522:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788540:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788572:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788590:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788598:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788604:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788906:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788920:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47260 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788939:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.788992:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47260 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.789010:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47260 expref: 21 pid: 5844 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.789027:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224407296:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402480.789146:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c7000723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402480.791870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402480.791965:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199230592 00000100:00100000:3.0:1789402480.792018:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199230592 00000100:00100000:3.0:1789402480.792089:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:3.0:1789402480.792168:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+22:5592:x1876324199230592:12345-192.168.203.8@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789402480.792238:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224407296:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402480.792273:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402480.792753:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+23:5592:x1876324199230592:12345-192.168.203.8@tcp:35:ldlm_bl.0 Request processed in 652us (892us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789402480.792761:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:3.0:1789402480.795065:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402480.795162:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199230720 00000100:00100000:2.0:1789402480.795176:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199230720 00010000:00010000:2.0:1789402480.795228:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47260 expref: 23 pid: 5844 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.795276:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 61 00000100:00100000:2.0:1789402480.795288:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+23:2351:x1876324199230720:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402480.795306:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402480.795314:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47260 expref: 23 pid: 5844 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.795330:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47260 expref: 23 pid: 5844 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.795474:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8374 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47260 expref: 23 pid: 5844 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.795495:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:2.0:1789402480.795502:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.795515:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.795524:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402480.795573:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402480.795738:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795748:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402480.795757:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+22:2351:x1876324199230720:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 471us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402480.795766:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 61 00000004:00200000:0.0:1789402480.795800:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789402480.795805:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402480.795829:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795844:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795854:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795861:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795868:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795875:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402480.795880:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795901:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795912:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402480.795915:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402480.795920:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795926:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f845b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795939:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795946:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795952:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795956:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402480.795959:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795965:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795973:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c6c30f8d00) 00010000:00010000:0.0:1789402480.795976:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402480.795979:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.795995:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.796039:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8454 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4729f expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.796055:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4729f expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402480.796062:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:0.0:1789402480.796065:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789402480.796067:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dee00, rc 0) 00000100:00100000:0.0:1789402480.796095:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+21:10558:x1876324199230336:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 7798us (9073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402480.796985:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 129 00010000:00010000:0.0:1789402481.123526:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402481.385120:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224407424:0@lo:400:kworker.0 00000100:00100000:1.0:1789402481.385237:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402481.385395:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224407424 00000100:00100000:2.0:1789402481.385416:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224407424 00000100:00100000:2.0:1789402481.385482:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789402481.385494:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224407424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402481.386383:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224407424:12345-0@lo:400:kworker.0 Request processed in 886us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402481.386395:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789402481.391681:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224407808:0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.391777:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402481.391846:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402481.391853:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224407936:0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.391896:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402481.391936:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224407680:0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.391965:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402481.391983:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789402481.391989:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224407552:0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.392011:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402481.392048:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224408064:0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.392071:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402481.392109:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224407936 00000100:00100000:0.0:1789402481.392118:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224407936 00000100:00100000:0.0:1789402481.392192:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224407680 00000100:00100000:0.0:1789402481.392195:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224407680 00000100:00100000:0.0:1789402481.392212:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224407552 00000100:00100000:0.0:1789402481.392215:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224407552 00000100:00100000:0.0:1789402481.392233:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789402481.392242:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224407936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.392299:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224407936:12345-0@lo:400:kworker.0 Request processed in 57us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402481.392307:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789402481.392326:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789402481.392385:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224407680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.392750:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224407680:12345-0@lo:400:kworker.0 Request processed in 416us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402481.392758:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789402481.392773:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789402481.392781:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224407552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.392813:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224407552:12345-0@lo:400:kworker.0 Request processed in 34us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402481.392819:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789402481.392848:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224407808 00000100:00100000:0.0:1789402481.392854:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224407808 00000100:00100000:3.0:1789402481.392984:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224408064 00000100:00100000:3.0:1789402481.393000:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224408064 00000100:00100000:3.0:1789402481.393040:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789402481.393048:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1876324224408064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402481.393089:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1876324224408064:12345-0@lo:400:kworker.0 Request processed in 42us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402481.393096:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789402481.393524:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789402481.393532:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224407808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.393580:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224407808:12345-0@lo:400:kworker.0 Request processed in 49us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402481.393587:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1789402481.393607:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789402481.393613:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402481.393659:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224407552:0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.395565:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224408064:0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.395582:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224407680:0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.395654:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224407936:0@lo:400:kworker.0 00000100:00100000:0.0:1789402481.396511:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224407808:0@lo:400:kworker.0 00000100:00100000:1.0:1789402481.402183:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224407424:0@lo:400:kworker.0 00000040:00080000:0.0:1789402481.763697:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789402481.763712:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789402481.763758:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789402481.763766:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789402481.763935:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224408192:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789402481.764073:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d81a2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402481.779270:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224408192:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789402481.785746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402481.785987:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199230848 00000100:00100000:3.0:1789402481.786001:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199230848 00000100:00100000:3.0:1789402481.786075:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 130 00000100:00100000:3.0:1789402481.786087:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:10569:x1876324199230848:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789402481.786132:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789402481.786254:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:10569:x1876324199230848:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 170us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402481.786262:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 130 00000100:00100000:1.0:1789402481.789531:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402481.789638:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199231104 00000100:00100000:3.0:1789402481.789651:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199231104 00000100:00100000:3.0:1789402481.789815:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 131 00000100:00100000:3.0:1789402481.789829:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+21:10569:x1876324199231104:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789402481.789922:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402481.789952:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8470 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472a6 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.790082:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f8477 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.790099:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f8477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.790132:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f8477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402481.790149:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00020000:3.0:1789402481.790160:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:3.0:1789402481.790320:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8470 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472a6 expref: 24 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.790382:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f8477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472a6 expref: 23 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.790392:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402481.790395:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402481.790400:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90da00, rc 0) 00000100:00100000:3.0:1789402481.790480:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+23:10569:x1876324199231104:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 653us (962us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789402481.790488:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 131 00000100:00100000:3.0:1789402481.802094:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402481.802141:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199231360 00000100:00100000:3.0:1789402481.802153:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199231360 00000100:00100000:3.0:1789402481.802218:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 132 00000100:00100000:3.0:1789402481.802230:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+23:10569:x1876324199231360:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789402481.802365:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.802387:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.802484:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.802752:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.802762:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.802769:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.802776:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402481.802781:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.802790:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.802805:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402481.802808:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789402481.802814:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402481.802821:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8485 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402481.803085:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+24:10569:x1876324199231360:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 854us (1001us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789402481.803094:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 132 00000100:00100000:2.0:1789402481.805209:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402481.805316:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199231488 00000100:00100000:2.0:1789402481.805338:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199231488 00000100:00100000:2.0:1789402481.805434:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:2.0:1789402481.805446:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+24:2352:x1876324199231488:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402481.805465:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402481.805495:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f8477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472a6 expref: 24 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402481.805515:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:2.0:1789402481.805523:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402481.805579:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+23:2352:x1876324199231488:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 135us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402481.805586:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 8 00000040:00080000:3.0:1789402481.805702:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789402481.805709:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789402481.809441:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789402481.809467:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789402481.814132:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402481.814190:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199231744 00000100:00100000:2.0:1789402481.814202:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199231744 00000100:00100000:2.0:1789402481.814273:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 34 00000100:00100000:2.0:1789402481.814285:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+23:10569:x1876324199231744:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789402481.814616:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+24:10569:x1876324199231744:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 331us (496us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789402481.814624:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 34 00000100:00100000:1.0:1789402481.894393:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224408320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789402481.894499:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402481.894611:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224408320 00000100:00100000:1.0:1789402481.894621:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224408320 00000100:00100000:1.0:1789402481.895405:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789402481.895422:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3316:x1876324224408320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402481.895475:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402481.895551:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3316:x1876324224408320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402481.895559:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789402481.895692:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224408320:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789402481.937038:0:12112:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789402481.937050:0:12112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789402481.937098:0:12112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789402481.937105:0:12112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789402482.092803:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402482.092948:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199232000 00000100:00100000:1.0:1789402482.093061:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199232000 00000100:00100000:1.0:1789402482.093186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 133 00000100:00100000:1.0:1789402482.093198:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+24:10582:x1876324199232000:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402482.093233:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402482.093262:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f848c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402482.093434:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f8493 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402482.093451:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f8493 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402482.093466:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f8493 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402482.093486:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00020000:1.0:1789402482.093496:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2208192004097 00010000:00010000:1.0:1789402482.093658:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f848c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472ad expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402482.093679:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f8493 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472ad expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402482.093688:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:1.0:1789402482.093691:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789402482.093696:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83f400, rc 0) 00000100:00100000:1.0:1789402482.093777:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+26:10582:x1876324199232000:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 582us (987us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789402482.093786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 133 00000100:00080000:0.0:1789402482.097785:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402482.099493:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402482.099605:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199232128 00000100:00100000:3.0:1789402482.099618:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199232128 00000100:00100000:3.0:1789402482.099704:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 134 00000100:00100000:3.0:1789402482.099717:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+26:10582:x1876324199232128:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:3.0:1789402482.099962:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402482.099986:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402482.100001:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402482.100036:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402482.100044:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402482.100051:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402482.100059:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402482.100064:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402482.100081:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402482.100095:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402482.100098:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789402482.100104:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402482.100110:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f84a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402482.100197:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+26:10582:x1876324199232128:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 481us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402482.100206:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 134 00010000:00010000:0.0:1789402482.146567:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402482.187483:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402482.187514:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199232256 00000100:00100000:1.0:1789402482.187527:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199232256 00000100:00100000:1.0:1789402482.187609:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 46 00000100:00100000:1.0:1789402482.187622:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+6:2353:x1876324199232256:12345-192.168.203.8@tcp:101:cat.0 00010000:00010000:1.0:1789402482.187646:0:12073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1789402482.187701:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789402482.187745:0:12073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c9eabea/0x9403f4af875f84a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472b4 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402482.187781:0:12073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa81d6e, atime: 0x6aa81d6e, ctime: 0x6aa81d6e, blocks: 0xb 00010000:00010000:1.0:1789402482.187808:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:1.0:1789402482.187813:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402482.187824:0:12073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c9eabea/0x9403f4af875f84a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472b4 expref: 7 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402482.187932:0:12073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c9eabea/0x9403f4af875f84a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472b4 expref: 7 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402482.187956:0:12073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83fa00, rc 0) 00000100:00100000:1.0:1789402482.188034:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+7:2353:x1876324199232256:12345-192.168.203.8@tcp:101:cat.0 Request processed in 415us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402482.188042:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 46 00000100:00100000:0.0:1789402482.197046:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402482.197165:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199232384 00000100:00100000:3.0:1789402482.197178:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199232384 00002000:00100000:3.0:1789402482.197244:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93c6da91f100 x1876324199232384/t0(0) o3->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:398/0 lens 488/0 e 0 to 0 dl 1789402493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789402482.197257:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6da91f100 with x1876324199232384 ext(0->4095) 00002000:00010000:3.0:1789402482.197264:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6da91f100 00000100:00100000:3.0:1789402482.197339:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:3.0:1789402482.197378:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:2354:x1876324199232384:12345-192.168.203.8@tcp:3:cat.0 00000100:00100000:3.0:1789402482.197694:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:2354:x1876324199232384:12345-192.168.203.8@tcp:3:cat.0 Request processed in 318us (662us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789402482.197704:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 3 00002000:00100000:3.0:1789402482.197712:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93c6da91f100 x1876324199232384/t0(0) o3->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:398/0 lens 488/4536 e 0 to 0 dl 1789402493 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789402482.198065:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6da91f100 with x1876324199232384 ext(0->4095) 00002000:00010000:3.0:1789402482.198071:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6da91f100 00000100:00100000:0.0:1789402482.403556:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224408448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789402482.403857:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402482.404536:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224408448 00000100:00100000:3.0:1789402482.404550:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224408448 00000100:00100000:3.0:1789402482.404624:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789402482.404638:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224408448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402482.404691:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402482.404756:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224408448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402482.404764:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789402482.404872:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224408448:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789402483.084125:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1789402483.084162:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1789402483.084189:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1789402483.173984:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402483.239313:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402483.239406:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402483.239447:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402483.239459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199232512 00000100:00100000:2.0:1789402483.239472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402483.239475:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199232512 00000100:00100000:2.0:1789402483.239508:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402483.239546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 291 00000100:00100000:1.0:1789402483.239560:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2352:x1876324199232512:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402483.239564:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199232768 00000100:00100000:2.0:1789402483.239571:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199232768 00000100:00100000:2.0:1789402483.239619:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199232896 00000100:00100000:2.0:1789402483.239622:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199232896 00000100:00100000:2.0:1789402483.239644:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 80 00000100:00100000:2.0:1789402483.239653:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199232768:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402483.239716:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199232768:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 64us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402483.239724:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 80 00000100:00100000:2.0:1789402483.239742:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 81 00000100:00100000:2.0:1789402483.239749:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199232896:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402483.239796:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199232896:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 48us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402483.239803:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 81 00000100:00100000:2.0:1789402483.239836:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199233024 00000100:00100000:2.0:1789402483.239840:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199233024 00000100:00100000:2.0:1789402483.239883:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199232640 00000100:00100000:2.0:1789402483.239886:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199232640 00000100:00100000:1.0:1789402483.239910:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2352:x1876324199232512:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 351us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402483.239911:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 142 00000100:00100000:2.0:1789402483.239925:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2352:x1876324199233024:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402483.239925:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 291 00000100:00100000:2.0:1789402483.239964:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2352:x1876324199233024:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 42us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402483.239971:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 142 00000100:00100000:2.0:1789402483.239984:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 143 00000100:00100000:2.0:1789402483.239990:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+26:2352:x1876324199232640:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402483.240027:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+26:2352:x1876324199232640:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 37us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402483.240033:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 143 00000100:00080000:1.0:1789402483.240956:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789402483.240976:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789402484.196075:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402485.220534:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789402485.923737:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789402485.923748:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789402485.923779:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789402485.923785:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1789402486.111791:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1789402486.111809:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789402486.111816:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1789402486.116785:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:2.0:1789402486.116805:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c6d8318840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789402486.116810:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e6197a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c6d8318480 00000020:00080000:2.0:1789402486.116813:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e6197d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c6ff645000 00000001:00080000:2.0:1789402486.116845:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1789402486.116875:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789402486.118133:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789402486.118403:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1789402486.242560:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402486.501490:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224408960:0@lo:400:kworker.0 00000100:00100000:0.0:1789402486.501557:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402486.501620:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789402486.501627:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224408576:0@lo:400:kworker.0 00000100:00100000:0.0:1789402486.501655:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402486.501676:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224409088:0@lo:400:kworker.0 00000100:00100000:0.0:1789402486.501699:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402486.501771:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224408960 00000100:00100000:1.0:1789402486.501779:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224408960 00000100:00100000:1.0:1789402486.501840:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789402486.501850:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224408960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402486.501911:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224408960:12345-0@lo:400:kworker.0 Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402486.501932:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789402486.502095:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224408576 00000100:00100000:2.0:1789402486.502100:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224408576 00000100:00100000:2.0:1789402486.502138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789402486.502145:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224408576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402486.502180:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224408576:12345-0@lo:400:kworker.0 Request processed in 36us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402486.502186:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789402486.502211:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224409088 00000100:00100000:2.0:1789402486.502215:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224409088 00000100:00100000:2.0:1789402486.502243:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789402486.502249:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224409088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402486.502277:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224409088:12345-0@lo:400:kworker.0 Request processed in 29us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402486.502283:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1789402486.502370:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789402486.502374:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789402486.502399:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224408576:0@lo:400:kworker.0 00000100:00100000:0.0:1789402486.502411:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224409088:0@lo:400:kworker.0 00000100:00100000:0.0:1789402486.502419:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789402486.502424:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789402486.502441:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6ff642a00, transno 4294967304 00000100:00100000:0.0:1789402486.502460:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224408960:0@lo:400:kworker.0 00000100:00100000:3.0:1789402486.502843:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224408704:0@lo:400:kworker.0 00000100:00100000:3.0:1789402486.502882:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402486.502921:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224409216:0@lo:400:kworker.0 00000100:00100000:3.0:1789402486.502944:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402486.502962:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402486.502967:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224408832:0@lo:400:kworker.0 00000100:00100000:3.0:1789402486.502985:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402486.503422:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224408704 00000100:00100000:1.0:1789402486.503428:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224408704 00000100:00100000:1.0:1789402486.503464:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224408832 00000100:00100000:1.0:1789402486.503468:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224408832 00000100:00100000:1.0:1789402486.503492:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789402486.503499:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224408704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402486.503554:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224408704:12345-0@lo:400:kworker.0 Request processed in 55us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402486.503561:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789402486.503576:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789402486.503582:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224408832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402486.503608:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224408832:12345-0@lo:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402486.503613:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789402486.503647:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224408832:0@lo:400:kworker.0 00000100:00100000:1.0:1789402486.503658:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224408704:0@lo:400:kworker.0 00000100:00100000:0.0:1789402486.503867:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224409216 00000100:00100000:0.0:1789402486.503884:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224409216 00000100:00100000:0.0:1789402486.503927:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789402486.503935:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224409216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402486.503975:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224409216:12345-0@lo:400:kworker.0 Request processed in 42us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402486.503982:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789402486.503997:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789402486.504001:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402486.504015:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789402486.504020:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6fb46b800, transno 4294967309 00000004:00080000:0.0:1789402486.504027:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c5c282dc00, transno 4294967310 00000004:00080000:0.0:1789402486.504031:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1789402486.504045:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224409216:0@lo:400:kworker.0 00000100:00100000:3.0:1789402487.011209:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224409344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402487.011281:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402487.011386:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224409344 00000100:00100000:3.0:1789402487.011402:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224409344 00000100:00100000:3.0:1789402487.011450:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789402487.011459:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224409344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789402487.011511:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402487.011559:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224409344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402487.011565:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789402487.011616:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224409344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402487.267557:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402487.529639:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402487.529660:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224409472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402487.529726:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402487.529796:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224409472 00000100:00100000:3.0:1789402487.529804:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224409472 00000100:00100000:3.0:1789402487.529849:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789402487.529857:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224409472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402487.529890:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402487.529932:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224409472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402487.529938:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789402487.529981:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224409472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402487.833257:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402487.833372:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199233152 00000100:00100000:1.0:1789402487.833382:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199233152 00000100:00100000:1.0:1789402487.833461:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 135 00000100:00100000:1.0:1789402487.833470:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+13:10234:x1876324199233152:12345-192.168.203.8@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789402487.833574:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+13:10234:x1876324199233152:12345-192.168.203.8@tcp:60:lhsmtool_posix.0 Request processed in 105us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402487.833581:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 135 00000100:00080000:0.0:1789402487.833900:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402487.840979:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402487.841089:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199233408 00000100:00100000:2.0:1789402487.841099:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199233408 00000100:00100000:2.0:1789402487.841156:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 35 00000100:00100000:2.0:1789402487.841166:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+13:10234:x1876324199233408:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789402487.841532:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:10234:x1876324199233408:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 366us (560us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789402487.841539:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 35 00010000:00010000:3.0:1789402488.290583:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402488.357639:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402488.357866:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199233536 00000100:00100000:1.0:1789402488.357877:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199233536 00000100:00100000:1.0:1789402488.357943:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 293 00000100:00100000:1.0:1789402488.357954:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199233536:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402488.358030:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199233536:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 78us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402488.358046:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 293 00000100:00100000:3.0:1789402488.358731:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402488.358766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402488.358797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402488.358838:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402488.358878:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199233792 00000100:00100000:3.0:1789402488.359192:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199233792 00000100:00100000:3.0:1789402488.359246:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199233920 00000100:00100000:3.0:1789402488.359250:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199233920 00000100:00100000:3.0:1789402488.359273:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 84 00000100:00100000:3.0:1789402488.359292:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199233792:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402488.359339:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199233792:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 59us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402488.359364:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 84 00000100:00100000:3.0:1789402488.359382:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 85 00000100:00100000:3.0:1789402488.359388:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199233920:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402488.359413:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199233920:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402488.359419:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 85 00000100:00100000:2.0:1789402488.359477:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199234048 00000100:00100000:2.0:1789402488.359481:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199234048 00000100:00100000:2.0:1789402488.359513:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199233664 00000100:00100000:2.0:1789402488.359516:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199233664 00000100:00100000:2.0:1789402488.359535:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 147 00000100:00100000:2.0:1789402488.359541:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199234048:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402488.359569:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199234048:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 29us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402488.359584:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 147 00000100:00100000:2.0:1789402488.359599:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 148 00000100:00100000:2.0:1789402488.359606:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199233664:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402488.359633:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199233664:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 28us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402488.359639:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 148 00000100:00080000:0.0:1789402488.359778:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789402488.359783:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789402488.359785:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789402489.314633:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789402489.954227:0:12311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:14:47 (1789402487) 00010000:00010000:3.0:1789402490.339879:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789402491.222051:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1789402491.222084:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789402491.222327:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789402491.222339:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789402491.362666:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402491.622117:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224409856:0@lo:400:kworker.0 00000100:00100000:3.0:1789402491.622192:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402491.622267:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789402491.622274:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224409728:0@lo:400:kworker.0 00000100:00100000:3.0:1789402491.622297:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402491.622312:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224410240:0@lo:400:kworker.0 00000100:00100000:3.0:1789402491.622334:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402491.622390:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224410240 00000100:00100000:3.0:1789402491.622398:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224410240 00000100:00100000:3.0:1789402491.622462:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789402491.622472:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224410240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402491.622477:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224409600:0@lo:400:kworker.0 00000100:00100000:0.0:1789402491.622521:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402491.622526:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224410240:12345-0@lo:400:kworker.0 Request processed in 56us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402491.622532:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789402491.622555:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789402491.622555:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224410112:0@lo:400:kworker.0 00000100:00100000:0.0:1789402491.622577:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402491.622581:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224410240:0@lo:400:kworker.0 00000100:00100000:0.0:1789402491.622591:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789402491.622596:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224409984:0@lo:400:kworker.0 00000100:00100000:0.0:1789402491.622617:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402491.622675:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224409600 00000100:00100000:0.0:1789402491.622677:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224409984 00000100:00100000:2.0:1789402491.622680:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224409600 00000100:00100000:0.0:1789402491.622680:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224409984 00000100:00100000:2.0:1789402491.622708:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789402491.622710:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789402491.622714:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224409600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402491.622714:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224409984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789402491.622797:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789402491.622814:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224409856 00000100:00100000:3.0:1789402491.622818:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224409856 00000100:00100000:3.0:1789402491.622847:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224409728 00000100:00100000:3.0:1789402491.622850:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224409728 00000100:00100000:3.0:1789402491.622861:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224410112 00000100:00100000:3.0:1789402491.622863:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224410112 00000100:00100000:3.0:1789402491.622877:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789402491.622882:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224409856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402491.622915:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224409856:12345-0@lo:400:kworker.0 Request processed in 33us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402491.622921:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789402491.622932:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789402491.622939:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224409728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402491.622961:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224409728:12345-0@lo:400:kworker.0 Request processed in 24us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402491.622966:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789402491.622975:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789402491.622981:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224410112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402491.623191:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224409984:12345-0@lo:400:kworker.0 Request processed in 33us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402491.623199:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789402491.623248:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224409728:0@lo:400:kworker.0 00000100:00100000:0.0:1789402491.623272:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224409856:0@lo:400:kworker.0 00000100:00100000:1.0:1789402491.626393:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224409984:0@lo:400:kworker.0 00000100:00100000:1.0:1789402491.626418:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224409600:0@lo:400:kworker.0 00000100:00100000:1.0:1789402491.626430:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224410112:0@lo:400:kworker.0 00000100:00080000:0.0:1789402491.628011:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402491.632142:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224409600:12345-0@lo:400:kworker.0 Request processed in 9415us (9607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402491.632161:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789402491.632626:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224410112:12345-0@lo:400:kworker.0 Request processed in 9641us (10044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402491.632660:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789402491.658265:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402491.658397:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199234304 00000100:00100000:1.0:1789402491.658409:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199234304 00000100:00080000:0.0:1789402491.658469:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402491.658479:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 136 00000100:00100000:1.0:1789402491.658489:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+13:11293:x1876324199234304:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789402491.658511:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402491.658546:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f84af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472bb expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.658617:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.658635:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.658647:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.658686:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.658695:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.658702:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.659324:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f84c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.659335:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f84c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.659376:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f84c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789402491.659384:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000004:00200000:1.0:1789402491.688031:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789402491.688984:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.688999:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689007:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689013:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402491.689017:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689038:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689174:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c6d2ca6900) 00010000:00010000:1.0:1789402491.689177:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402491.689183:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689190:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f84b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689205:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689211:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689218:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689223:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402491.689226:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689232:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689238:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93c6d8cd8a00) 00010000:00010000:1.0:1789402491.689241:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402491.689244:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.689269:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.693876:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f84af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472bb expref: 16 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.693907:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f84c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472bb expref: 15 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402491.693917:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:1.0:1789402491.693920:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402491.693924:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e000, rc 0) 00000100:00100000:1.0:1789402491.693996:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+15:11293:x1876324199234304:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 35508us (35893us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789402491.694005:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 136 00000100:00100000:0.0:1789402491.713606:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402491.713829:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199234432 00000100:00100000:3.0:1789402491.713839:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199234432 00000100:00100000:3.0:1789402491.713908:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:3.0:1789402491.713918:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+15:2353:x1876324199234432:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402491.713931:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402491.713952:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f84c4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472bb expref: 15 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402491.713970:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:3.0:1789402491.713975:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402491.714027:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:2353:x1876324199234432:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 111us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402491.714035:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:0.0:1789402491.727321:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402491.727941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199234560 00000100:00100000:1.0:1789402491.727951:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199234560 00000100:00100000:0.0:1789402491.739847:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 137 00000100:00100000:0.0:1789402491.739863:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+14:11293:x1876324199234560:12345-192.168.203.8@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789402491.739995:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+14:11293:x1876324199234560:12345-192.168.203.8@tcp:59:lhsmtool_posix.0 Request processed in 134us (12684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402491.740003:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 137 00000040:00080000:0.0:1789402492.070730:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789402492.070739:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789402492.074768:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789402492.074797:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789402492.130949:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402492.130973:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224410368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402492.131054:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402492.132740:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224410368 00000100:00100000:1.0:1789402492.132753:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224410368 00000100:00100000:1.0:1789402492.132826:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789402492.132835:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224410368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402492.132873:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402492.132942:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224410368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402492.132949:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789402492.132997:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224410368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789402492.386756:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402492.647194:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224410496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402492.647288:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402492.647393:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224410496 00000100:00100000:3.0:1789402492.647402:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224410496 00000100:00100000:3.0:1789402492.647446:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789402492.647456:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224410496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402492.647488:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402492.647542:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224410496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402492.647549:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789402492.650098:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224410496:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789402493.410530:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402493.472757:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402493.472824:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402493.472879:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402493.472900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402493.472926:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402493.472986:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199235072 00000100:00100000:0.0:1789402493.472999:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199235072 00000100:00100000:0.0:1789402493.473066:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199234944 00000100:00100000:0.0:1789402493.473070:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199234944 00000100:00100000:0.0:1789402493.473097:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 88 00000100:00100000:0.0:1789402493.473108:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199235072:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402493.473199:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199235072:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 92us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402493.473208:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 88 00000100:00100000:0.0:1789402493.473226:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 89 00000100:00100000:0.0:1789402493.473234:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199234944:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402493.473274:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199234944:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 40us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402493.473281:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 89 00000100:00080000:0.0:1789402493.473300:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789402493.473305:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789402493.473812:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199234816 00000100:00100000:1.0:1789402493.473821:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199234816 00000100:00100000:1.0:1789402493.473882:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199235200 00000100:00100000:1.0:1789402493.473885:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199235200 00000100:00100000:1.0:1789402493.473918:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 152 00000100:00100000:1.0:1789402493.473927:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199234816:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402493.473985:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199234816:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 59us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402493.473992:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 152 00000100:00100000:1.0:1789402493.474010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 153 00000100:00100000:1.0:1789402493.474016:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199235200:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402493.474039:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199235200:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 24us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402493.474044:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 153 00000100:00100000:1.0:1789402493.474062:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199234688 00000100:00100000:1.0:1789402493.474066:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199234688 00000100:00100000:1.0:1789402493.474092:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 295 00000100:00100000:1.0:1789402493.474097:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199234688:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402493.474120:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199234688:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 23us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402493.474125:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 295 00000100:00080000:0.0:1789402493.474483:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402494.215968:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402494.216566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199235328 00000100:00100000:2.0:1789402494.216583:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199235328 00000100:00100000:2.0:1789402494.216653:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 138 00000100:00100000:2.0:1789402494.216665:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:11335:x1876324199235328:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402494.216686:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402494.216706:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.216787:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.216801:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.216813:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.216827:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.216834:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.216841:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217254:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217264:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217270:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217276:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402494.217281:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217299:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217315:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:2.0:1789402494.217318:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402494.217324:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217330:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f84d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217372:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217379:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217386:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217391:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402494.217394:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217400:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217406:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402494.217409:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402494.217412:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217429:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217470:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472c2 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217481:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:2.0:1789402494.217484:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402494.217488:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472c2 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.217497:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dfc00, rc 0) 00000100:00100000:2.0:1789402494.217715:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:11335:x1876324199235328:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1051us (1762us total) trans 0 rc 301/301 00000100:00100000:2.0:1789402494.217723:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 138 00000100:00100000:2.0:1789402494.239193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402494.239268:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199235584 00000100:00100000:1.0:1789402494.239283:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199235584 00000100:00100000:2.0:1789402494.239535:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 139 00000100:00100000:2.0:1789402494.239565:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+14:11335:x1876324199235584:12345-192.168.203.8@tcp:36:lfs.0 00010000:00010000:2.0:1789402494.239628:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402494.239661:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f7e5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47102 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.239681:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:2.0:1789402494.239691:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402494.239900:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.239924:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.239934:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.239947:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.239953:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.239959:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402494.240885:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789402494.240897:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.240904:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.240911:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.240917:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402494.240922:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.240929:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.240952:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402494.240954:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402494.240959:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.240965:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f84e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402494.240981:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063007ace reply state 000000008c138f3c transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402494.240988:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789402494.241440:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+15:11335:x1876324199235584:12345-192.168.203.8@tcp:36:lfs.0 Request processed in 1888us (2252us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789402494.241449:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 139 00010000:00010000:1.0:1789402494.259405:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.259452:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.259462:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.259469:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402494.259475:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.259487:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.259508:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c6c30f8b00) 00010000:00010000:1.0:1789402494.259512:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402494.259518:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.259524:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f84ee lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402494.342157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402494.343209:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199235712 00000100:00100000:1.0:1789402494.343222:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199235712 00000100:00100000:1.0:1789402494.343311:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 140 00000100:00100000:1.0:1789402494.343323:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+14:11343:x1876324199235712:12345-192.168.203.8@tcp:101:lctl.0 00010000:00010000:1.0:1789402494.343514:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402494.343541:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472c9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.343702:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f84fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.343716:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f84fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.343727:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f84fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402494.344100:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789402494.344105:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402494.357256:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f84fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.357311:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f84f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472c9 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.357335:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f84fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472c9 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.357361:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:0.0:1789402494.357364:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789402494.357382:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e600, rc 0) 00000100:00100000:0.0:1789402494.357746:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+15:11343:x1876324199235712:12345-192.168.203.8@tcp:101:lctl.0 Request processed in 14244us (15415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402494.357756:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 140 00010000:00010000:3.0:1789402494.437598:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402494.440413:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402494.440553:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199235840 00000100:00100000:1.0:1789402494.440572:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199235840 00000100:00100000:1.0:1789402494.440626:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 141 00000100:00100000:1.0:1789402494.440636:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+15:11349:x1876324199235840:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:1.0:1789402494.440654:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402494.440674:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8503 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472d0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440730:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440744:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440756:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440781:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440802:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440810:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440909:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f8518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440918:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f8518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440925:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f8518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402494.440952:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789402494.440956:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402494.440972:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f8518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440983:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440989:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.440995:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441000:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402494.441004:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441017:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441029:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:1.0:1789402494.441032:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402494.441037:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441055:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f850a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441070:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441076:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441082:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441087:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402494.441090:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441096:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441103:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c6d8cd8000) 00010000:00010000:1.0:1789402494.441106:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402494.441109:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441125:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8511 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441156:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8503 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d0 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441168:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f8518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d0 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.441175:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:1.0:1789402494.441177:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789402494.441179:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e800, rc 0) 00000100:00100000:1.0:1789402494.441251:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+16:11349:x1876324199235840:12345-192.168.203.8@tcp:101:bash.0 Request processed in 616us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402494.441259:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 141 00000100:00100000:3.0:1789402494.443982:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402494.444076:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199236096 00000100:00100000:2.0:1789402494.444087:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199236096 00000100:00100000:2.0:1789402494.444141:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 142 00000100:00100000:2.0:1789402494.444152:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+16:11349:x1876324199236096:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:2.0:1789402494.444172:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402494.444193:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f851f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472d7 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.444336:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.444374:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.444398:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.444449:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.444457:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.444463:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789402494.445558:0:6712:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789402494.445725:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.445738:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.445748:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789402494.445755:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023256130 00000004:00020000:2.0:1789402494.447158:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023256130 00010000:00010000:3.0:1789402494.472121:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.472138:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.472147:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.472153:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402494.472158:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.472165:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.472181:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402494.472184:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402494.472189:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.472195:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8526 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789402494.472211:0:6712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049571679 reply state 000000003265ca69 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402494.472248:0:6712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789402494.472296:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f851f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d7 expref: 19 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.472325:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d7 expref: 18 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.472333:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:3.0:1789402494.472335:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402494.472338:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de800, rc 0) 00000100:00100000:3.0:1789402494.472631:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+19:11349:x1876324199236096:12345-192.168.203.8@tcp:101:bash.0 Request processed in 28480us (28657us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789402494.472643:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 142 00010000:00010000:2.0:1789402494.474020:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.474033:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.474040:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.474146:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402494.474151:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.474157:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.474170:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402494.474173:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402494.474177:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.474184:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f852d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402494.548717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402494.548847:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199236224 00000100:00100000:0.0:1789402494.548857:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199236224 00000100:00100000:0.0:1789402494.548915:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:0.0:1789402494.548925:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199236224:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402494.548943:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402494.548963:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472de expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789402494.548989:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402494.549009:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1789402494.549014:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402494.549023:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472de expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.549054:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472de expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.549069:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83a00, rc 0) 00000100:00100000:0.0:1789402494.549134:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+6:2354:x1876324199236224:12345-192.168.203.8@tcp:101:bash.0 Request processed in 211us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402494.549141:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:3.0:1789402494.557464:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402494.557766:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199236352 00000100:00100000:0.0:1789402494.557775:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199236352 00000100:00100000:0.0:1789402494.557841:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:0.0:1789402494.557850:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+6:11349:x1876324199236352:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402494.557867:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402494.557886:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472e5 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.557917:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472de expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.557927:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402494.557931:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402494.557937:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.557968:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472de expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.557990:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472de expref: 7 pid: 6689 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402494.558004:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1876324224410624:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402494.568760:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402494.586336:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1876324224410624:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402494.586407:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.586427:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82000, rc 0) 00000100:00100000:3.0:1789402494.586484:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:11349:x1876324199236352:12345-192.168.203.8@tcp:101:bash.0 Request processed in 28635us (29035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402494.586493:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:3.0:1789402494.587528:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402494.593641:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199236480 00000100:00100000:1.0:1789402494.593657:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199236480 00010000:00010000:1.0:1789402494.593709:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472de expref: 7 pid: 6689 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402494.593755:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 62 00000100:00100000:1.0:1789402494.593765:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199236480:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402494.593780:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402494.593803:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472de expref: 7 pid: 6689 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.593836:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472de expref: 7 pid: 6689 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.593861:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fffd8dba/0x9403f4af875f8542 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472de expref: 7 pid: 6689 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.593878:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402494.593883:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402494.593891:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.593902:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.593943:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402494.593959:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1876324224410752:192.168.203.8@tcp:105: 00000100:00100000:1.0:1789402494.594036:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c74b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789402494.614471:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402494.614590:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1876324224410752:192.168.203.8@tcp:105: 00010000:00010000:1.0:1789402494.614620:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402494.614676:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199236480:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 20911us (27153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402494.614690:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 62 00000100:00100000:0.0:1789402494.614883:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199236736 00000100:00100000:0.0:1789402494.614891:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199236736 00000100:00100000:0.0:1789402494.614940:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 36 00000100:00100000:0.0:1789402494.614949:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+18:11349:x1876324199236736:12345-192.168.203.8@tcp:35:bash.0 00000100:00100000:0.0:1789402494.615283:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+19:11349:x1876324199236736:12345-192.168.203.8@tcp:35:bash.0 Request processed in 335us (822us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789402494.615303:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 36 00000100:00100000:2.0:1789402494.760754:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402494.760861:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199236992 00000100:00100000:1.0:1789402494.760870:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199236992 00000100:00100000:1.0:1789402494.760930:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 143 00000100:00100000:1.0:1789402494.760941:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+19:11359:x1876324199236992:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402494.760965:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402494.760987:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472ec expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402494.761088:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789402494.761209:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8550 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472ec expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.761222:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:1.0:1789402494.761225:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789402494.761238:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472ec expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.761253:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83ea00, rc 0) 00000100:00100000:1.0:1789402494.761535:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+20:11359:x1876324199236992:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 595us (790us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1789402494.761543:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 143 00000100:00100000:1.0:1789402494.772397:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402494.772545:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199237248 00000100:00100000:0.0:1789402494.772556:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199237248 00000100:00100000:0.0:1789402494.772611:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 37 00000100:00100000:0.0:1789402494.772622:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+20:11359:x1876324199237248:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:0.0:1789402494.772870:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+21:11359:x1876324199237248:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 241us (476us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789402494.772878:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 37 00000100:00100000:3.0:1789402494.879880:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402494.880006:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199237376 00000100:00100000:0.0:1789402494.880016:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199237376 00000100:00100000:0.0:1789402494.880088:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 144 00000100:00100000:0.0:1789402494.880098:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:11365:x1876324199237376:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402494.880119:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402494.880139:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f855e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472f3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.880204:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.880218:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.880240:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402494.880275:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789402494.880278:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402494.880305:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.880331:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f855e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472f3 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.880399:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472f3 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.880408:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:0.0:1789402494.880411:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789402494.880415:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:0.0:1789402494.880466:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+22:11365:x1876324199237376:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 369us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402494.880473:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 144 00000100:00100000:3.0:1789402494.899591:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402494.899696:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199237632 00000100:00100000:2.0:1789402494.899707:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199237632 00000100:00100000:2.0:1789402494.899768:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 145 00000100:00100000:2.0:1789402494.899780:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+22:11365:x1876324199237632:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402494.899800:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402494.899821:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f856c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b472fa expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.899922:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.899950:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.899963:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402494.899976:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000004:00020000:2.0:1789402494.899985:0:5845:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133187 00010000:00010000:2.0:1789402494.900122:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f856c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472fa expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.900142:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472fa expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.900151:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:2.0:1789402494.900154:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402494.900158:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dec00, rc 0) 00000100:00100000:2.0:1789402494.900218:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+24:11365:x1876324199237632:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 440us (635us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789402494.900226:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 145 00000100:00100000:1.0:1789402494.903869:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402494.903951:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402494.904026:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199237760 00000100:00100000:2.0:1789402494.904037:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199237760 00000100:00100000:2.0:1789402494.904109:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:2.0:1789402494.904119:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+24:2352:x1876324199237760:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402494.904137:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402494.904161:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472fa expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.904198:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:2.0:1789402494.904203:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402494.904270:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+23:2352:x1876324199237760:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 152us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402494.904277:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:0.0:1789402494.904674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199238016 00000100:00100000:0.0:1789402494.904680:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199238016 00000100:00100000:0.0:1789402494.904711:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 146 00000100:00100000:0.0:1789402494.904719:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+23:11365:x1876324199238016:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402494.904737:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402494.904754:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8581 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47301 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.904853:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.904868:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.904879:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402494.904901:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000004:00020000:0.0:1789402494.904910:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2268287991810 00010000:00010000:0.0:1789402494.905021:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8581 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47301 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.905037:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47301 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.905055:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:0.0:1789402494.905058:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789402494.905061:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83000, rc 0) 00000100:00100000:0.0:1789402494.905091:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+25:11365:x1876324199238016:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 373us (1140us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789402494.905098:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 146 00000100:00100000:0.0:1789402494.922959:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402494.923061:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199238144 00000100:00100000:3.0:1789402494.923071:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199238144 00000100:00100000:3.0:1789402494.923132:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:3.0:1789402494.923143:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199238144:12345-192.168.203.8@tcp:1:lfs.0 00010000:00010000:3.0:1789402494.923186:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.923206:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.923214:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789402494.923219:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402494.923224:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.923268:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.923281:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 6 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402494.923294:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876324224410880:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402494.923396:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c9b5e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789402494.925800:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402494.925984:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199238272 00000100:00100000:0.0:1789402494.925992:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199238272 00002000:00100000:0.0:1789402494.926037:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93c6fb469500 x1876324199238272/t0(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:410/0 lens 504/0 e 0 to 0 dl 1789402505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789402494.926059:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6fb469500 with x1876324199238272 ext(0->12) 00010000:00010000:0.0:1789402494.926068:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 7 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.926085:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 7 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789402494.926110:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c6fb469500 00000100:00100000:0.0:1789402494.926144:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:0.0:1789402494.926153:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199238272:12345-192.168.203.8@tcp:4:lfs.0 00000100:00100000:0.0:1789402494.926691:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4785302d-2648-4148-8042-c10a24a5dd29+9:2351:x1876324199238272:12345-192.168.203.8@tcp:4:lfs.0 Request processed in 536us (897us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789402494.926701:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 2 00002000:00100000:0.0:1789402494.926709:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93c6fb469500 x1876324199238272/t4294967305(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:410/0 lens 504/448 e 0 to 0 dl 1789402505 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789402494.926718:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6fb469500 with x1876324199238272 ext(0->12) 00010000:00010000:0.0:1789402494.926726:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.926739:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789402494.926746:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c6fb469500 00000100:00100000:3.0:1789402494.927872:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8217:1876324224410880:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402494.927904:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402494.933641:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402494.934686:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199238400 00000100:00100000:2.0:1789402494.934698:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199238400 00010000:00010000:2.0:1789402494.934746:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402494.934920:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 63 00000100:00100000:2.0:1789402494.934931:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+9:2353:x1876324199238400:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402494.934947:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789402494.934967:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789402494.934970:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789402493 00002000:00010000:2.0:1789402494.934973:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789402494 00002000:00010000:2.0:1789402494.934975:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789402493 00010000:00010000:2.0:1789402494.934981:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.934995:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.935020:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a523c456/0x9403f4af875f8549 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472e5 expref: 9 pid: 6690 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.936904:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402494.936910:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402494.936918:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.936932:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.936979:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402494.937053:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+8:2353:x1876324199238400:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 2120us (3418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402494.937064:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 63 00010000:00010000:3.0:1789402494.937150:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.937161:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.937192:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.937200:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.937209:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.937216:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402494.937220:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.937237:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.937251:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.937276:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8596 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402494.937321:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199238144:12345-192.168.203.8@tcp:1:lfs.0 Request processed in 14180us (14370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402494.937329:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:0.0:1789402494.946020:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402494.946058:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199238656 00000100:00100000:0.0:1789402494.946067:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199238656 00000100:00100000:0.0:1789402494.946123:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 38 00000100:00100000:0.0:1789402494.946134:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e6e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+25:11365:x1876324199238656:12345-192.168.203.8@tcp:35:lfs.0 00000004:00010000:0.0:1789402494.946197:0:5848:0:(mdt_open.c:2006:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47301 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789402494.946483:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789402494.946527:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789402494.947020:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789402494.947075:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.947090:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d7 expref: 29 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.947098:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.947130:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d7 expref: 29 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402494.947145:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d7 expref: 29 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402494.947159:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876324224411008:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402494.947252:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402494.951483:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876324224411008:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402494.951514:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402494.951678:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402494.951961:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199238784 00000100:00100000:2.0:1789402494.951968:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199238784 00010000:00010000:2.0:1789402494.952004:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d7 expref: 30 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402494.952054:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 64 00000100:00100000:2.0:1789402494.952064:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+30:2351:x1876324199238784:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402494.952079:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402494.952086:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d7 expref: 30 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.952114:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d7 expref: 30 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.952136:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8534 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d7 expref: 30 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.952151:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:2.0:1789402494.952156:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.952165:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.952173:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.952207:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402494.952266:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+29:2351:x1876324199238784:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 203us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402494.952273:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 64 00010000:00010000:1.0:1789402494.952405:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402494.952424:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789402494.952540:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789402494.952749:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1789402494.952863:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224411136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789402494.952910:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402494.952940:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459300 going to sleep for 11 seconds 00000100:00100000:2.0:1789402494.953172:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224411136 00000100:00100000:2.0:1789402494.953179:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224411136 00000100:00100000:2.0:1789402494.953219:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789402494.953239:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876324224411136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789402494.953307:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876324224411136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402494.953313:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789402494.954930:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402494.954979:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224411136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789402494.955625:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789402494.955708:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224411264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789402494.955758:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402494.955788:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459900 going to sleep for 11 seconds 00000100:00100000:2.0:1789402494.955881:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224411264 00000100:00100000:2.0:1789402494.955887:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224411264 00000100:00100000:2.0:1789402494.955930:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789402494.955938:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876324224411264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789402494.956101:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876324224411264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (343us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789402494.956109:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789402494.956383:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876324224411264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789402494.956433:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789402494.956470:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.956479:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.956486:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.956492:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402494.956497:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.956504:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.956518:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:3.0:1789402494.956521:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789402494.956525:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402494.956543:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f859d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789402494.956712:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789402494.956840:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789402494.956850:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400105505841ns, next at 401105503887ns, rc = 0 00000001:00080000:3.0:1789402494.956856:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789402494.956884:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:3.0:1789402494.956887:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789402494.956893:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f8588 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47301 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402494.956976:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e6e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+32:11365:x1876324199238656:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 10845us (10966us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1789402494.956984:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 38 00000020:00080000:3.0:1789402494.956988:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789402494.962269:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402494.962382:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199238912 00000100:00100000:2.0:1789402494.962391:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199238912 00000100:00100000:2.0:1789402494.962442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 147 00000100:00100000:2.0:1789402494.962451:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+32:11365:x1876324199238912:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402494.962474:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402494.962496:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f85a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47308 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.962566:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f85a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47308 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.962581:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f85a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47308 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402494.962600:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402494.962603:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789402494.962607:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dfc00, rc 0) 00000100:00100000:2.0:1789402494.962654:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+33:11365:x1876324199238912:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 204us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402494.962661:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 147 00000100:00100000:0.0:1789402494.966990:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402494.967083:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199239168 00000100:00100000:3.0:1789402494.967093:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199239168 00000100:00100000:3.0:1789402494.967151:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:3.0:1789402494.967160:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+33:11365:x1876324199239168:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:3.0:1789402494.967412:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+34:11365:x1876324199239168:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 252us (430us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789402494.967420:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:0.0:1789402495.063883:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402495.063990:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199239424 00000100:00100000:2.0:1789402495.064000:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199239424 00000100:00100000:2.0:1789402495.064086:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 148 00000100:00100000:2.0:1789402495.064097:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+34:11375:x1876324199239424:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402495.064119:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1789402495.064244:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789402495.064395:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4730f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402495.064629:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789402495.064736:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4730f expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.064751:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:2.0:1789402495.064753:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789402495.064868:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4730f expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.064884:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de800, rc 0) 00000100:00100000:2.0:1789402495.064931:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+35:11375:x1876324199239424:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 837us (1058us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1789402495.064938:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 148 00000100:00100000:0.0:1789402495.068643:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402495.070797:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199239552 00000100:00100000:2.0:1789402495.070811:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199239552 00000100:00100000:2.0:1789402495.070874:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 149 00000100:00100000:2.0:1789402495.070884:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+35:11375:x1876324199239552:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:2.0:1789402495.070958:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.070991:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071002:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071018:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071025:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071031:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071505:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071518:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071525:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402495.071568:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071581:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071587:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071605:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071611:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402495.071616:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071623:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071634:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402495.071637:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402495.071642:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071648:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f85b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071661:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071666:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071672:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071677:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402495.071680:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071695:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071704:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c30f8500) 00010000:00010000:2.0:1789402495.071706:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402495.071709:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071715:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071728:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071735:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071740:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071746:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402495.071749:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071754:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071828:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402495.071830:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402495.071834:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.071850:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402495.071926:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+35:11375:x1876324199239552:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 1041us (3290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402495.071935:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 149 00000100:00100000:0.0:1789402495.074511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402495.074696:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199239808 00000100:00100000:3.0:1789402495.074708:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199239808 00000100:00100000:3.0:1789402495.074821:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 40 00000100:00100000:3.0:1789402495.074832:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+35:11375:x1876324199239808:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:3.0:1789402495.075075:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+36:11375:x1876324199239808:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 245us (573us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789402495.075083:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 40 00000100:00100000:0.0:1789402495.126122:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402495.126266:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199240064 00000100:00100000:3.0:1789402495.126275:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199240064 00000100:00100000:3.0:1789402495.126330:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 150 00000100:00100000:3.0:1789402495.126373:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+36:11378:x1876324199240064:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:3.0:1789402495.126398:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402495.126418:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f85ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47316 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126491:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126507:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126517:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126532:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126539:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126546:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126667:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126683:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126690:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789402495.126697:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:3.0:1789402495.126702:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000004:00020000:3.0:1789402495.126710:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:3.0:1789402495.126807:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126815:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126821:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126827:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402495.126831:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126839:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126850:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402495.126853:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402495.126858:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126864:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f85d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126887:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126893:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126899:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126904:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402495.126907:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126913:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126920:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6d2ca6700) 00010000:00010000:3.0:1789402495.126922:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402495.126924:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126930:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f85dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126971:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f85ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47316 expref: 39 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.126983:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47316 expref: 38 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402495.127002:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:3.0:1789402495.127004:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402495.127007:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90ca00, rc 0) 00000100:00100000:3.0:1789402495.127318:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+38:11378:x1876324199240064:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 978us (1203us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789402495.127327:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 150 00000100:00100000:0.0:1789402495.132059:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402495.132249:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199240192 00000100:00100000:2.0:1789402495.132259:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199240192 00000100:00100000:2.0:1789402495.132317:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 151 00000100:00100000:2.0:1789402495.132327:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+38:11378:x1876324199240192:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:2.0:1789402495.132414:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.132432:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.132444:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.132468:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.132476:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.132482:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.132489:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402495.132493:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.132511:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.132523:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402495.132525:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789402495.132531:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.132537:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402495.132621:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+38:11378:x1876324199240192:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 296us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402495.132629:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 151 00000100:00100000:0.0:1789402495.137576:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402495.137806:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199240448 00000100:00100000:1.0:1789402495.137815:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199240448 00000100:00100000:1.0:1789402495.137867:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:1.0:1789402495.137876:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+38:11378:x1876324199240448:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:1.0:1789402495.138306:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+39:11378:x1876324199240448:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 429us (737us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789402495.138314:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 41 00000040:00080000:2.0:1789402495.143976:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789402495.143985:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789402495.144219:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789402495.144234:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789402495.458703:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402495.551115:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402495.551219:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199240704 00000100:00100000:2.0:1789402495.551239:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199240704 00000100:00100000:2.0:1789402495.551310:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 152 00000100:00100000:2.0:1789402495.551320:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+39:11409:x1876324199240704:12345-192.168.203.8@tcp:101:cat.0 00010000:00010000:2.0:1789402495.551375:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402495.551400:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4731d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.551494:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.551527:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.551539:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402495.551551:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000004:00020000:2.0:1789402495.551572:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199065198593 00010000:00010000:2.0:1789402495.551691:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f85f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4731d expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.551710:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4731d expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.551719:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402495.551721:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402495.551724:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de000, rc 0) 00000100:00100000:2.0:1789402495.551797:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+41:11409:x1876324199240704:12345-192.168.203.8@tcp:101:cat.0 Request processed in 478us (692us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789402495.551805:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 152 00000100:00100000:0.0:1789402495.555032:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402495.557136:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402495.557424:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199241088 00000100:00100000:3.0:1789402495.557434:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199241088 00000100:00100000:3.0:1789402495.557490:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 42 00000100:00100000:3.0:1789402495.557500:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+41:11409:x1876324199241088:12345-192.168.203.8@tcp:35:cat.0 00000100:00100000:3.0:1789402495.557786:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+42:11409:x1876324199241088:12345-192.168.203.8@tcp:35:cat.0 Request processed in 286us (657us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789402495.557793:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 42 00000100:00100000:1.0:1789402495.560968:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199240832 00000100:00100000:1.0:1789402495.560984:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199240832 00000100:00100000:1.0:1789402495.561583:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:1.0:1789402495.561598:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+42:2351:x1876324199240832:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402495.561631:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402495.561658:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f85ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4731d expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.561680:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:1.0:1789402495.561685:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402495.561741:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+41:2351:x1876324199240832:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 148us (6719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402495.561747:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:0.0:1789402495.668943:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402495.670160:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199241344 00000100:00100000:2.0:1789402495.670175:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199241344 00000100:00100000:2.0:1789402495.670250:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 153 00000100:00100000:2.0:1789402495.670260:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+41:11415:x1876324199241344:12345-192.168.203.8@tcp:101:dd.0 00010000:00010000:2.0:1789402495.670282:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402495.670285:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789402495.670310:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472f3 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.670402:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402495.670409:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402495.670422:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f860d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47324 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.670512:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.670525:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47316 expref: 41 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.670533:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.670574:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47316 expref: 41 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.670586:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47316 expref: 41 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402495.670599:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224411392:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402495.670742:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789402495.684282:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402495.684667:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199241472 00000100:00100000:1.0:1789402495.684677:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199241472 00010000:00010000:1.0:1789402495.684718:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47316 expref: 42 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402495.684763:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 65 00000100:00100000:1.0:1789402495.684773:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+42:2352:x1876324199241472:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402495.684787:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402495.684794:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47316 expref: 42 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.684806:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47316 expref: 42 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.684828:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:1.0:1789402495.684832:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.684859:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.684867:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.684886:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402495.684943:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+42:2352:x1876324199241472:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 170us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402495.684951:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 65 00010000:00010000:2.0:1789402495.689094:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f85e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47316 expref: 41 pid: 6712 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402495.689122:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224411392:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402495.689163:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.689173:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.689179:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402495.689200:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000004:00020000:2.0:1789402495.689219:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:2.0:1789402495.689402:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f860d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47324 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.689417:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47324 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.689426:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402495.689429:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789402495.689432:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de800, rc 0) 00000100:00100000:2.0:1789402495.689486:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+41:11415:x1876324199241344:12345-192.168.203.8@tcp:101:dd.0 Request processed in 19227us (20569us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789402495.689494:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 153 00000100:00100000:0.0:1789402495.695527:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402495.695642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199241728 00000100:00100000:2.0:1789402495.695654:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199241728 00000100:00100000:2.0:1789402495.695711:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 154 00000100:00100000:2.0:1789402495.695721:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+41:11415:x1876324199241728:12345-192.168.203.8@tcp:36:dd.0 00010000:00010000:2.0:1789402495.696258:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.696286:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402495.696298:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789402495.696376:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789402495.696401:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008125a71f reply state 00000000ad015cc1 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402495.696410:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789402495.696507:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+44:11415:x1876324199241728:12345-192.168.203.8@tcp:36:dd.0 Request processed in 786us (988us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789402495.696514:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 154 00000020:00080000:2.0:1789402495.696519:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789402495.698264:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.698278:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.698285:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.698290:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402495.698295:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.698302:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.698316:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:1.0:1789402495.698320:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402495.698325:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402495.698390:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8622 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402496.167052:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402496.167172:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199241856 00000100:00100000:3.0:1789402496.167182:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199241856 00000100:00100000:3.0:1789402496.167251:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 155 00000100:00100000:3.0:1789402496.167261:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+43:11430:x1876324199241856:12345-192.168.203.8@tcp:101:stat.0 00010000:00010000:3.0:1789402496.167284:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402496.167307:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8629 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4732b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167521:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167535:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167562:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167578:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167584:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167590:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167738:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167749:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47324 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167757:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167791:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47324 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.167805:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47324 expref: 44 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402496.167819:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224411520:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402496.167990:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e011fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402496.174914:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224411520:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402496.174946:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402496.180862:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402496.181017:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199242112 00000100:00100000:3.0:1789402496.181027:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199242112 00000100:00100000:3.0:1789402496.181085:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 43 00000100:00100000:3.0:1789402496.181095:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+45:5592:x1876324199242112:12345-192.168.203.8@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789402496.181457:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+46:5592:x1876324199242112:12345-192.168.203.8@tcp:35:ldlm_bl.0 Request processed in 362us (614us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789402496.181465:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 43 00000100:00100000:0.0:1789402496.192728:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402496.192992:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199242240 00000100:00100000:2.0:1789402496.193002:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199242240 00010000:00010000:2.0:1789402496.193045:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47324 expref: 46 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402496.193087:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 66 00000100:00100000:2.0:1789402496.193097:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+46:2352:x1876324199242240:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402496.193112:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402496.193119:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47324 expref: 46 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.193144:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47324 expref: 46 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.193165:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8614 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47324 expref: 46 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.193181:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402496.193185:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.193194:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.193202:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.193236:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402496.193290:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+45:2352:x1876324199242240:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 194us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402496.193297:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 66 00010000:00010000:3.0:1789402496.193367:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193375:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402496.193419:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789402496.193424:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402496.193449:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193461:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193470:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193477:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193493:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193500:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402496.193504:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193512:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193522:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402496.193526:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402496.193530:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193536:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8630 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193548:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193554:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193560:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193564:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402496.193567:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193581:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193590:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6d2ca6700) 00010000:00010000:3.0:1789402496.193592:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402496.193595:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193601:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8637 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193648:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8629 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4732b expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193662:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4732b expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.193669:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:3.0:1789402496.193671:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402496.193673:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c400, rc 0) 00000100:00100000:3.0:1789402496.193701:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+44:11430:x1876324199241856:12345-192.168.203.8@tcp:101:stat.0 Request processed in 26441us (26659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402496.193708:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 155 00000100:00100000:0.0:1789402496.329789:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402496.329862:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199242496 00000100:00100000:3.0:1789402496.329873:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199242496 00000100:00100000:3.0:1789402496.329931:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 156 00000100:00100000:3.0:1789402496.329941:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+44:11436:x1876324199242496:12345-192.168.203.8@tcp:36:truncate.0 00010000:00010000:3.0:1789402496.330005:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402496.330030:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f863e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4732b expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.330058:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:3.0:1789402496.330063:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789402496.330399:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.330415:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.330426:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789402496.330478:0:6712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789402496.330504:0:6712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4ff16bb reply state 00000000ef297d0d transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402496.330513:0:6712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789402496.330602:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+46:11436:x1876324199242496:12345-192.168.203.8@tcp:36:truncate.0 Request processed in 662us (821us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789402496.330610:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 156 00000020:00080000:3.0:1789402496.330614:0:6712:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789402496.336529:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.336547:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.336556:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.336583:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402496.336588:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.336596:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.336613:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:3.0:1789402496.336616:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402496.336621:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.336626:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8645 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789402496.345876:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967426 is committed 00000001:00080000:2.0:1789402496.345904:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000020:00080000:2.0:1789402496.345918:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c6c5459a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789402496.345924:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e0a4d700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c6c5459300 00000020:00080000:2.0:1789402496.345927:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e0a4df00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c700226000 00000001:00080000:2.0:1789402496.345948:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000001:00080000:2.0:1789402496.345969:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000004:00080000:2.0:1789402496.345995:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1789402496.346211:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789402496.346238:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224411648:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1789402496.346249:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1789402496.346301:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789402496.346432:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789402496.346483:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224411648 00000100:00100000:0.0:1789402496.346491:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224411648 00000100:00100000:0.0:1789402496.346553:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789402496.346562:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876324224411648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789402496.346593:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789402496.346624:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa81d7d, atime: 0x6aa81d7e, ctime: 0x6aa81d7d, blocks: 0x1 00000100:00080000:1.0:1789402496.346633:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789402496.346633:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402496.346649:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1789402496.346654:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402496.346661:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402496.346676:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402496.346698:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402496.346707:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402496.346732:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789402496.347339:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224411648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 777us (1036us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789402496.347376:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1789402496.347405:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6e622fb80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789402496.347412:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224411648:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789402496.347639:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402496.347647:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.347657:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83c00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402496.347661:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.347671:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.347688:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.347695:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c74e588/0x9403f4af875f864c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.347713:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402496.347714:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402496.347716:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402496.482648:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402496.564123:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402496.574181:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199242624 00000100:00100000:2.0:1789402496.574196:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199242624 00000100:00100000:2.0:1789402496.574280:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 157 00000100:00100000:2.0:1789402496.574291:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+17:11450:x1876324199242624:12345-192.168.203.8@tcp:101:stat.0 00010000:00010000:2.0:1789402496.574314:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402496.574333:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8653 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47332 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574408:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574423:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574434:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574446:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574452:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574458:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574742:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574761:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574768:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402496.574801:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789402496.574806:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402496.574824:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574833:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574840:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574846:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574861:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574866:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402496.574870:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574878:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574897:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402496.574900:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402496.574905:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574910:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f865a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574922:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574928:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574933:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574937:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402496.574939:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574944:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574950:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c30f8200) 00010000:00010000:2.0:1789402496.574952:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402496.574954:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574960:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.574998:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8653 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47332 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.575272:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47332 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.575279:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402496.575281:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402496.575283:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de200, rc 0) 00000100:00100000:2.0:1789402496.575405:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+18:11450:x1876324199242624:12345-192.168.203.8@tcp:101:stat.0 Request processed in 1114us (11290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402496.575412:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 157 00000100:00100000:0.0:1789402496.709047:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402496.709130:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199242880 00000100:00100000:3.0:1789402496.709141:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199242880 00000100:00100000:3.0:1789402496.709200:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 158 00000100:00100000:3.0:1789402496.709211:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+18:11460:x1876324199242880:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:3.0:1789402496.709241:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402496.709260:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f866f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47339 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402496.709374:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789402496.711037:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f866f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47339 expref: 20 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.711072:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:3.0:1789402496.711075:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789402496.711080:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f866f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47339 expref: 20 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.711094:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90ce00, rc 0) 00000100:00100000:3.0:1789402496.711202:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+19:11460:x1876324199242880:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1992us (2163us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1789402496.711210:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 158 00000100:00100000:0.0:1789402496.721328:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402496.721439:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199243136 00000100:00100000:3.0:1789402496.721449:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199243136 00000100:00100000:3.0:1789402496.721556:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:3.0:1789402496.721568:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+19:11460:x1876324199243136:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:3.0:1789402496.721791:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+20:11460:x1876324199243136:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 225us (470us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789402496.721799:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:1.0:1789402496.738656:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224411776:0@lo:400:kworker.0 00000100:00100000:1.0:1789402496.738731:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402496.738844:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224411776 00000100:00100000:3.0:1789402496.738861:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224411776 00000100:00100000:0.0:1789402496.738878:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224411904:0@lo:400:kworker.0 00000100:00100000:3.0:1789402496.738911:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789402496.738918:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402496.738923:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224411776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402496.747500:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224412160:0@lo:400:kworker.0 00000100:00100000:0.0:1789402496.747517:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224412032:0@lo:400:kworker.0 00000100:00100000:0.0:1789402496.748523:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402496.748542:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789402496.748555:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224412288:0@lo:400:kworker.0 00000100:00100000:2.0:1789402496.748598:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402496.748630:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224412288 00000100:00100000:2.0:1789402496.748638:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224412288 00000100:00100000:0.0:1789402496.748640:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224411904 00000100:00100000:0.0:1789402496.748644:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224411904 00000100:00100000:0.0:1789402496.748679:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224412032 00000100:00100000:0.0:1789402496.748681:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224412032 00000100:00100000:2.0:1789402496.748683:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789402496.748691:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224412288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402496.748699:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789402496.748705:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224411904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402496.748739:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224411904:12345-0@lo:400:kworker.0 Request processed in 34us (9822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402496.748741:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224412288:12345-0@lo:400:kworker.0 Request processed in 52us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402496.748747:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789402496.748756:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789402496.748768:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789402496.748772:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224412032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402496.748784:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224412288:0@lo:400:kworker.0 00000100:00100000:2.0:1789402496.748795:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224411904:0@lo:400:kworker.0 00000100:00100000:0.0:1789402496.748803:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224412032:12345-0@lo:400:kworker.0 Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402496.748807:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789402496.748824:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402496.748833:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224412032:0@lo:400:kworker.0 00000100:00100000:0.0:1789402496.748846:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224412160 00000100:00100000:0.0:1789402496.748849:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224412160 00000100:00100000:0.0:1789402496.748870:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789402496.748876:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224412160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402496.748905:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224412160:12345-0@lo:400:kworker.0 Request processed in 30us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402496.748911:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789402496.748932:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224412160:0@lo:400:kworker.0 00000100:00080000:0.0:1789402496.748933:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789402496.748938:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402496.749304:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3315:x1876324224411776:12345-0@lo:400:kworker.0 Request processed in 10382us (10569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402496.749315:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789402496.758043:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224411776:0@lo:400:kworker.0 00000100:00100000:0.0:1789402496.811337:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402496.811467:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199243392 00000100:00100000:2.0:1789402496.811478:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199243392 00000100:00100000:2.0:1789402496.811538:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 159 00000100:00100000:2.0:1789402496.811549:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+20:11466:x1876324199243392:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:2.0:1789402496.811573:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402496.811594:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f867d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47340 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.811688:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.811704:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47332 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.811714:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.811745:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47332 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.811759:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47332 expref: 21 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402496.811772:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c998a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224412416:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402496.811850:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789402496.821472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402496.821550:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199243520 00000100:00100000:1.0:1789402496.821560:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199243520 00010000:00010000:1.0:1789402496.821601:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47332 expref: 22 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402496.821642:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 67 00000100:00100000:1.0:1789402496.821652:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+22:2352:x1876324199243520:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402496.821668:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402496.821675:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47332 expref: 22 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.821687:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47332 expref: 22 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.821709:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:1.0:1789402496.821714:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.821724:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.821732:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.821752:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402496.821816:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+22:2352:x1876324199243520:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 165us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402496.821823:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 67 00010000:00010000:2.0:1789402496.823200:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f8668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47332 expref: 21 pid: 5846 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402496.823233:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c998a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224412416:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402496.823256:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.823266:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.823272:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402496.823294:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00020000:2.0:1789402496.823315:0:5845:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:2.0:1789402496.823511:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f867d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47340 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.823525:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47340 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.823534:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402496.823536:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789402496.823539:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df400, rc 0) 00000100:00100000:2.0:1789402496.823588:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+21:11466:x1876324199243392:12345-192.168.203.8@tcp:101:bash.0 Request processed in 12040us (12261us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789402496.823596:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 159 00000100:00100000:0.0:1789402496.839284:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402496.839376:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199243776 00000100:00100000:2.0:1789402496.839385:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199243776 00000100:00100000:2.0:1789402496.839453:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 160 00000100:00100000:2.0:1789402496.839462:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+21:11466:x1876324199243776:12345-192.168.203.8@tcp:36:bash.0 00010000:00010000:2.0:1789402496.839705:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.839722:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.839733:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789402496.839778:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1789402496.839800:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081079f68 reply state 0000000001a002e0 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402496.839809:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789402496.839893:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+24:11466:x1876324199243776:12345-192.168.203.8@tcp:36:bash.0 Request processed in 431us (617us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789402496.839900:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 160 00000020:00080000:2.0:1789402496.839905:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789402496.846579:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.846599:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.846608:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.846615:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402496.846620:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.846628:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.846646:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:1.0:1789402496.846650:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402496.846655:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402496.846661:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8692 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402496.860021:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402496.860274:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199243904 00000100:00100000:3.0:1789402496.860285:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199243904 00000100:00100000:3.0:1789402496.860395:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 161 00000100:00100000:3.0:1789402496.860405:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+23:11466:x1876324199243904:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:3.0:1789402496.860429:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402496.860451:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8699 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47347 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.860548:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.860562:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47340 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.860570:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.860602:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47340 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.860627:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47340 expref: 24 pid: 5845 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402496.860641:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224412544:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402496.860721:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e011fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402496.865337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402496.866636:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199244032 00000100:00100000:2.0:1789402496.866646:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199244032 00010000:00010000:2.0:1789402496.866688:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47340 expref: 25 pid: 5845 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402496.866716:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 68 00000100:00100000:2.0:1789402496.866724:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+25:2351:x1876324199244032:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402496.866737:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402496.866752:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47340 expref: 25 pid: 5845 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.866777:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47340 expref: 25 pid: 5845 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.866799:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402496.866805:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.866814:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.866822:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.866837:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402496.867394:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+25:2351:x1876324199244032:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 668us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402496.867403:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 68 00010000:00010000:3.0:1789402496.870046:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8684 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47340 expref: 24 pid: 5845 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402496.870071:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224412544:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402496.870094:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.870120:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.870127:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402496.870177:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789402496.870182:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402496.870202:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.870247:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8699 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47347 expref: 24 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.870262:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47347 expref: 23 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402496.870271:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:3.0:1789402496.870274:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402496.870277:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c400, rc 0) 00000100:00100000:3.0:1789402496.870335:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+23:11466:x1876324199243904:12345-192.168.203.8@tcp:101:bash.0 Request processed in 9931us (10325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402496.870382:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 161 00000100:00100000:0.0:1789402496.885273:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402496.887802:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199244288 00000100:00100000:1.0:1789402496.887816:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199244288 00000100:00100000:1.0:1789402496.887883:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:1.0:1789402496.887895:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+23:11466:x1876324199244288:12345-192.168.203.8@tcp:35:bash.0 00000100:00100000:1.0:1789402496.888557:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+24:11466:x1876324199244288:12345-192.168.203.8@tcp:35:bash.0 Request processed in 661us (3291us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789402496.888566:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:0.0:1789402496.990533:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402496.990762:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199244544 00000100:00100000:2.0:1789402496.990772:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199244544 00000100:00100000:2.0:1789402496.990832:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 162 00000100:00100000:2.0:1789402496.990841:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+24:11476:x1876324199244544:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402496.990960:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402496.990980:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4734e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402496.991135:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789402496.991391:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4734e expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.992121:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:2.0:1789402496.992127:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789402496.992136:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4734e expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402496.992152:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de200, rc 0) 00000100:00100000:2.0:1789402496.992273:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+25:11476:x1876324199244544:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1431us (1749us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789402496.992281:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 162 00000100:00100000:0.0:1789402497.007074:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402497.007231:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199244672 00000100:00100000:2.0:1789402497.007242:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199244672 00000100:00100000:2.0:1789402497.007313:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 163 00000100:00100000:2.0:1789402497.007326:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+25:11476:x1876324199244672:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:2.0:1789402497.007443:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007460:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007471:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007486:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007492:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007514:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007812:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007820:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007827:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402497.007865:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007878:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007883:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007890:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007897:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402497.007902:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007910:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007922:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402497.007930:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402497.007936:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007943:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007956:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007963:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007970:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007975:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402497.007977:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007984:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.007992:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c30f8200) 00010000:00010000:2.0:1789402497.007994:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402497.008201:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.008210:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.008235:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.008249:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.008255:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.008260:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402497.008264:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.008271:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.008280:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402497.008282:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402497.008286:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.008292:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402497.008407:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+25:11476:x1876324199244672:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 1083us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402497.008417:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 163 00000100:00080000:0.0:1789402497.008499:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402497.010412:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402497.010527:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199244928 00000100:00100000:3.0:1789402497.010536:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199244928 00000100:00100000:3.0:1789402497.010586:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 46 00000100:00100000:3.0:1789402497.010596:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+25:11476:x1876324199244928:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:3.0:1789402497.010830:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+26:11476:x1876324199244928:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 235us (426us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789402497.010845:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 46 00000100:00100000:0.0:1789402497.065829:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402497.065977:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199245184 00000100:00100000:2.0:1789402497.065987:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199245184 00000100:00100000:2.0:1789402497.066043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 164 00000100:00100000:2.0:1789402497.066053:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+26:11479:x1876324199245184:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402497.066077:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402497.066111:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47355 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066182:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066195:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066207:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066230:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066237:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066244:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066553:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f86df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066562:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f86df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066569:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f86df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789402497.066576:0:5844:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:2.0:1789402497.066580:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00020000:2.0:1789402497.066586:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:2.0:1789402497.066663:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066671:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066677:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066683:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402497.066687:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066694:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066705:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402497.066709:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402497.066713:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066719:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f86d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066729:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066735:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066741:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066756:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402497.066764:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066771:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066778:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c30f8200) 00010000:00010000:2.0:1789402497.066781:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402497.066784:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066789:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f86d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066825:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47355 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066838:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f86df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47355 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.066844:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402497.066847:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402497.066849:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df400, rc 0) 00000100:00100000:2.0:1789402497.066905:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+28:11479:x1876324199245184:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 854us (1086us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789402497.066912:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 164 00000100:00100000:0.0:1789402497.073881:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402497.073928:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402497.073998:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199245312 00000100:00100000:2.0:1789402497.074009:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199245312 00000100:00100000:2.0:1789402497.074066:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 165 00000100:00100000:2.0:1789402497.074076:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+28:11479:x1876324199245312:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:2.0:1789402497.074151:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.074167:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.074179:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.074203:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.074210:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.074228:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.074234:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402497.074239:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.074247:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.074257:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:2.0:1789402497.074260:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789402497.074264:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.074270:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f86ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402497.074373:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+28:11479:x1876324199245312:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 270us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402497.074381:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 165 00000100:00100000:1.0:1789402497.074606:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199245440 00000100:00100000:1.0:1789402497.074611:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199245440 00000100:00100000:1.0:1789402497.074647:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:1.0:1789402497.074653:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+28:2353:x1876324199245440:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402497.074663:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402497.074677:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f86df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47355 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402497.074687:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:1.0:1789402497.074690:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402497.074720:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+27:2353:x1876324199245440:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 68us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402497.074727:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:0.0:1789402497.078902:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402497.078984:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199245696 00000100:00100000:3.0:1789402497.078995:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199245696 00000100:00100000:3.0:1789402497.079056:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:3.0:1789402497.079067:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+27:11479:x1876324199245696:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:3.0:1789402497.079382:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+28:11479:x1876324199245696:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 279us (451us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789402497.079393:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:2.0:1789402497.251587:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224412672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789402497.251660:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402497.251996:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224412672 00000100:00100000:0.0:1789402497.252005:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224412672 00000100:00100000:0.0:1789402497.252057:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789402497.252067:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224412672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789402497.252100:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789402497.252162:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224412672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402497.252169:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789402497.252689:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224412672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789402497.287538:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402497.287692:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199245952 00000100:00100000:0.0:1789402497.287703:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199245952 00000100:00100000:0.0:1789402497.287768:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 166 00000100:00100000:0.0:1789402497.287779:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+28:11497:x1876324199245952:12345-192.168.203.8@tcp:101:cat.0 00010000:00010000:0.0:1789402497.287805:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402497.287827:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f86f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4735c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402497.287922:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f86fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402497.287940:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f86fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402497.287952:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f86fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402497.287982:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00020000:0.0:1789402497.287991:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602069505 00010000:00010000:0.0:1789402497.288116:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f86f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4735c expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402497.288137:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f86fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4735c expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402497.288146:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:0.0:1789402497.288149:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789402497.288152:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:0.0:1789402497.288274:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+30:11497:x1876324199245952:12345-192.168.203.8@tcp:101:cat.0 Request processed in 497us (747us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789402497.288281:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 166 00000100:00100000:0.0:1789402497.326093:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402497.326199:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199246080 00000100:00100000:2.0:1789402497.326209:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199246080 00000100:00100000:2.0:1789402497.326278:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 167 00000100:00100000:2.0:1789402497.326289:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+30:11498:x1876324199246080:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402497.326315:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402497.326338:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47363 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.326430:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8710 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.326456:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.326468:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402497.326501:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789402497.326505:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402497.326523:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.326564:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47363 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.326582:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47363 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.326590:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402497.326593:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789402497.326596:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de600, rc 0) 00000100:00100000:2.0:1789402497.326660:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+31:11498:x1876324199246080:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 373us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402497.326668:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 167 00000100:00100000:1.0:1789402497.337678:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402497.337782:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199246464 00000100:00100000:3.0:1789402497.337793:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199246464 00000100:00100000:3.0:1789402497.337848:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:3.0:1789402497.337859:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+31:11498:x1876324199246464:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:3.0:1789402497.338163:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+32:11498:x1876324199246464:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 306us (494us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789402497.338171:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:0.0:1789402497.341996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402497.342118:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199246592 00000100:00100000:1.0:1789402497.342128:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199246592 00000100:00100000:1.0:1789402497.342250:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:1.0:1789402497.342261:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+32:11498:x1876324199246592:12345-192.168.203.8@tcp:103:lfs.0 00010000:00010000:1.0:1789402497.342277:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789402497.342304:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f86a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47347 expref: 32 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402497.342327:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f86fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4735c expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402497.342340:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f85a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47308 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402497.342490:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8f00) 00010000:00010000:1.0:1789402497.342500:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402497.342689:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+29:11498:x1876324199246592:12345-192.168.203.8@tcp:103:lfs.0 Request processed in 429us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402497.342717:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:0.0:1789402497.349257:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402497.349638:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199246720 00000100:00100000:2.0:1789402497.349648:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199246720 00000100:00100000:2.0:1789402497.349755:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 168 00000100:00100000:2.0:1789402497.349766:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+29:11498:x1876324199246720:12345-192.168.203.8@tcp:58:lfs.0 00010000:00010000:2.0:1789402497.349869:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.349888:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.349899:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789402497.350239:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789402497.350336:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+29:11498:x1876324199246720:12345-192.168.203.8@tcp:58:lfs.0 Request processed in 571us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402497.350611:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 168 00000100:00100000:0.0:1789402497.383423:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402497.383519:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199246848 00000100:00100000:2.0:1789402497.383529:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199246848 00000100:00100000:2.0:1789402497.383596:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 169 00000100:00100000:2.0:1789402497.383727:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+29:11500:x1876324199246848:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402497.383748:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402497.383769:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f871e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4736a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.383832:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.383846:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.383858:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.383874:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.383882:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.383889:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384443:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384466:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384473:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402497.384511:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789402497.384516:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402497.384533:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384545:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384552:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384559:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384565:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384572:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402497.384576:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384583:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384595:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402497.384598:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402497.384835:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384844:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8725 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384858:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384864:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384869:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384874:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402497.384877:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384884:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384893:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c30f8500) 00010000:00010000:2.0:1789402497.384895:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402497.384898:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384903:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f872c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384937:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f871e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4736a expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384963:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4736a expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402497.384971:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:2.0:1789402497.384973:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789402497.384976:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dec00, rc 0) 00000100:00100000:2.0:1789402497.385056:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+30:11500:x1876324199246848:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1449us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402497.385064:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 169 00010000:00010000:1.0:1789402497.509817:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402497.764116:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224412800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789402497.764188:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402497.764299:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224412800 00000100:00100000:3.0:1789402497.764308:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224412800 00000100:00100000:3.0:1789402497.764392:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789402497.764402:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224412800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402497.764437:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402497.764499:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224412800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402497.764507:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789402497.764560:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224412800:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789402498.211114:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789402498.211122:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789402498.211173:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789402498.211185:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789402498.211326:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224412928:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789402498.211455:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789402498.216995:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224412928:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789402498.220003:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.220894:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199246976 00000100:00100000:3.0:1789402498.220905:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199246976 00000100:00100000:3.0:1789402498.220979:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 170 00000100:00100000:3.0:1789402498.220989:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+30:11511:x1876324199246976:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789402498.221019:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789402498.221123:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+30:11511:x1876324199246976:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 135us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402498.221131:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 170 00000100:00100000:1.0:1789402498.227046:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.227126:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199247104 00000100:00100000:3.0:1789402498.227135:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199247104 00000100:00100000:3.0:1789402498.227194:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 171 00000100:00100000:3.0:1789402498.227242:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+30:11511:x1876324199247104:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789402498.227316:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227333:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227374:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227390:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227410:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227417:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227894:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227905:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227912:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402498.227950:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789402498.227954:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402498.227966:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227976:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227983:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227991:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.227997:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.228002:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228010:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228021:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:3.0:1789402498.228031:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402498.228036:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228043:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f873a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228055:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228062:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228068:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228074:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.228077:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228083:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228090:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff93c6d2ca6c00) 00010000:00010000:3.0:1789402498.228093:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402498.228096:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228102:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8741 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228116:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228127:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228133:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228137:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.228140:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228146:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228154:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:3.0:1789402498.228156:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402498.228159:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.228165:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402498.228257:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+30:11511:x1876324199247104:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 Request processed in 1053us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402498.228266:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 171 00000100:00100000:1.0:1789402498.237487:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.237941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199247360 00000100:00100000:3.0:1789402498.237951:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199247360 00000100:00100000:3.0:1789402498.238007:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 172 00000100:00100000:3.0:1789402498.238017:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+30:11511:x1876324199247360:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789402498.238037:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402498.238067:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f874f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47371 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238161:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238176:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238190:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402498.238241:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00020000:3.0:1789402498.238250:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:3.0:1789402498.238362:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238370:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238378:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238384:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.238389:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238589:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238605:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:3.0:1789402498.238608:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789402498.238614:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238628:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238670:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f874f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47371 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238681:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:3.0:1789402498.238684:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789402498.238872:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f874f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47371 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.238884:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d000, rc 0) 00000100:00100000:3.0:1789402498.238948:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+31:11511:x1876324199247360:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 931us (1471us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1789402498.238956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 172 00000100:00100000:2.0:1789402498.245447:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.245525:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199247488 00000100:00100000:3.0:1789402498.245545:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199247488 00000100:00100000:3.0:1789402498.245606:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 173 00000100:00100000:3.0:1789402498.245616:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+31:11511:x1876324199247488:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789402498.245652:0:6712:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789402498.245768:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+31:11511:x1876324199247488:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 152us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402498.245776:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 173 00000100:00100000:0.0:1789402498.290848:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402498.290890:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199247744 00000100:00100000:0.0:1789402498.290900:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199247744 00000100:00100000:0.0:1789402498.290947:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 174 00000100:00100000:0.0:1789402498.290955:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+31:11511:x1876324199247744:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402498.290975:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402498.290984:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789402498.291010:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8710 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47363 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.291027:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:0.0:1789402498.291031:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402498.291045:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8764 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47378 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789402498.292222:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789402498.292497:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f876b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.292512:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f876b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.292522:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f876b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789402498.292530:0:5846:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:0.0:1789402498.292541:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:0.0:1789402498.292585:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8764 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47378 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.292602:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f876b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47378 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.292610:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3ec00) 00010000:00010000:0.0:1789402498.292614:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789402498.292617:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83c00, rc 0) 00000100:00100000:0.0:1789402498.292690:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+32:11511:x1876324199247744:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 1734us (1850us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789402498.292699:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 174 00000100:00100000:1.0:1789402498.310475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402498.310511:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199248000 00000100:00100000:1.0:1789402498.310520:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199248000 00000100:00100000:1.0:1789402498.310569:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 175 00000100:00100000:1.0:1789402498.310579:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+32:11511:x1876324199248000:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789402498.310647:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402498.310675:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f876b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47378 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.310693:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3ec00) 00010000:00010000:1.0:1789402498.310705:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402498.310742:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.310757:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.310767:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.310781:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.310788:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.310796:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.310985:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.310994:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311002:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311008:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402498.311013:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311022:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311040:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:1.0:1789402498.311043:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402498.311048:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311055:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8779 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311065:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311072:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311079:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311084:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402498.311087:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311093:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311100:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa911a333 (ffff93c6d8cd8500) 00010000:00010000:1.0:1789402498.311102:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402498.311105:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.311112:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8780 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa911a333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402498.311199:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+31:11511:x1876324199248000:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 619us (730us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789402498.311217:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 175 00000100:00100000:3.0:1789402498.315623:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402498.315789:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199248128 00000100:00100000:0.0:1789402498.315800:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199248128 00000100:00100000:0.0:1789402498.315966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 176 00000100:00100000:0.0:1789402498.315979:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+31:11511:x1876324199248128:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402498.316001:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402498.316027:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8787 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4737f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.316064:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.316078:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.316089:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.316182:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8787 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4737f expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.316199:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4737f expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.316217:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:0.0:1789402498.316220:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789402498.316224:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82000, rc 0) 00000100:00100000:0.0:1789402498.316288:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+32:11511:x1876324199248128:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 312us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402498.316296:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 176 00000100:00100000:0.0:1789402498.335624:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402498.338394:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199248384 00000100:00100000:1.0:1789402498.338409:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199248384 00000100:00100000:1.0:1789402498.338476:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 177 00000100:00100000:1.0:1789402498.338487:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+32:11511:x1876324199248384:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789402498.338894:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.338913:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.338933:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789402498.339551:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789402498.339566:0:6712:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403488221225ns, next at 404488217655ns, rc = 0 00000004:00010000:1.0:1789402498.339656:0:6712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000433e02e reply state 00000000b249de56 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402498.339666:0:6712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789402498.339762:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+34:11511:x1876324199248384:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 1275us (4144us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789402498.339770:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 177 00010000:00010000:3.0:1789402498.341514:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.343074:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.343083:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.343091:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.343096:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.343105:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.343123:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:3.0:1789402498.343126:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789402498.343131:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.343137:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8795 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402498.343258:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402498.343907:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199248512 00000100:00100000:2.0:1789402498.343918:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199248512 00000100:00100000:2.0:1789402498.343969:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 178 00000100:00100000:2.0:1789402498.343979:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+33:11511:x1876324199248512:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402498.344001:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402498.344021:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47386 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.344076:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47386 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.344089:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47386 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.344121:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:2.0:1789402498.344124:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789402498.344127:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de400, rc 0) 00000100:00100000:2.0:1789402498.344181:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+34:11511:x1876324199248512:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 203us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402498.344188:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 178 00000100:00100000:1.0:1789402498.357977:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402498.358399:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199248640 00000100:00100000:1.0:1789402498.358409:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199248640 00000100:00100000:1.0:1789402498.358466:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 51 00000100:00100000:1.0:1789402498.358474:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199248640:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789402498.358786:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199248640:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 311us (816us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789402498.358795:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 51 00000100:00080000:1.0:1789402498.360408:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789402498.366067:0:12461:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789402498.366077:0:12461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789402498.366115:0:12461:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789402498.366120:0:12461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789402498.373322:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1789402498.373335:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1789402498.377682:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.379852:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199248896 00000100:00100000:3.0:1789402498.379864:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199248896 00000100:00100000:3.0:1789402498.379936:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:3.0:1789402498.379946:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+34:11511:x1876324199248896:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789402498.380191:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+35:11511:x1876324199248896:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 246us (2518us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789402498.380199:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:2.0:1789402498.388224:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402498.388388:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199249152 00000100:00100000:1.0:1789402498.388398:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199249152 00000100:00100000:1.0:1789402498.388460:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 179 00000100:00100000:1.0:1789402498.388471:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+35:11511:x1876324199249152:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789402498.388591:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+35:11511:x1876324199249152:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 122us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402498.388605:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 179 00000100:00100000:1.0:1789402498.390786:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402498.390942:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199249280 00000100:00100000:2.0:1789402498.390952:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199249280 00000100:00100000:2.0:1789402498.391164:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 180 00000100:00100000:2.0:1789402498.391176:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+35:11511:x1876324199249280:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402498.391193:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402498.391223:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f87a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4738d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.391286:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f87aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.391301:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f87aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.391312:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f87aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402498.391395:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402498.391415:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f87aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.391442:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f87a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4738d expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.391457:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f87aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4738d expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.391466:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:2.0:1789402498.391469:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789402498.391473:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de000, rc 0) 00000100:00100000:2.0:1789402498.393987:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+36:11511:x1876324199249280:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 2801us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402498.394002:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 180 00000100:00100000:2.0:1789402498.399537:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402498.399665:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199249408 00000100:00100000:0.0:1789402498.399675:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199249408 00000100:00100000:0.0:1789402498.399748:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 52 00000100:00100000:0.0:1789402498.399758:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199249408:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402498.399775:0:12073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402498.399796:0:12073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47394 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789402498.399820:0:12073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa81d81, blocks: 0x1 00010000:00010000:0.0:1789402498.399839:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789402498.399849:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402498.399857:0:12073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47394 expref: 8 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.399876:0:12073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47394 expref: 8 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.399888:0:12073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83600, rc 0) 00000100:00100000:0.0:1789402498.399946:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199249408:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 189us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402498.399952:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 52 00000100:00100000:2.0:1789402498.413439:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402498.413539:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199249664 00000100:00100000:1.0:1789402498.413548:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199249664 00000100:00100000:1.0:1789402498.413615:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 181 00000100:00100000:1.0:1789402498.413628:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+36:11511:x1876324199249664:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789402498.413733:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+36:11511:x1876324199249664:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 109us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402498.413740:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 181 00000100:00100000:2.0:1789402498.416918:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.417369:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199249792 00000100:00100000:3.0:1789402498.417379:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199249792 00000100:00100000:2.0:1789402498.417488:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00100000:2.0:1789402498.417499:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+8:11511:x1876324199249792:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402498.417532:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402498.417551:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4739b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.417582:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47394 expref: 9 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.417611:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402498.417616:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402498.417622:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.417655:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47394 expref: 9 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.417669:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47394 expref: 9 pid: 12073 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402498.417682:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1876324224413056:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402498.417771:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1fc9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789402498.420410:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ef3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1876324224413056:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402498.420458:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.420477:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df800, rc 0) 00000100:00100000:1.0:1789402498.420544:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:11511:x1876324199249792:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 3046us (3634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402498.420554:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00100000:3.0:1789402498.422403:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402498.423444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199249920 00000100:00100000:1.0:1789402498.423457:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199249920 00010000:00010000:1.0:1789402498.423514:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47394 expref: 9 pid: 12073 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402498.423557:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:1.0:1789402498.423567:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+9:2351:x1876324199249920:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402498.423589:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402498.423611:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47394 expref: 9 pid: 12073 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.423625:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47394 expref: 9 pid: 12073 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.423647:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db9425f/0x9403f4af875f87b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47394 expref: 9 pid: 12073 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.423664:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402498.423682:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402498.423692:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.423702:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.423741:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402498.423755:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb469f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876324224413184:192.168.203.8@tcp:105: 00000100:00100000:1.0:1789402498.423840:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789402498.434639:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402498.434693:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199250048 00000100:00100000:0.0:1789402498.434710:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199250048 00002000:00100000:0.0:1789402498.434762:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93c7006e9500 x1876324199250048/t0(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:414/0 lens 504/0 e 0 to 0 dl 1789402509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789402498.434773:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c7006e9500 with x1876324199250048 ext(0->8) 00002000:00010000:0.0:1789402498.434779:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c7006e9500 00000100:00100000:0.0:1789402498.434815:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:0.0:1789402498.434824:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:2352:x1876324199250048:12345-192.168.203.8@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789402498.435259:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4785302d-2648-4148-8042-c10a24a5dd29+11:2352:x1876324199250048:12345-192.168.203.8@tcp:4:lhsmtool_posix.0 Request processed in 434us (628us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789402498.435268:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 4 00002000:00100000:0.0:1789402498.435275:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93c7006e9500 x1876324199250048/t4294967314(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:414/0 lens 504/448 e 0 to 0 dl 1789402509 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789402498.435283:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c7006e9500 with x1876324199250048 ext(0->8) 00002000:00010000:0.0:1789402498.435286:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c7006e9500 00000100:00100000:2.0:1789402498.442004:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb469f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876324224413184:192.168.203.8@tcp:105: 00010000:00010000:2.0:1789402498.442031:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402498.442106:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+10:2351:x1876324199249920:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 18540us (19709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402498.442117:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:2.0:1789402498.442580:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402498.443920:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199250176 00000100:00100000:0.0:1789402498.443932:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199250176 00000100:00100000:0.0:1789402498.443989:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 182 00000100:00100000:0.0:1789402498.444000:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+36:11511:x1876324199250176:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789402498.498212:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:1.0:1789402498.498232:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1789402498.498239:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1789402498.498264:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1789402498.498280:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789402498.498426:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789402498.498437:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789402498.498453:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224413312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789402498.498518:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402498.498959:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:11511:x1876324199250176:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 Request processed in 54959us (56377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402498.498969:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 182 00000100:00100000:0.0:1789402498.498999:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224413312 00000100:00100000:0.0:1789402498.499004:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224413312 00000100:00100000:0.0:1789402498.499045:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789402498.499051:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224413312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789402498.499189:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789402498.499193:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789402497 00002000:00010000:0.0:1789402498.499196:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789402498.499198:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789402497 -> 1789402497 00002000:00010000:0.0:1789402498.499212:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789402498.499245:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224413312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (726us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789402498.499251:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789402498.499267:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789402498.499296:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6fb468000/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789402498.499301:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224413312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789402498.511830:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.512039:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199250304 00000100:00100000:3.0:1789402498.512049:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199250304 00000100:00100000:3.0:1789402498.512106:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 55 00000100:00100000:3.0:1789402498.512117:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+10:2352:x1876324199250304:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1789402498.537132:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789402498.590183:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1789402498.590210:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1789402498.590401:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199250304:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 Request processed in 78280us (78573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402498.590411:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 55 00000100:00100000:3.0:1789402498.590849:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.591115:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.591143:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199250560 00000100:00100000:3.0:1789402498.591151:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199250560 00000100:00100000:3.0:1789402498.591199:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 91 00000100:00100000:3.0:1789402498.591222:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199250560:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402498.591270:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2354:x1876324199250560:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 51us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402498.591278:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 91 00000100:00100000:3.0:1789402498.591301:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199250432 00000100:00100000:3.0:1789402498.591304:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199250432 00000100:00100000:3.0:1789402498.591328:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 297 00000100:00100000:3.0:1789402498.591334:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199250432:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402498.591381:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199250432:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 46us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402498.591398:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 297 00000100:00080000:0.0:1789402498.592877:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789402498.598953:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402498.599083:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402498.607125:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199250688 00000100:00100000:2.0:1789402498.607138:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199250688 00000100:00100000:2.0:1789402498.607239:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199250944 00000100:00100000:2.0:1789402498.607244:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199250944 00000100:00100000:2.0:1789402498.607273:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 157 00000100:00100000:2.0:1789402498.607283:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c282ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199250688:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402498.607384:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c282ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199250688:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 102us (8440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402498.607392:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 157 00000100:00100000:2.0:1789402498.607410:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 183 00000100:00100000:2.0:1789402498.607417:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+18:11511:x1876324199250944:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789402498.607461:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402498.607490:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f87aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4738d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.607505:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:2.0:1789402498.607511:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402498.607540:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.607554:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.607564:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402498.607837:0:6712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f8136ed reply state 0000000031455759 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402498.607848:0:6712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789402498.607908:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+19:11511:x1876324199250944:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 490us (8824us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789402498.607921:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 183 00000100:00080000:0.0:1789402498.608821:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402498.611659:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00010000:00010000:1.0:1789402498.612853:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.612869:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.612877:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.612900:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402498.612905:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.612912:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.612929:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:1.0:1789402498.612931:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402498.612936:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.612942:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f87bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402498.613025:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199251072 00000100:00100000:0.0:1789402498.613035:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199251072 00000100:00100000:0.0:1789402498.613087:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 56 00000100:00100000:0.0:1789402498.613096:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199251072:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789402498.613386:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789402498.613391:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789402497 -> 1789402496 00002000:00010000:0.0:1789402498.613393:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789402494 00002000:00010000:0.0:1789402498.613396:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789402497 -> 1789402496 00002000:00010000:0.0:1789402498.613398:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789402498.613455:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+8:2351:x1876324199251072:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 360us (1806us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789402498.613472:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 56 00000100:00100000:2.0:1789402498.616460:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402498.616540:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199251328 00000100:00100000:1.0:1789402498.616550:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199251328 00000100:00100000:1.0:1789402498.616606:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 184 00000100:00100000:1.0:1789402498.616616:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+18:11511:x1876324199251328:12345-192.168.203.8@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789402498.616682:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.616699:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4737f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.616709:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.616856:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4737f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.616871:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4737f expref: 18 pid: 5844 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402498.616884:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224413440:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402498.617412:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459900 going to sleep for 11 seconds 00000100:00100000:3.0:1789402498.625966:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224413440:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402498.625996:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402498.628149:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402498.628481:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199251456 00000100:00100000:1.0:1789402498.628503:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199251456 00010000:00010000:1.0:1789402498.628556:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4737f expref: 19 pid: 5844 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402498.628924:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 70 00000100:00100000:2.0:1789402498.628937:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+19:2351:x1876324199251456:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402498.628953:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402498.628961:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4737f expref: 19 pid: 5844 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.628976:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4737f expref: 19 pid: 5844 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.628998:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f878e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4737f expref: 19 pid: 5844 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.629012:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:2.0:1789402498.629018:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.629027:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.629035:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.629063:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402498.629134:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+18:2351:x1876324199251456:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 201us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402498.629142:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 70 00010000:00010000:3.0:1789402498.630552:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.630567:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.630598:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.630605:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.630612:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.630618:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.630635:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.630643:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.630660:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:3.0:1789402498.630663:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789402498.630668:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.630674:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f87c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402498.630742:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+17:11511:x1876324199251328:12345-192.168.203.8@tcp:55:lhsmtool_posix.0 Request processed in 14123us (14287us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789402498.630751:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 184 00000100:00100000:0.0:1789402498.637716:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.638704:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199251584 00000100:00100000:3.0:1789402498.638716:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199251584 00000100:00100000:3.0:1789402498.638850:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 57 00000100:00100000:3.0:1789402498.638861:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+8:2351:x1876324199251584:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789402498.638904:0:12073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.638926:0:12073:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.638934:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402498.638939:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402498.638958:0:12073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.638996:0:12073:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.639010:0:12073:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 8 pid: 6689 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402498.639023:0:12073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12073:1876324224413568:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402498.639148:0:12073:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e10180 going to sleep for 11 seconds 00000100:00100000:0.0:1789402498.642254:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.642335:0:12073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12073:1876324224413568:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402498.642386:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199251712 00000100:00100000:1.0:1789402498.642393:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199251712 00010000:00010000:1.0:1789402498.642433:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 9 pid: 6689 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.642462:0:12073:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402498.642472:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 71 00000100:00100000:1.0:1789402498.642482:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:2352:x1876324199251712:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402498.642496:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402498.642528:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 9 pid: 6689 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.642541:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 9 pid: 6689 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.642563:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f654fe6/0x9403f4af875f87b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4739b expref: 9 pid: 6689 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.642579:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789402498.642655:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789402498.642662:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.642672:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.642705:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402498.642719:0:12073:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.642727:0:12073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402498.642759:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199251712:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 278us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402498.642766:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 71 00010000:00010000:0.0:1789402498.643965:0:12073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.643975:0:12073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.643984:0:12073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.643991:0:12073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402498.643996:0:12073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.644005:0:12073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.644021:0:12073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402498.644039:0:12073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dde250d/0x9403f4af875f87cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402498.644176:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199251584:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 Request processed in 5314us (6466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402498.644184:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 57 00000100:00100000:0.0:1789402498.646742:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.646816:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199251968 00000100:00100000:3.0:1789402498.646827:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199251968 00000100:00100000:3.0:1789402498.646879:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 185 00000100:00100000:3.0:1789402498.646888:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+17:11511:x1876324199251968:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789402498.646963:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.646979:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.646990:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.647224:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.647236:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47386 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.647245:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.647279:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47386 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.647292:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47386 expref: 18 pid: 5846 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402498.647306:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224413696:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402498.647513:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e10180 going to sleep for 11 seconds 00000100:00100000:2.0:1789402498.651134:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402498.651269:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199252096 00000100:00100000:1.0:1789402498.651279:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199252096 00010000:00010000:1.0:1789402498.651319:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47386 expref: 19 pid: 5846 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402498.651378:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 72 00000100:00100000:1.0:1789402498.651388:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+19:2351:x1876324199252096:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402498.651401:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402498.651408:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47386 expref: 19 pid: 5846 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.651421:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47386 expref: 19 pid: 5846 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.651442:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:1.0:1789402498.651447:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.651456:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.651463:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.651497:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402498.651562:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+19:2351:x1876324199252096:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 175us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402498.651570:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 72 00010000:00010000:3.0:1789402498.652626:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f879c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47386 expref: 18 pid: 5846 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402498.652648:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224413696:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402498.652671:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.652680:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.652687:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789402498.652940:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789402498.653083:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789402498.653127:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789402498.653223:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876324224413824:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789402498.653277:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402498.653394:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c9b5ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789402498.653931:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224413824 00000100:00100000:2.0:1789402498.653939:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224413824 00000100:00100000:2.0:1789402498.653980:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789402498.653988:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876324224413824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789402498.654106:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876324224413824:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402498.654113:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789402498.654169:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789402498.654174:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6fb468000, transno 4294967315 00000100:00100000:3.0:1789402498.654192:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876324224413824:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789402498.654994:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789402498.655060:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c1e1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876324224413952:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789402498.655101:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402498.655173:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789402498.655895:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224413952 00000100:00100000:2.0:1789402498.655903:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224413952 00000100:00100000:2.0:1789402498.655993:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789402498.656002:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876324224413952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789402498.656221:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876324224413952:12345-0@lo:1000:mdt00_002.0 Request processed in 219us (1116us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789402498.656228:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789402498.656297:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c1e1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876324224413952:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789402498.656336:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656365:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656373:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656381:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.656385:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656392:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656407:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c3a3e500) 00010000:00010000:3.0:1789402498.656410:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402498.656426:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656433:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f87db lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656464:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656470:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656476:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656482:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.656485:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656491:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656499:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:3.0:1789402498.656502:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402498.656505:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656510:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f8717 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656542:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656557:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4736a expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656574:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656603:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4736a expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.656616:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4736a expref: 21 pid: 5845 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402498.656628:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224414080:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402498.656701:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e10180 going to sleep for 11 seconds 00000100:00100000:2.0:1789402498.660664:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.660774:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224414080:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402498.660805:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402498.660922:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199252224 00000100:00100000:1.0:1789402498.660930:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199252224 00010000:00010000:1.0:1789402498.660968:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4736a expref: 22 pid: 5845 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402498.661006:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 73 00000100:00100000:1.0:1789402498.661014:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+22:2352:x1876324199252224:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402498.661029:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402498.661035:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4736a expref: 22 pid: 5845 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.661046:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4736a expref: 22 pid: 5845 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.661065:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4736a expref: 22 pid: 5845 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.661079:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:1.0:1789402498.661084:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.661093:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.661116:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.661141:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402498.661195:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+21:2352:x1876324199252224:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 181us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402498.661211:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 73 00010000:00010000:3.0:1789402498.661260:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661268:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661280:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661286:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661292:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661305:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.661310:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661318:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661327:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:3.0:1789402498.661330:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402498.661333:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661339:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f87e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661385:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661392:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661397:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661402:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402498.661405:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661410:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661427:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8200) 00010000:00010000:3.0:1789402498.661430:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789402498.661433:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402498.661438:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f87d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402498.661631:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+20:11511:x1876324199251968:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 14743us (14896us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1789402498.661639:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 185 00000020:00080000:3.0:1789402498.661643:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789402498.661909:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789402498.661914:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789402498.662983:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789402498.662999:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789402498.668558:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402498.668647:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199252480 00000100:00100000:3.0:1789402498.668658:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199252480 00000100:00100000:3.0:1789402498.668711:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 50 00000100:00100000:3.0:1789402498.668721:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+20:11511:x1876324199252480:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789402498.670856:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789402498.670978:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1789402498.671041:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.671060:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.671072:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.671093:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.671100:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.671106:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402498.671166:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789402498.671327:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+22:11511:x1876324199252480:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 2604us (2774us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789402498.671337:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 50 00000020:00080000:2.0:1789402498.671369:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789402498.671480:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402498.671488:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.671495:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402498.671499:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.671507:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.671521:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c6c30f8b00) 00010000:00010000:1.0:1789402498.671535:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789402498.671541:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.671547:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f87e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402498.671577:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402498.671578:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402498.671580:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402499.554827:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789402500.379758:0:12514:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789402500.379771:0:12514:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789402500.379829:0:12514:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789402500.379851:0:12514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789402500.489700:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402500.489854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199252736 00000100:00100000:0.0:1789402500.489867:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199252736 00000100:00100000:0.0:1789402500.489997:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 186 00000100:00100000:0.0:1789402500.490011:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+22:11529:x1876324199252736:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402500.490052:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402500.490082:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f87f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473a2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.490215:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f87f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.490233:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f87f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.490249:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f87f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402500.490270:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789402500.490469:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f87f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a2 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.490489:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f87f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a2 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.490498:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:0.0:1789402500.490501:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789402500.490505:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83a00, rc 0) 00000100:00100000:0.0:1789402500.490580:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+24:11529:x1876324199252736:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 572us (891us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789402500.490588:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 186 00000100:00080000:2.0:1789402500.490993:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402500.498268:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402500.498624:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199252864 00000100:00100000:0.0:1789402500.498639:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199252864 00000100:00100000:0.0:1789402500.498714:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 187 00000100:00100000:0.0:1789402500.498725:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+24:11529:x1876324199252864:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:0.0:1789402500.498947:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.498968:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.498981:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.498996:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.499013:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.499020:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501250:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501274:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501288:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402500.501367:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501384:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501392:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501400:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501407:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402500.501412:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501421:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501444:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:0.0:1789402500.501447:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402500.501454:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501461:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f8805 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501477:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501484:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501490:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501496:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402500.501499:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501505:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501513:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c3a3ea00) 00010000:00010000:0.0:1789402500.501515:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402500.501518:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501523:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f880c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501550:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501557:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501563:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501568:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402500.501571:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501576:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501583:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c3a3ee00) 00010000:00010000:0.0:1789402500.501586:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402500.501589:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.501594:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402500.502301:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+24:11529:x1876324199252864:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 3569us (4049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402500.502315:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 187 00000100:00100000:3.0:1789402500.537068:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402500.537110:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199253120 00000100:00100000:3.0:1789402500.537122:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199253120 00000100:00100000:3.0:1789402500.537201:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 188 00000100:00100000:3.0:1789402500.537211:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+24:11532:x1876324199253120:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:3.0:1789402500.537805:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402500.537959:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f881a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473a9 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.538074:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.538092:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.538106:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.538124:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.538132:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.538139:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539048:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539063:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539073:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789402500.539082:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:3.0:1789402500.539091:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000004:00020000:3.0:1789402500.539102:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:3.0:1789402500.539229:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539312:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539319:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539326:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402500.539331:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539340:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539383:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402500.539386:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402500.539553:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539562:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539577:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539583:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539589:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539594:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402500.539603:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539610:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539618:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6d2ca6c00) 00010000:00010000:3.0:1789402500.539621:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402500.539625:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539631:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90dc00/0x9403f4af875f8828 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539696:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f881a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a9 expref: 27 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539712:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a9 expref: 26 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.539719:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:3.0:1789402500.539721:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402500.539724:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d400, rc 0) 00000100:00100000:3.0:1789402500.540031:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+26:11532:x1876324199253120:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 2819us (2972us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789402500.540042:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 188 00000100:00100000:0.0:1789402500.550116:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402500.550221:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199253248 00000100:00100000:3.0:1789402500.550235:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199253248 00000100:00100000:3.0:1789402500.550312:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 189 00000100:00100000:3.0:1789402500.550323:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+26:11532:x1876324199253248:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:3.0:1789402500.550460:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.550483:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.550498:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.550528:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.550535:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.550543:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.550550:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402500.550556:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.550574:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.550586:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:3.0:1789402500.550590:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789402500.550829:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.550837:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f883d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402500.550937:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+26:11532:x1876324199253248:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 615us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402500.550944:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 189 00000100:00100000:0.0:1789402500.554727:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402500.554808:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199253504 00000100:00100000:3.0:1789402500.554881:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199253504 00000100:00100000:3.0:1789402500.555016:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 51 00000100:00100000:3.0:1789402500.555029:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+26:11532:x1876324199253504:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:0.0:1789402500.555040:0:5847:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1789402500.555061:0:5847:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1789402500.555674:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+27:11532:x1876324199253504:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 645us (960us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789402500.555682:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 51 00010000:00010000:1.0:1789402500.588611:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402500.600676:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402500.600797:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199253760 00000100:00100000:2.0:1789402500.600876:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199253760 00000100:00100000:2.0:1789402500.601098:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 190 00000100:00100000:2.0:1789402500.601111:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+27:11057:x1876324199253760:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:2.0:1789402500.601144:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402500.601173:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8844 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473b0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.603431:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.603460:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a9 expref: 28 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.604025:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.604078:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a9 expref: 28 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.604094:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a9 expref: 28 pid: 6712 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402500.604113:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb578e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224414208:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402500.604663:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072000 going to sleep for 11 seconds 00000100:00100000:0.0:1789402500.609313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402500.609554:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199253888 00000100:00100000:1.0:1789402500.609623:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199253888 00010000:00010000:1.0:1789402500.609679:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a9 expref: 29 pid: 6712 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402500.609730:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 74 00000100:00100000:1.0:1789402500.609742:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+29:2352:x1876324199253888:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402500.609762:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402500.609770:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a9 expref: 29 pid: 6712 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.609784:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a9 expref: 29 pid: 6712 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.609811:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:1.0:1789402500.609818:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.609830:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.609838:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.609859:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402500.609941:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+29:2352:x1876324199253888:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 200us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402500.609957:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 74 00010000:00010000:2.0:1789402500.610769:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f882f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a9 expref: 28 pid: 6712 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402500.610791:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb578e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224414208:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402500.610825:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.610835:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.610841:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402500.610866:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000004:00020000:2.0:1789402500.610891:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:2.0:1789402500.611155:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8844 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b0 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.611202:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b0 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.611211:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:2.0:1789402500.611214:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789402500.611217:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de800, rc 0) 00000100:00100000:2.0:1789402500.612008:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+28:11057:x1876324199253760:12345-192.168.203.8@tcp:101:bash.0 Request processed in 10894us (11341us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789402500.612019:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 190 00000100:00100000:0.0:1789402500.617810:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402500.618070:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199254144 00000100:00100000:1.0:1789402500.618084:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199254144 00000100:00100000:1.0:1789402500.618162:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 191 00000100:00100000:1.0:1789402500.618176:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+28:11057:x1876324199254144:12345-192.168.203.8@tcp:36:bash.0 00010000:00010000:1.0:1789402500.618743:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.618771:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.618787:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789402500.618856:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1789402500.618886:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e426df5 reply state 000000005f148ef7 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402500.618897:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789402500.618953:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1789402500.619143:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+32:11057:x1876324199254144:12345-192.168.203.8@tcp:36:bash.0 Request processed in 968us (1345us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789402500.619151:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 191 00000020:00080000:1.0:1789402500.619157:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789402500.627162:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402500.628240:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199254272 00000100:00100000:0.0:1789402500.628265:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199254272 00000100:00100000:0.0:1789402500.628364:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 192 00000100:00100000:0.0:1789402500.628378:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+32:11057:x1876324199254272:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402500.628415:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402500.628445:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8860 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473b7 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.628537:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8860 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b7 expref: 33 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.628554:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8860 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b7 expref: 33 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.628578:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:0.0:1789402500.628582:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789402500.628587:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:0.0:1789402500.628667:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+33:11057:x1876324199254272:12345-192.168.203.8@tcp:101:bash.0 Request processed in 293us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402500.628675:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 192 00010000:00010000:3.0:1789402500.629030:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.629040:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.629047:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.629053:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402500.629059:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.629067:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.629081:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:3.0:1789402500.629103:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402500.629109:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.629115:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8859 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402500.631787:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402500.631966:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199254400 00000100:00100000:2.0:1789402500.631980:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199254400 00000100:00100000:2.0:1789402500.632068:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 58 00000100:00100000:2.0:1789402500.632081:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:11057:x1876324199254400:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:2.0:1789402500.632104:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402500.632131:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473be expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789402500.632164:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa81d80, atime: 0x6aa81d7e, ctime: 0x6aa81d80, blocks: 0xb 00010000:00010000:2.0:1789402500.632205:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=405s v=(0 0) 00010000:00010000:2.0:1789402500.632211:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402500.632220:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473be expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.632238:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473be expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.632284:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df400, rc 0) 00000100:00080000:0.0:1789402500.632806:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789402500.632813:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+8:11057:x1876324199254400:12345-192.168.203.8@tcp:101:bash.0 Request processed in 733us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402500.632822:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 58 00000100:00100000:1.0:1789402500.635736:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402500.635800:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199254528 00000100:00100000:3.0:1789402500.635814:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199254528 00002000:00010000:3.0:1789402500.635924:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789402500.635930:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6fb468000 with x1876324199254528 ext(0->18446744073709551615) 00002000:00010000:3.0:1789402500.635943:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6fb468000. 00000100:00100000:3.0:1789402500.635975:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:3.0:1789402500.635987:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4785302d-2648-4148-8042-c10a24a5dd29+8:2351:x1876324199254528:12345-192.168.203.8@tcp:10:bash.0 00002000:00010000:3.0:1789402500.636424:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789402500.636430:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789402496 -> 1789402499 00002000:00010000:3.0:1789402500.636433:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789402494 -> 1789402494 00002000:00010000:3.0:1789402500.636435:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789402496 -> 1789402499 00002000:00010000:3.0:1789402500.636438:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789402500.636580:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4785302d-2648-4148-8042-c10a24a5dd29+9:2351:x1876324199254528:12345-192.168.203.8@tcp:10:bash.0 Request processed in 531us (792us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789402500.636589:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 5 00002000:00010000:3.0:1789402500.636595:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789402500.636598:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6fb468000 with x1876324199254528 ext(0->18446744073709551615) 00002000:00010000:3.0:1789402500.636604:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6fb468000. 00000100:00100000:2.0:1789402500.732964:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402500.733109:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199254656 00000100:00100000:3.0:1789402500.733122:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199254656 00000100:00100000:3.0:1789402500.733211:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 193 00000100:00100000:3.0:1789402500.733240:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+32:11546:x1876324199254656:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:3.0:1789402500.733499:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.733530:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.733546:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.733565:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.733572:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.733580:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734118:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734130:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734140:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402500.734201:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734216:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734223:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734230:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734237:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402500.734243:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734266:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734280:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402500.734284:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402500.734290:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734296:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d000/0x9403f4af875f886e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734312:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734318:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734325:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734331:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402500.734334:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734391:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734401:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6d2ca6c00) 00010000:00010000:2.0:1789402500.734403:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402500.734407:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734425:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d800/0x9403f4af875f8875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734444:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734450:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734456:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734461:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402500.734464:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734470:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734478:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:2.0:1789402500.734480:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402500.734484:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.734489:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f887c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402500.734609:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+32:11546:x1876324199254656:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 1365us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402500.734620:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 193 00000100:00100000:1.0:1789402500.771672:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402500.772122:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199254912 00000100:00100000:0.0:1789402500.772136:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199254912 00000100:00100000:0.0:1789402500.772220:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 194 00000100:00100000:0.0:1789402500.772233:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+32:11549:x1876324199254912:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402500.772279:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402500.772306:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8883 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473c5 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.772454:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.772474:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.772496:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.772524:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.772533:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.772540:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773438:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8898 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773469:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773486:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789402500.773495:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:1.0:1789402500.773503:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00020000:1.0:1789402500.773523:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:1.0:1789402500.773646:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773655:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773662:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773669:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402500.773674:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773684:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773699:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:1.0:1789402500.773703:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402500.773709:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773727:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f888a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773755:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773762:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773768:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773773:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402500.773777:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773783:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773792:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c3a3ee00) 00010000:00010000:1.0:1789402500.773794:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402500.773798:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.773803:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8891 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.774321:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8883 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473c5 expref: 35 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.774340:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8898 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473c5 expref: 34 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.774637:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:1.0:1789402500.774640:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789402500.774644:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83ec00, rc 0) 00000100:00100000:1.0:1789402500.775302:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+34:11549:x1876324199254912:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 3066us (3641us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789402500.775315:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 194 00000100:00100000:1.0:1789402500.782621:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402500.782704:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199255040 00000100:00100000:0.0:1789402500.782727:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199255040 00000100:00100000:0.0:1789402500.782803:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 195 00000100:00100000:0.0:1789402500.782824:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+34:11549:x1876324199255040:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:0.0:1789402500.782917:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.783154:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b0 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.783201:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.783247:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b0 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.783266:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b0 expref: 34 pid: 5844 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402500.783284:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224414336:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402500.783561:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789402500.787492:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402500.787589:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199255296 00000100:00100000:3.0:1789402500.787601:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199255296 00000100:00100000:3.0:1789402500.787663:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 52 00000100:00100000:3.0:1789402500.787675:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+35:5592:x1876324199255296:12345-192.168.203.8@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789402500.788128:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+36:5592:x1876324199255296:12345-192.168.203.8@tcp:35:ldlm_bl.0 Request processed in 453us (649us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789402500.788137:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 52 00000100:00100000:1.0:1789402500.790658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402500.790831:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199255424 00000100:00100000:2.0:1789402500.790843:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199255424 00010000:00010000:2.0:1789402500.790896:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b0 expref: 36 pid: 5844 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402500.790950:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 75 00000100:00100000:2.0:1789402500.790963:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+36:2352:x1876324199255424:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402500.790985:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402500.790993:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b0 expref: 36 pid: 5844 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.791009:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b0 expref: 36 pid: 5844 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.791037:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:2.0:1789402500.791043:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.791054:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.791064:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.791088:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402500.791159:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+36:2352:x1876324199255424:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 198us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402500.791167:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 75 00010000:00010000:0.0:1789402500.792935:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f884b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b0 expref: 35 pid: 5844 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402500.792964:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876324224414336:192.168.203.8@tcp:104: 00010000:00010000:0.0:1789402500.792995:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.793007:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.793012:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.793056:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.793063:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.793091:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.793097:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402500.793101:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.793109:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.793127:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:0.0:1789402500.793130:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789402500.793136:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.793142:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402500.793247:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+34:11549:x1876324199255040:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 10431us (10637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402500.793257:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 195 00000100:00100000:1.0:1789402500.796913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402500.797022:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199255680 00000100:00100000:3.0:1789402500.797035:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199255680 00000100:00100000:3.0:1789402500.797140:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00100000:3.0:1789402500.797153:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+34:11549:x1876324199255680:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:3.0:1789402500.797602:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+35:11549:x1876324199255680:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 449us (699us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789402500.797611:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00100000:2.0:1789402500.891909:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402500.892056:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199255936 00000100:00100000:0.0:1789402500.892068:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199255936 00000100:00100000:0.0:1789402500.892145:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 196 00000100:00100000:0.0:1789402500.892157:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+35:11560:x1876324199255936:12345-192.168.203.8@tcp:101:cat.0 00010000:00010000:0.0:1789402500.892198:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402500.892226:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473cc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.892410:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.892429:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.892445:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.892462:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.892469:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.892477:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.892954:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f88c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.892966:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.892973:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789402500.892981:0:5844:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000004:00200000:0.0:1789402500.892988:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00000004:00020000:0.0:1789402500.892998:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023255553 00010000:00010000:0.0:1789402500.893116:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893132:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893140:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893146:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402500.893151:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893159:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893175:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:0.0:1789402500.893178:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402500.893196:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893204:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893219:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893225:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893231:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893237:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402500.893245:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893252:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893259:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c3a3ea00) 00010000:00010000:0.0:1789402500.893262:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402500.893265:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893271:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893328:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f88ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473cc expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893404:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f88c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473cc expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.893413:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:0.0:1789402500.893415:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789402500.893418:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83c00, rc 0) 00000100:00100000:0.0:1789402500.893504:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+37:11560:x1876324199255936:12345-192.168.203.8@tcp:101:cat.0 Request processed in 1348us (1608us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789402500.894615:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 196 00000100:00100000:2.0:1789402500.898256:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402500.898394:0:12528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199256192 00000100:00100000:1.0:1789402500.898408:0:12528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199256192 00000100:00100000:1.0:1789402500.898477:0:12528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 54 00000100:00100000:1.0:1789402500.898489:0:12528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+37:11560:x1876324199256192:12345-192.168.203.8@tcp:35:cat.0 00000100:00100000:1.0:1789402500.899085:0:12528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+38:11560:x1876324199256192:12345-192.168.203.8@tcp:35:cat.0 Request processed in 595us (841us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789402500.899093:0:12528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 54 00000100:00100000:3.0:1789402500.924056:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402500.924758:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199256448 00000100:00100000:2.0:1789402500.924773:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199256448 00000100:00100000:2.0:1789402500.924890:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 197 00000100:00100000:2.0:1789402500.924901:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+38:11561:x1876324199256448:12345-192.168.203.8@tcp:36:rm.0 00010000:00010000:2.0:1789402500.924981:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789402500.925017:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f88c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473cc expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925041:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8898 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473c5 expref: 37 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925052:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8860 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473b7 expref: 36 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925061:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6d2ca6700) 00010000:00010000:2.0:1789402500.925077:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402500.925105:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925124:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925135:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925153:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925193:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925201:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925583:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925594:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.925602:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789402500.926270:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789402500.926282:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406074938044ns, next at 407074935127ns, rc = 0 00010000:00010000:2.0:1789402500.926376:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926389:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926399:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926407:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926414:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926434:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926470:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402500.926499:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926506:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926513:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926520:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402500.926525:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926534:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926545:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8600) 00010000:00010000:2.0:1789402500.926548:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789402500.926553:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926560:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f88de lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926583:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926590:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926603:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926608:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402500.926611:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926617:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926625:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402500.926628:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402500.926631:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402500.926637:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f88d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402500.926648:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a95e316a reply state 00000000519d8aa6 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402500.926659:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789402500.926774:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+37:11561:x1876324199256448:12345-192.168.203.8@tcp:36:rm.0 Request processed in 1872us (2732us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789402500.926782:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 197 00010000:00010000:3.0:1789402500.926869:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402500.926876:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.926883:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402500.926886:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.926896:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.926905:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c6c30f8600) 00010000:00010000:3.0:1789402500.926907:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789402500.926910:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.926915:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df600/0x9403f4af875f88e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.926931:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402500.926933:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402500.926935:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402500.929096:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.929117:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.929125:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.929132:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402500.929156:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.929164:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.929194:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c30f8700) 00010000:00010000:1.0:1789402500.929198:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402500.929203:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.929211:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f88d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402500.960245:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402500.961331:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199256704 00000100:00100000:0.0:1789402500.961415:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199256704 00000100:00100000:0.0:1789402500.961615:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 198 00000100:00100000:0.0:1789402500.961628:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+36:11567:x1876324199256704:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402500.961683:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402500.961712:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473d3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.961878:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.961897:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.961912:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.961930:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.961938:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.961945:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789402500.962721:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789402500.962943:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.962957:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.962968:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789402500.962990:0:5844:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023256130 00000004:00020000:0.0:1789402500.963007:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023256130 00010000:00010000:0.0:1789402500.963036:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.963044:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.963052:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.963065:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402500.963071:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.963079:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.963095:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:0.0:1789402500.963098:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402500.963105:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.963112:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f88f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402500.963130:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a3f4f3c reply state 00000000a5f6bb25 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402500.963140:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789402500.963194:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f88ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473d3 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.963219:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473d3 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.963228:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:0.0:1789402500.963230:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789402500.963233:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:0.0:1789402500.963331:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+39:11567:x1876324199256704:12345-192.168.203.8@tcp:101:bash.0 Request processed in 1705us (3101us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789402500.963402:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 198 00010000:00010000:3.0:1789402500.967639:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.967663:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.967687:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.967694:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402500.967699:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.967709:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.967731:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c3a3ea00) 00010000:00010000:3.0:1789402500.967734:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402500.967740:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.967748:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f88fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402500.968173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402500.975665:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199256832 00000100:00100000:3.0:1789402500.975689:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199256832 00000100:00100000:3.0:1789402500.975841:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 59 00000100:00100000:3.0:1789402500.975853:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+5:2352:x1876324199256832:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:3.0:1789402500.975878:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402500.975909:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473da expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789402500.975945:0:8217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402500.975974:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789402500.975998:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402500.976010:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473da expref: 6 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.976035:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473da expref: 6 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402500.976053:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90dc00, rc 0) 00000100:00100000:3.0:1789402500.976139:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199256832:12345-192.168.203.8@tcp:101:bash.0 Request processed in 287us (7973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402500.976146:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 59 00000100:00080000:2.0:1789402500.980845:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402500.984274:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402500.984736:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199256960 00000100:00100000:0.0:1789402500.984750:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199256960 00000100:00100000:0.0:1789402500.984863:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 60 00000100:00100000:0.0:1789402500.984875:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+6:11567:x1876324199256960:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:0.0:1789402500.984900:0:12073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402500.984927:0:12073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473e1 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.984975:0:12073:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473da expref: 7 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.984986:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402500.984991:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402500.984997:0:12073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 7 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.985067:0:12073:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473da expref: 7 pid: 8217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402500.985083:0:12073:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473da expref: 7 pid: 8217 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402500.985099:0:12073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12073:1876324224414464:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402500.985236:0:12073:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789402500.990635:0:12073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12073:1876324224414464:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402500.990691:0:12073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 7 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.990718:0:12073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83000, rc 0) 00000100:00100000:1.0:1789402500.990794:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+7:11567:x1876324199256960:12345-192.168.203.8@tcp:101:bash.0 Request processed in 5920us (6531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402500.990805:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 60 00000100:00100000:0.0:1789402500.992938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402500.993091:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199257088 00000100:00100000:1.0:1789402500.993105:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199257088 00010000:00010000:1.0:1789402500.993163:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473da expref: 7 pid: 8217 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402500.993231:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 76 00000100:00100000:1.0:1789402500.993243:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199257088:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402500.993290:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402500.993330:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473da expref: 7 pid: 8217 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.993376:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473da expref: 7 pid: 8217 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.993408:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f890f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473da expref: 7 pid: 8217 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.993430:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402500.993436:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402500.993446:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 6 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.993458:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 6 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402500.993517:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 6 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402500.993534:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1876324224414592:192.168.203.8@tcp:105: 00000100:00100000:1.0:1789402500.993625:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789402501.000076:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1876324224414592:192.168.203.8@tcp:105: 00010000:00010000:1.0:1789402501.000117:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402501.000225:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2351:x1876324199257088:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 6982us (7299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402501.000239:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 76 00000100:00100000:0.0:1789402501.000899:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.000995:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199257344 00000100:00100000:3.0:1789402501.001005:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199257344 00000100:00100000:3.0:1789402501.001102:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 55 00000100:00100000:3.0:1789402501.001114:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+38:11567:x1876324199257344:12345-192.168.203.8@tcp:35:bash.0 00000100:00100000:3.0:1789402501.002373:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+39:11567:x1876324199257344:12345-192.168.203.8@tcp:35:bash.0 Request processed in 1229us (1444us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789402501.002388:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 55 00000100:00100000:0.0:1789402501.180873:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.181010:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199257472 00000100:00100000:1.0:1789402501.181022:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199257472 00000100:00100000:1.0:1789402501.181103:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 199 00000100:00100000:1.0:1789402501.181119:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+39:11583:x1876324199257472:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402501.181153:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402501.181202:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f891d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473e8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.181296:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.181314:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.181329:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402501.181435:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789402501.181439:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402501.181461:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.181494:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f891d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e8 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.181516:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e8 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.181549:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:1.0:1789402501.181552:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789402501.181557:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83e000, rc 0) 00000100:00100000:1.0:1789402501.181643:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+40:11583:x1876324199257472:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 528us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402501.181650:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 199 00000100:00100000:2.0:1789402501.187172:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.187371:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199257728 00000100:00100000:1.0:1789402501.187384:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199257728 00000100:00100000:1.0:1789402501.187555:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 200 00000100:00100000:1.0:1789402501.187567:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+40:11583:x1876324199257728:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402501.187595:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402501.187622:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f892b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473ef expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.187767:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.187784:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.187799:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402501.187812:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000004:00020000:1.0:1789402501.187821:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133187 00010000:00010000:1.0:1789402501.188957:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f892b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473ef expref: 43 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.189021:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473ef expref: 42 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.189031:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:1.0:1789402501.189035:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402501.189040:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6cb83ea00, rc 0) 00000100:00100000:1.0:1789402501.189126:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+42:11583:x1876324199257728:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1560us (1968us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789402501.189135:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 200 00000100:00100000:0.0:1789402501.195994:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402501.196048:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.196463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199257984 00000100:00100000:1.0:1789402501.196478:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199257984 00000100:00100000:1.0:1789402501.196634:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 201 00000100:00100000:1.0:1789402501.196647:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+42:11583:x1876324199257984:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402501.196684:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789402501.196815:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199258112 00000100:00100000:2.0:1789402501.196836:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199258112 00000100:00100000:2.0:1789402501.196878:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:2.0:1789402501.196886:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+43:2353:x1876324199258112:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402501.196902:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402501.197137:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8940 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473f6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.197285:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c70215ee00/0x9403f4af875f8947 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.197367:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ea00/0x9403f4af875f8932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473ef expref: 44 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.197955:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c70215ee00/0x9403f4af875f8947 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.197983:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c70215ee00/0x9403f4af875f8947 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402501.198005:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000004:00020000:1.0:1789402501.198033:0:5845:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2268287991810 00010000:00010000:1.0:1789402501.198220:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83ec00/0x9403f4af875f8940 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473f6 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.198241:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c70215ee00/0x9403f4af875f8947 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473f6 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.198250:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:1.0:1789402501.198254:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789402501.198258:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c70215ee00, rc 0) 00010000:00010000:2.0:1789402501.198269:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c3a3e100) 00000100:00100000:1.0:1789402501.198418:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+44:11583:x1876324199257984:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1772us (2440us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789402501.198427:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 201 00010000:00010000:2.0:1789402501.198609:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402501.198637:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+43:2353:x1876324199258112:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 1751us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.198645:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:0.0:1789402501.206304:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.209867:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199258240 00000100:00100000:2.0:1789402501.209891:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199258240 00000100:00100000:2.0:1789402501.210082:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 61 00000100:00100000:2.0:1789402501.210095:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+6:2352:x1876324199258240:12345-192.168.203.8@tcp:1:lfs.0 00010000:00010000:2.0:1789402501.210172:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.210210:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 6 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.210219:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402501.210225:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402501.210231:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.210305:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 6 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.210323:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 6 pid: 12073 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.210340:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1876324224414720:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402501.210524:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072780 going to sleep for 11 seconds 00000100:00100000:0.0:1789402501.217310:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.218059:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1876324224414720:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402501.218101:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.218832:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199258368 00000100:00100000:2.0:1789402501.218844:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199258368 00002000:00100000:2.0:1789402501.218910:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93c6ffac9f80 x1876324199258368/t0(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:417/0 lens 504/0 e 0 to 0 dl 1789402512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789402501.218922:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ffac9f80 with x1876324199258368 ext(0->8) 00010000:00010000:2.0:1789402501.218931:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 7 pid: 12073 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.218949:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 7 pid: 12073 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789402501.218958:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c6ffac9f80 00000100:00100000:2.0:1789402501.219020:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:2.0:1789402501.219031:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199258368:12345-192.168.203.8@tcp:4:lfs.0 00000100:00100000:2.0:1789402501.220077:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:2351:x1876324199258368:12345-192.168.203.8@tcp:4:lfs.0 Request processed in 1039us (2773us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789402501.220090:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 3 00002000:00100000:2.0:1789402501.220100:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93c6ffac9f80 x1876324199258368/t4294967308(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:417/0 lens 504/448 e 0 to 0 dl 1789402512 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789402501.220110:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ffac9f80 with x1876324199258368 ext(0->8) 00010000:00010000:2.0:1789402501.220118:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 9 pid: 12073 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.220136:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 9 pid: 12073 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789402501.220143:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93c6ffac9f80 00000100:00100000:0.0:1789402501.223024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.223742:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199258496 00000100:00100000:3.0:1789402501.223757:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199258496 00010000:00010000:3.0:1789402501.223816:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 9 pid: 12073 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.223921:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 77 00000100:00100000:3.0:1789402501.223932:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+9:2352:x1876324199258496:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402501.223952:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789402501.223995:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789402501.223999:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789402500 00002000:00010000:3.0:1789402501.224002:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789402500 00002000:00010000:3.0:1789402501.224004:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789402500 00010000:00010000:3.0:1789402501.224013:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 9 pid: 12073 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.224030:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 9 pid: 12073 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.224060:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8916 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e1 expref: 9 pid: 12073 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.224084:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402501.224089:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402501.224096:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.224106:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.224146:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402501.224233:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199258496:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 302us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.224242:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 77 00010000:00010000:2.0:1789402501.224888:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.224904:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.224939:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.224948:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.224970:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.224979:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402501.224983:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.224994:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.225012:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.225020:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000597bd3cf/0x9403f4af875f8955 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.225113:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199258240:12345-192.168.203.8@tcp:1:lfs.0 Request processed in 15017us (18820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.225122:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 61 00000100:00100000:0.0:1789402501.230212:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.230883:0:12528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199258752 00000100:00100000:1.0:1789402501.230898:0:12528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199258752 00000100:00100000:1.0:1789402501.230977:0:12528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 56 00000100:00100000:1.0:1789402501.230989:0:12528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+43:11583:x1876324199258752:12345-192.168.203.8@tcp:35:lfs.0 00000004:00010000:1.0:1789402501.231280:0:12528:0:(mdt_open.c:2006:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c70215ee00/0x9403f4af875f8947 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473f6 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789402501.232020:0:12528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1789402501.232066:0:12528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789402501.233063:0:12528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1789402501.233172:0:12528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.233206:0:12528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473d3 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.233229:0:12528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.233278:0:12528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473d3 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.233297:0:12528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473d3 expref: 47 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402501.233316:0:12528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fa975f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12528:1876324224414848:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402501.234045:0:12528:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402501.242035:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.242898:0:12528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fa975f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12528:1876324224414848:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402501.242943:0:12528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.243122:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199258880 00000100:00100000:3.0:1789402501.243133:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199258880 00010000:00010000:3.0:1789402501.243202:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473d3 expref: 48 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.243286:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 78 00000100:00100000:3.0:1789402501.243298:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+48:2351:x1876324199258880:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402501.243329:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402501.243338:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473d3 expref: 48 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.243373:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473d3 expref: 48 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.243469:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82400/0x9403f4af875f8901 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473d3 expref: 48 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.243489:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:3.0:1789402501.243494:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.243506:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.243586:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.243617:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402501.243687:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+47:2351:x1876324199258880:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 389us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.243694:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 78 00010000:00010000:0.0:1789402501.245137:0:12528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.245157:0:12528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789402501.245384:0:12528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789402501.247217:0:12528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1789402501.247869:0:12528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6eec03100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12528:1876324224414976:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789402501.247972:0:12528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402501.248079:0:12528:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789402501.248138:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224414976 00000100:00100000:2.0:1789402501.248148:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224414976 00000100:00100000:2.0:1789402501.248286:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789402501.248297:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12528:x1876324224414976:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789402501.248458:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12528:x1876324224414976:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 162us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.248466:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789402501.248830:0:12528:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1789402501.248838:0:12528:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1789402501.248863:0:12528:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6e622fb80, transno 4294967307 00000100:00080000:0.0:1789402501.248868:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402501.248887:0:12528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6eec03100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12528:1876324224414976:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1789402501.251073:0:12528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789402501.252001:0:12528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12528:1876324224415104:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789402501.252112:0:12528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402501.252239:0:12528:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072180 going to sleep for 11 seconds 00000100:00100000:0.0:1789402501.252314:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224415104 00000100:00100000:0.0:1789402501.252611:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224415104 00000100:00100000:0.0:1789402501.252725:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789402501.252738:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12528:x1876324224415104:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789402501.253033:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12528:x1876324224415104:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 297us (925us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789402501.253041:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789402501.253135:0:12528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12528:1876324224415104:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1789402501.253235:0:12528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1789402501.253291:0:12528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.253303:0:12528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.253313:0:12528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.253334:0:12528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402501.253340:0:12528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.253387:0:12528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.253409:0:12528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:2.0:1789402501.253412:0:12528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789402501.253436:0:12528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.253444:0:12528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223c00/0x9403f4af875f895c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789402501.253704:0:12528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789402501.253820:0:12528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789402501.253835:0:12528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406402490872ns, next at 407402488488ns, rc = 0 00000001:00080000:2.0:1789402501.253842:0:12528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789402501.253879:0:12528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c3a3e100) 00010000:00010000:2.0:1789402501.253883:0:12528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789402501.253891:0:12528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c70215ee00/0x9403f4af875f8947 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473f6 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.254594:0:12528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+50:11583:x1876324199258752:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 23604us (24396us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789402501.254606:0:12528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 56 00000020:00080000:2.0:1789402501.254612:0:12528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789402501.258389:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.258610:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199259008 00000100:00100000:2.0:1789402501.258623:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199259008 00000100:00100000:2.0:1789402501.258693:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 202 00000100:00100000:2.0:1789402501.258705:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+50:11583:x1876324199259008:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402501.258999:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402501.259030:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8963 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b473fd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.259111:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8963 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473fd expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.259151:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8963 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473fd expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.259177:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402501.259190:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789402501.259195:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de600, rc 0) 00000100:00100000:2.0:1789402501.259278:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+51:11583:x1876324199259008:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 575us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.259286:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 202 00000100:00100000:1.0:1789402501.266824:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.266935:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199259264 00000100:00100000:3.0:1789402501.266974:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199259264 00000100:00100000:3.0:1789402501.267048:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 57 00000100:00100000:3.0:1789402501.267063:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+51:11583:x1876324199259264:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:0.0:1789402501.267868:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+52:11583:x1876324199259264:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 804us (1054us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789402501.267878:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 57 00000100:00100000:0.0:1789402501.347120:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.347713:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199259392 00000100:00100000:3.0:1789402501.347731:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199259392 00000100:00100000:3.0:1789402501.347854:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 203 00000100:00100000:3.0:1789402501.347867:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+52:11594:x1876324199259392:12345-192.168.203.8@tcp:34:lfs.0 00010000:00010000:3.0:1789402501.347973:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.347996:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348012:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348032:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348039:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348046:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348173:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348196:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348203:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789402501.348440:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348457:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348464:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348471:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348477:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402501.348482:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348490:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348504:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402501.348507:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402501.348644:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348650:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f896a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348668:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348673:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348686:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348692:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402501.348695:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348701:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348708:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6d2ca6400) 00010000:00010000:3.0:1789402501.348711:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402501.348714:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348720:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348738:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348744:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348749:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348755:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402501.348758:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348773:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348781:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402501.348783:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402501.348787:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.348792:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8978 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.348898:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+52:11594:x1876324199259392:12345-192.168.203.8@tcp:34:lfs.0 Request processed in 1030us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.348908:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 203 00000100:00100000:3.0:1789402501.391843:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.392115:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199259648 00000100:00100000:1.0:1789402501.392129:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199259648 00000100:00100000:1.0:1789402501.393726:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 204 00000100:00100000:1.0:1789402501.393750:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+52:11597:x1876324199259648:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402501.393783:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402501.393811:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f897f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47404 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.393937:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.393976:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.393991:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.394011:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.394019:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.394026:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395257:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395706:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395721:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789402501.395731:0:6712:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:1.0:1789402501.395742:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000004:00020000:1.0:1789402501.395754:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:1.0:1789402501.395890:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395899:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395926:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395933:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402501.395937:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395945:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395961:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:1.0:1789402501.395965:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402501.395971:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395978:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8986 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.395994:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.396001:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.396007:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.396013:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402501.396016:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.396033:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.396043:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6d8cd8500) 00010000:00010000:1.0:1789402501.396045:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402501.396048:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.396054:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f898d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.396127:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f897f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47404 expref: 55 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.396144:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47404 expref: 54 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.396151:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:1.0:1789402501.396153:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402501.396162:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6223200, rc 0) 00000100:00100000:1.0:1789402501.397134:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+54:11597:x1876324199259648:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 3386us (5297us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789402501.397146:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 204 00000100:00100000:0.0:1789402501.402377:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.403113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199259776 00000100:00100000:1.0:1789402501.403130:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199259776 00000100:00100000:1.0:1789402501.403280:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 205 00000100:00100000:1.0:1789402501.403293:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+54:11597:x1876324199259776:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:1.0:1789402501.403533:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.403556:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.403571:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.403726:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.403735:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.403742:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.403749:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402501.403754:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.403763:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.403779:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:1.0:1789402501.403782:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789402501.403789:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.403797:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222600/0x9403f4af875f89a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402501.403922:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+54:11597:x1876324199259776:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 630us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402501.403930:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 205 00000100:00100000:0.0:1789402501.406570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.406859:0:12528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199260032 00000100:00100000:2.0:1789402501.406873:0:12528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199260032 00000100:00100000:2.0:1789402501.406953:0:12528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 58 00000100:00100000:2.0:1789402501.406966:0:12528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+54:11597:x1876324199260032:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:2.0:1789402501.407702:0:12528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+55:11597:x1876324199260032:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 734us (1141us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789402501.407720:0:12528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 58 00000100:00100000:0.0:1789402501.488119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.488474:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199260288 00000100:00100000:2.0:1789402501.488488:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199260288 00000100:00100000:2.0:1789402501.488569:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 206 00000100:00100000:2.0:1789402501.488693:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+55:11607:x1876324199260288:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:2.0:1789402501.488738:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402501.488742:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789402501.488779:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e000/0x9403f4af875f8924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473e8 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.488823:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402501.488829:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402501.488849:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f89a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4740b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.488974:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.488989:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47404 expref: 55 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.488999:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.489038:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47404 expref: 55 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.489054:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47404 expref: 55 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.489264:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224415232:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402501.490904:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072900 going to sleep for 11 seconds 00000100:00100000:0.0:1789402501.503894:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.504001:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199260416 00000100:00100000:1.0:1789402501.504013:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199260416 00010000:00010000:1.0:1789402501.504068:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47404 expref: 56 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402501.504118:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 79 00000100:00100000:1.0:1789402501.504131:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+56:2353:x1876324199260416:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402501.504152:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402501.504161:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47404 expref: 56 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.504177:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47404 expref: 56 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.504220:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:1.0:1789402501.504226:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.504238:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.504247:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.504274:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402501.504422:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+56:2353:x1876324199260416:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 284us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402501.505152:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 79 00010000:00010000:2.0:1789402501.505554:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223200/0x9403f4af875f8994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47404 expref: 55 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.505689:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224415232:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402501.505794:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.505807:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.505814:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402501.505840:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000004:00020000:2.0:1789402501.505867:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:2.0:1789402501.506048:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f89a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4740b expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.506066:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4740b expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.506076:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402501.506079:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789402501.506082:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de000, rc 0) 00000100:00100000:2.0:1789402501.506155:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+55:11607:x1876324199260288:12345-192.168.203.8@tcp:101:bash.0 Request processed in 17575us (18051us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789402501.506164:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 206 00000100:00100000:0.0:1789402501.510939:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.511043:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199260672 00000100:00100000:3.0:1789402501.511057:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199260672 00000100:00100000:3.0:1789402501.511188:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 207 00000100:00100000:3.0:1789402501.511203:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+55:11607:x1876324199260672:12345-192.168.203.8@tcp:36:bash.0 00010000:00010000:3.0:1789402501.511764:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.511787:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.511803:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789402501.511865:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1789402501.511902:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035c81528 reply state 000000008b8f6015 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.511913:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789402501.512037:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+58:11607:x1876324199260672:12345-192.168.203.8@tcp:36:bash.0 Request processed in 835us (1110us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789402501.512045:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 207 00000020:00080000:3.0:1789402501.512052:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789402501.517130:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.517823:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199260800 00000100:00100000:3.0:1789402501.517839:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199260800 00000100:00100000:3.0:1789402501.517917:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 208 00000100:00100000:3.0:1789402501.517930:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+58:11607:x1876324199260800:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:3.0:1789402501.517965:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402501.517993:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f89c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47412 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.518104:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.518121:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4740b expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.518131:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.518139:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.518163:0:6712:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.518228:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4740b expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.518245:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4740b expref: 59 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.518262:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224415360:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402501.518402:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e10cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789402501.519444:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.519459:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.519467:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.519496:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402501.519501:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.519681:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.519701:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402501.519704:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402501.519708:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.519732:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.519739:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f89be lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.522119:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224415360:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402501.522157:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402501.522638:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.522867:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199260928 00000100:00100000:3.0:1789402501.522876:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199260928 00010000:00010000:3.0:1789402501.522921:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4740b expref: 59 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.522959:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 80 00000100:00100000:3.0:1789402501.522968:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+59:2352:x1876324199260928:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402501.522985:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402501.522993:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4740b expref: 59 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.523006:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4740b expref: 59 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.523053:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f89b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4740b expref: 59 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.523071:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402501.523077:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.523088:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.523097:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.523131:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402501.523199:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+58:2352:x1876324199260928:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 230us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.523206:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 80 00010000:00010000:1.0:1789402501.523274:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.523282:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402501.523377:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789402501.523382:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402501.523408:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.523444:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f89c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47412 expref: 58 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.523461:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47412 expref: 57 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.523469:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:1.0:1789402501.523472:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402501.523474:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90ce00, rc 0) 00000100:00100000:1.0:1789402501.523502:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+57:11607:x1876324199260800:12345-192.168.203.8@tcp:101:bash.0 Request processed in 5577us (6388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402501.523509:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 208 00000100:00100000:0.0:1789402501.527082:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.527262:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199261184 00000100:00100000:1.0:1789402501.527274:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199261184 00000100:00100000:1.0:1789402501.527330:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 59 00000100:00100000:1.0:1789402501.527340:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+57:11607:x1876324199261184:12345-192.168.203.8@tcp:35:bash.0 00000100:00100000:1.0:1789402501.527895:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+58:11607:x1876324199261184:12345-192.168.203.8@tcp:35:bash.0 Request processed in 553us (826us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789402501.527904:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 59 00000100:00100000:0.0:1789402501.600206:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.600400:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199261312 00000100:00100000:1.0:1789402501.600414:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199261312 00000100:00100000:1.0:1789402501.600493:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 209 00000100:00100000:1.0:1789402501.600507:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+58:11613:x1876324199261312:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402501.600543:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402501.600574:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f89d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47419 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.600669:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f89da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.600688:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f89da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.600703:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f89da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402501.600960:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789402501.600965:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402501.600991:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f89da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.601041:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223e00/0x9403f4af875f89d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47419 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.601082:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f89da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47419 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.601092:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:0.0:1789402501.601095:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789402501.601100:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6222c00, rc 0) 00000100:00100000:0.0:1789402501.601189:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+59:11613:x1876324199261312:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 685us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402501.601197:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 209 00010000:00010000:1.0:1789402501.606321:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402501.606696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.606851:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199261440 00000100:00100000:2.0:1789402501.606866:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199261440 00000100:00100000:2.0:1789402501.606954:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 210 00000100:00100000:2.0:1789402501.606968:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+59:11613:x1876324199261440:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402501.606994:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402501.607022:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f89e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47420 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607116:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607135:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607168:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607195:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607203:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607211:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607325:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f89f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607336:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f89f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607380:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f89f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402501.607431:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789402501.607436:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402501.607461:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f89f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607476:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f89f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607487:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607506:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607514:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607522:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402501.607527:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607536:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607549:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:2.0:1789402501.607552:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402501.607559:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607565:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de200/0x9403f4af875f89e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607582:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607588:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607594:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607599:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402501.607608:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607616:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607624:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402501.607628:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402501.607630:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607637:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f89ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607676:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f89e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47420 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607692:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f89f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47420 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.607700:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402501.607703:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402501.607705:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dec00, rc 0) 00000100:00100000:2.0:1789402501.607796:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+60:11613:x1876324199261440:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 831us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.607805:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 210 00000100:00100000:3.0:1789402501.611575:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.611627:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402501.611741:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199261824 00000100:00100000:0.0:1789402501.611754:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199261824 00000100:00100000:0.0:1789402501.611831:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:0.0:1789402501.611843:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+60:2351:x1876324199261824:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402501.611865:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402501.611898:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f89f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47420 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.611933:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:0.0:1789402501.611939:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402501.612016:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+59:2351:x1876324199261824:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 174us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402501.612024:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:2.0:1789402501.612755:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199261696 00000100:00100000:2.0:1789402501.612765:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199261696 00000100:00100000:2.0:1789402501.612808:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 211 00000100:00100000:2.0:1789402501.612817:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+59:11613:x1876324199261696:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402501.612852:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402501.612873:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f89fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47427 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.613010:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.613029:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47412 expref: 60 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.613038:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.613298:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47412 expref: 60 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.613316:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47412 expref: 60 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.613332:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224415488:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402501.613457:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072900 going to sleep for 11 seconds 00000100:00100000:3.0:1789402501.616404:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402501.616519:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199261952 00000100:00100000:0.0:1789402501.616531:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199261952 00010000:00010000:0.0:1789402501.616581:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47412 expref: 61 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402501.616622:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 81 00000100:00100000:0.0:1789402501.616633:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+61:2352:x1876324199261952:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402501.616651:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402501.616658:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47412 expref: 61 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.616673:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47412 expref: 61 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.616701:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:0.0:1789402501.616707:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.616719:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.616728:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.616751:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402501.616820:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+61:2352:x1876324199261952:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 188us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402501.616829:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 81 00010000:00010000:2.0:1789402501.621152:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f89cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47412 expref: 60 pid: 6712 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.621201:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224415488:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402501.621240:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.621281:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.621288:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402501.621318:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00020000:2.0:1789402501.621364:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2208192008195 00010000:00010000:2.0:1789402501.621568:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f89fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47427 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.621590:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47427 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.621600:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402501.621604:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789402501.621609:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df800, rc 0) 00000100:00100000:2.0:1789402501.621706:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+60:11613:x1876324199261696:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 8889us (10146us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789402501.621716:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 211 00000100:00100000:3.0:1789402501.624577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402501.625260:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199262208 00000100:00100000:0.0:1789402501.625297:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199262208 00000100:00100000:0.0:1789402501.625736:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:0.0:1789402501.625750:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+60:11613:x1876324199262208:12345-192.168.203.8@tcp:103:lfs.0 00010000:00010000:0.0:1789402501.625773:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402501.625807:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8963 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473fd expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.625835:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:0.0:1789402501.625841:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402501.626041:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4785302d-2648-4148-8042-c10a24a5dd29+59:11613:x1876324199262208:12345-192.168.203.8@tcp:103:lfs.0 Request processed in 293us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402501.626049:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:1.0:1789402501.630018:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.630201:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199262336 00000100:00100000:2.0:1789402501.630216:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199262336 00000100:00100000:2.0:1789402501.630294:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 212 00000100:00100000:2.0:1789402501.630306:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+59:11613:x1876324199262336:12345-192.168.203.8@tcp:58:lfs.0 00010000:00010000:2.0:1789402501.630901:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.631844:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.631891:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789402501.632291:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789402501.632551:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+59:11613:x1876324199262336:12345-192.168.203.8@tcp:58:lfs.0 Request processed in 2240us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.632564:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 212 00000100:00100000:3.0:1789402501.635701:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.635845:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199262464 00000100:00100000:1.0:1789402501.635859:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199262464 00000100:00100000:1.0:1789402501.636042:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 213 00000100:00100000:1.0:1789402501.636058:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+59:11613:x1876324199262464:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402501.636098:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402501.636130:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223400/0x9403f4af875f8a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4742e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.636239:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.636252:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223400/0x9403f4af875f8a19 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4742e expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.636276:0:5845:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.636294:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223400/0x9403f4af875f8a19 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4742e expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.636311:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:1.0:1789402501.636314:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789402501.636318:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223400/0x9403f4af875f8a19 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4742e expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.636327:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6223400, rc 0) 00000100:00100000:1.0:1789402501.636439:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+60:11613:x1876324199262464:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 385us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402501.636448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 213 00000040:00080000:1.0:1789402501.731146:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789402501.731160:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789402501.731219:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789402501.731226:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789402501.731415:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003d8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224415616:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789402501.732078:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789402501.742877:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.742970:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003d8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224415616:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789402501.744864:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199262592 00000100:00100000:0.0:1789402501.744893:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199262592 00000100:00100000:0.0:1789402501.744994:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 214 00000100:00100000:0.0:1789402501.745008:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+60:11614:x1876324199262592:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789402501.745052:0:6712:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789402501.745228:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+60:11614:x1876324199262592:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 223us (2369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402501.745236:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 214 00000100:00100000:0.0:1789402501.762119:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.762258:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199262720 00000100:00100000:2.0:1789402501.762274:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199262720 00000100:00100000:1.0:1789402501.762486:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 215 00000100:00100000:1.0:1789402501.762502:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+60:11614:x1876324199262720:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789402501.762805:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.762829:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.762969:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763166:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763175:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763191:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763226:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763237:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763244:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402501.763303:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789402501.763328:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402501.763378:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763392:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763398:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763406:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763412:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402501.763418:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763426:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763440:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:1.0:1789402501.763443:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402501.763449:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763454:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8a20 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763470:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763476:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763496:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763502:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402501.763505:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763583:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763593:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff93c6d8cd8500) 00010000:00010000:1.0:1789402501.763595:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402501.763599:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763605:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8a27 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763630:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763637:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763643:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763647:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402501.763650:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763667:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763675:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:1.0:1789402501.763678:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402501.763681:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.763687:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223600/0x9403f4af875f8a2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402501.765213:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+60:11614:x1876324199262720:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 Request processed in 2697us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402501.765232:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 215 00000100:00100000:1.0:1789402501.768408:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.768519:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199262976 00000100:00100000:2.0:1789402501.768533:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199262976 00000100:00100000:2.0:1789402501.769147:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 216 00000100:00100000:2.0:1789402501.769166:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+60:11614:x1876324199262976:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402501.769206:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402501.769237:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47435 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.770198:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.770225:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.770239:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402501.770255:0:6712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00020000:2.0:1789402501.770266:0:6712:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:2.0:1789402501.771241:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.771274:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.771282:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.771289:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402501.771295:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.771304:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.771322:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402501.771326:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789402501.771333:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.771340:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.771701:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a35 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47435 expref: 62 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.771781:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:2.0:1789402501.771784:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789402501.771790:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47435 expref: 62 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.771812:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de400, rc 0) 00000100:00100000:2.0:1789402501.772193:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7003d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+61:11614:x1876324199262976:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 3030us (3798us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789402501.772203:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 216 00000100:00100000:3.0:1789402501.777569:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.777625:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199263104 00000100:00100000:3.0:1789402501.777639:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199263104 00000100:00100000:3.0:1789402501.777726:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 217 00000100:00100000:3.0:1789402501.777741:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+61:11614:x1876324199263104:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789402501.777815:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789402501.778123:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+61:11614:x1876324199263104:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 383us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.778130:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 217 00000100:00100000:1.0:1789402501.803607:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.803828:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199263360 00000100:00100000:3.0:1789402501.803849:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199263360 00000100:00100000:3.0:1789402501.803927:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 218 00000100:00100000:3.0:1789402501.803941:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+61:11614:x1876324199263360:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789402501.803970:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402501.803975:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789402501.804011:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f89da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47419 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.804038:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402501.804045:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789402501.804063:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f8a4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4743c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789402501.805117:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789402501.805702:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8a51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.805943:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.805963:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789402501.805994:0:5844:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:3.0:1789402501.806011:0:5844:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:3.0:1789402501.806079:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90da00/0x9403f4af875f8a4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4743c expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.806106:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8a51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4743c expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.806117:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6d2ca6400) 00010000:00010000:3.0:1789402501.806120:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402501.806124:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c200, rc 0) 00000100:00100000:3.0:1789402501.806278:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+62:11614:x1876324199263360:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 2340us (2694us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789402501.806288:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 218 00000100:00100000:1.0:1789402501.810777:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.810999:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199263616 00000100:00100000:3.0:1789402501.811013:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199263616 00000100:00100000:3.0:1789402501.811129:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 219 00000100:00100000:3.0:1789402501.811144:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+62:11614:x1876324199263616:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789402501.811233:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402501.811268:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8a51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4743c expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811291:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6d2ca6400) 00010000:00010000:3.0:1789402501.811305:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789402501.811332:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811413:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811426:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811443:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811451:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811458:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811552:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811560:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811567:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811573:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402501.811579:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811588:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811606:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402501.811615:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402501.811621:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811628:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8a5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811639:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811645:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811650:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811655:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402501.811657:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811663:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811671:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x20486e6e (ffff93c6d2ca6500) 00010000:00010000:3.0:1789402501.811674:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402501.811676:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.811681:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x20486e6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.811800:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+61:11614:x1876324199263616:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 659us (1454us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789402501.811815:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 219 00000100:00100000:0.0:1789402501.815293:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.816126:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199263744 00000100:00100000:2.0:1789402501.816144:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199263744 00000100:00100000:2.0:1789402501.816233:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 220 00000100:00100000:2.0:1789402501.816246:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+61:11614:x1876324199263744:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402501.816276:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402501.816310:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47443 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.816402:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.816419:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.816436:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.816589:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47443 expref: 63 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.816853:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47443 expref: 62 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.816862:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402501.816866:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789402501.816993:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de800, rc 0) 00000100:00100000:2.0:1789402501.817137:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+62:11614:x1876324199263744:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 893us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.817147:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 220 00000100:00100000:1.0:1789402501.825500:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.825628:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199264000 00000100:00100000:3.0:1789402501.825641:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199264000 00000100:00100000:3.0:1789402501.825737:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 221 00000100:00100000:3.0:1789402501.825752:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+62:11614:x1876324199264000:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789402501.826053:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.826076:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.826092:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789402501.826484:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:3.0:1789402501.827056:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001448e980 reply state 000000001e2fba21 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.827072:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789402501.827240:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+64:11614:x1876324199264000:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 1486us (1752us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789402501.827250:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 221 00000100:00100000:1.0:1789402501.830472:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.831024:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199264128 00000100:00100000:2.0:1789402501.831039:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199264128 00000100:00100000:2.0:1789402501.831119:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 222 00000100:00100000:2.0:1789402501.831132:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+64:11614:x1876324199264128:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402501.831164:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402501.831202:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4744a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.831280:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4744a expref: 65 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.831297:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4744a expref: 65 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.831319:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402501.831323:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789402501.831327:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de400, rc 0) 00000100:00100000:2.0:1789402501.831523:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+65:11614:x1876324199264128:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 393us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.831531:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 222 00010000:00010000:3.0:1789402501.832070:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.832084:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.832092:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.832118:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402501.832124:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.832133:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.832150:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:3.0:1789402501.832153:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789402501.832159:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.832166:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c600/0x9403f4af875f8a7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402501.838632:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.839111:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199264256 00000100:00100000:1.0:1789402501.839127:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199264256 00000100:00100000:1.0:1789402501.839211:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 62 00000100:00100000:1.0:1789402501.839224:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+9:2351:x1876324199264256:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789402501.839684:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+10:2351:x1876324199264256:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 461us (1066us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789402501.839693:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 62 00000100:00100000:1.0:1789402501.843858:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.844064:0:12528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199264512 00000100:00100000:2.0:1789402501.844078:0:12528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199264512 00000100:00100000:2.0:1789402501.844148:0:12528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 60 00000100:00100000:2.0:1789402501.844161:0:12528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+64:11614:x1876324199264512:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789402501.844547:0:12528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+65:11614:x1876324199264512:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 386us (711us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789402501.844556:0:12528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 60 00000100:00100000:2.0:1789402501.848107:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.848224:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199264768 00000100:00100000:1.0:1789402501.848238:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199264768 00000100:00100000:1.0:1789402501.848315:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 223 00000100:00100000:1.0:1789402501.848328:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+65:11614:x1876324199264768:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789402501.848538:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+65:11614:x1876324199264768:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 211us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402501.848546:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 223 00000100:00100000:3.0:1789402501.855635:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402501.855825:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199264896 00000100:00100000:0.0:1789402501.855837:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199264896 00000100:00100000:0.0:1789402501.855920:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 224 00000100:00100000:0.0:1789402501.855933:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+65:11614:x1876324199264896:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402501.855983:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402501.856022:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8a89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47451 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.856118:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8a90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.856136:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.856153:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402501.856211:0:6712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402501.856238:0:6712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.856267:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8a89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47451 expref: 67 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.856289:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47451 expref: 66 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.856298:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:0.0:1789402501.856301:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789402501.856306:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83600, rc 0) 00000100:00100000:0.0:1789402501.856447:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+66:11614:x1876324199264896:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 516us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402501.856455:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 224 00000100:00100000:2.0:1789402501.860460:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224415872:0@lo:400:kworker.0 00000100:00100000:2.0:1789402501.860560:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402501.860629:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224416384:0@lo:400:kworker.0 00000100:00100000:2.0:1789402501.860660:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402501.860694:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789402501.860700:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224415744:0@lo:400:kworker.0 00000100:00100000:2.0:1789402501.860739:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402501.860757:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224416256:0@lo:400:kworker.0 00000100:00100000:2.0:1789402501.860778:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402501.860810:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224416384 00000100:00100000:2.0:1789402501.860820:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224416384 00000100:00100000:2.0:1789402501.861056:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789402501.861308:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3316:x1876324224416384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402501.861422:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3316:x1876324224416384:12345-0@lo:400:kworker.0 Request processed in 120us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.861431:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789402501.862044:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224415872 00000100:00100000:3.0:1789402501.862055:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224415872 00000100:00100000:0.0:1789402501.862188:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224416000:0@lo:400:kworker.0 00000100:00100000:0.0:1789402501.862242:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402501.862287:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402501.862295:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224416128:0@lo:400:kworker.0 00000100:00100000:0.0:1789402501.862321:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402501.862375:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224415744 00000100:00100000:0.0:1789402501.862380:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224415744 00000100:00100000:0.0:1789402501.862418:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789402501.862425:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224415744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402501.862465:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3316:x1876324224415744:12345-0@lo:400:kworker.0 Request processed in 40us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402501.862472:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789402501.862691:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224416128 00000100:00100000:2.0:1789402501.862705:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224416128 00000100:00100000:2.0:1789402501.862761:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789402501.862974:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3313:x1876324224416128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402501.863026:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224416256 00000100:00100000:3.0:1789402501.863034:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224416256 00000100:00100000:3.0:1789402501.863065:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224416000 00000100:00100000:2.0:1789402501.863075:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3313:x1876324224416128:12345-0@lo:400:kworker.0 Request processed in 108us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.863095:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789402501.863150:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8612d911-d8bf-490d-b22c-35e85a3b4473:3316:1876324224415744:0@lo:400:kworker.0 00000100:00100000:2.0:1789402501.863167:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224416384:0@lo:400:kworker.0 00000100:00100000:2.0:1789402501.863213:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789402501.863225:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224415872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402501.863290:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224415872:12345-0@lo:400:kworker.0 Request processed in 70us (2731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.863296:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789402501.863315:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224416000 00000100:00100000:2.0:1789402501.863333:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224415872:0@lo:400:kworker.0 00000100:00100000:3.0:1789402501.863383:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789402501.863394:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224416256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402501.863445:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224416256:12345-0@lo:400:kworker.0 Request processed in 54us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.863456:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789402501.863471:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224416256:0@lo:400:kworker.0 00000100:00100000:3.0:1789402501.863474:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789402501.863491:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224416000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402501.863545:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224416000:12345-0@lo:400:kworker.0 Request processed in 58us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.863552:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789402501.863646:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224416128:0@lo:400:kworker.0 00000100:00100000:0.0:1789402501.863664:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224416000:0@lo:400:kworker.0 00000100:00080000:0.0:1789402501.863693:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789402501.863700:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789402501.864930:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.865190:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199265024 00000100:00100000:3.0:1789402501.865204:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199265024 00000100:00100000:3.0:1789402501.865268:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 63 00000100:00100000:3.0:1789402501.865281:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+10:2352:x1876324199265024:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789402501.865305:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402501.865334:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47458 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789402501.866155:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa81d85, blocks: 0x1 00010000:00010000:3.0:1789402501.866195:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1789402501.866202:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402501.866216:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47458 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.866246:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47458 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.866262:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c600, rc 0) 00000100:00100000:3.0:1789402501.866371:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+11:2352:x1876324199265024:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 1091us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.866382:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 63 00000100:00100000:3.0:1789402501.869802:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.869908:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199265280 00000100:00100000:2.0:1789402501.869923:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199265280 00000100:00100000:2.0:1789402501.869994:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 225 00000100:00100000:2.0:1789402501.870005:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+66:11614:x1876324199265280:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789402501.870122:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+66:11614:x1876324199265280:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 119us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.870129:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 225 00000100:00100000:0.0:1789402501.874549:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.874660:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199265408 00000100:00100000:2.0:1789402501.874670:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199265408 00000100:00100000:2.0:1789402501.874750:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 64 00000100:00100000:2.0:1789402501.874761:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+11:11614:x1876324199265408:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789402501.874794:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402501.874833:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4745f expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.874871:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47458 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.874881:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402501.874886:0:8217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402501.874892:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 12 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.874928:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47458 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.874942:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47458 expref: 12 pid: 6690 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.874956:0:8217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff642300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876324224416512:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402501.875042:0:8217:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072900 going to sleep for 11 seconds 00000100:00100000:1.0:1789402501.881525:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402501.881598:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199265536 00000100:00100000:0.0:1789402501.881607:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199265536 00010000:00010000:0.0:1789402501.881661:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47458 expref: 13 pid: 6690 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402501.881704:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 82 00000100:00100000:2.0:1789402501.881929:0:8217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff642300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8217:1876324224416512:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402501.881961:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 13 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.881983:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df600, rc 0) 00000100:00100000:2.0:1789402501.882043:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+13:11614:x1876324199265408:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 7285us (7504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402501.882071:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 64 00000100:00100000:0.0:1789402501.882272:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+12:2351:x1876324199265536:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402501.882288:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402501.882312:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47458 expref: 12 pid: 6690 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.882332:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47458 expref: 12 pid: 6690 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.882519:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b5f016f/0x9403f4af875f8a97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47458 expref: 12 pid: 6690 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.882536:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402501.882540:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402501.882549:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 11 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.882559:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 11 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402501.882594:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 11 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402501.882608:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb844000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1876324224416640:192.168.203.8@tcp:105: 00000100:00100000:0.0:1789402501.882679:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789402501.886058:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb844000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1876324224416640:192.168.203.8@tcp:105: 00010000:00010000:0.0:1789402501.886087:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402501.886144:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+11:2351:x1876324199265536:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 4431us (4629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402501.886155:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 82 00000100:00100000:3.0:1789402501.889970:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402501.890079:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199265664 00000100:00100000:1.0:1789402501.890088:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199265664 00002000:00100000:1.0:1789402501.890137:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93c6ff67fb80 x1876324199265664/t0(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:417/0 lens 504/0 e 0 to 0 dl 1789402512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789402501.890148:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ff67fb80 with x1876324199265664 ext(0->12) 00002000:00010000:1.0:1789402501.890153:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6ff67fb80 00000100:00100000:1.0:1789402501.890256:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:1.0:1789402501.890268:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4785302d-2648-4148-8042-c10a24a5dd29+11:2351:x1876324199265664:12345-192.168.203.8@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789402501.890791:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4785302d-2648-4148-8042-c10a24a5dd29+13:2351:x1876324199265664:12345-192.168.203.8@tcp:4:lhsmtool_posix.0 Request processed in 523us (827us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789402501.890799:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 6 00002000:00100000:1.0:1789402501.890807:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93c6ff67fb80 x1876324199265664/t4294967320(0) o4->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:417/0 lens 504/448 e 0 to 0 dl 1789402512 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789402501.890815:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ff67fb80 with x1876324199265664 ext(0->12) 00002000:00010000:1.0:1789402501.890819:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6ff67fb80 00000100:00100000:2.0:1789402501.894901:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.895003:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199265792 00000100:00100000:3.0:1789402501.895014:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199265792 00000100:00100000:3.0:1789402501.895085:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 226 00000100:00100000:3.0:1789402501.895095:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+66:11614:x1876324199265792:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789402501.941003:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+66:11614:x1876324199265792:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 Request processed in 45893us (46094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.941020:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 226 00000001:00080000:2.0:1789402501.941115:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967491 is committed 00000020:00080000:2.0:1789402501.941144:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c6c92efe40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789402501.941149:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e61e7700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c6c92ef0c0 00000020:00080000:2.0:1789402501.941153:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e61e7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c6f7f3fc00 00000001:00080000:2.0:1789402501.941185:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000020:00080000:2.0:1789402501.941196:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c6fb81c900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789402501.941200:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6fb315600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c6fb81c0c0 00000020:00080000:2.0:1789402501.941204:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6fb315500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c5c2828800 00000001:00080000:2.0:1789402501.941242:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1789402501.941871:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789402501.942194:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000004:00080000:2.0:1789402501.943039:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:0.0:1789402501.943941:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789402501.943973:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224416768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789402501.944077:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789402501.944438:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789402501.945749:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402501.945774:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224416896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789402501.945854:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402501.945913:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224416768 00000100:00100000:1.0:1789402501.945923:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224416768 00000100:00100000:1.0:1789402501.945980:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224416896 00000100:00100000:1.0:1789402501.945984:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224416896 00000100:00100000:1.0:1789402501.946009:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789402501.946020:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224416768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789402501.946055:0:12073:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1789402501.946102:0:12073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa81d84, atime: 0x6aa81d84, ctime: 0x6aa81d84, blocks: 0x1 00010000:00010000:1.0:1789402501.946112:0:12073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.946133:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1789402501.946139:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402501.946147:0:12073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.946167:0:12073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.946191:0:12073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.946201:0:12073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.946244:0:12073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789402501.947201:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789402501.947221:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876324224416896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789402501.947259:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789402501.947286:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.947308:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473be expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.947317:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789402501.947322:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402501.947326:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.947404:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473be expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.947423:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473be expref: 12 pid: 6691 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.947442:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff642680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1876324224417024:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402501.948224:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c7000720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402501.948365:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402501.948699:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199265920 00000100:00100000:2.0:1789402501.948709:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199265920 00000100:00100000:2.0:1789402501.948762:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 67 00000100:00100000:2.0:1789402501.948773:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+13:2352:x1876324199265920:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789402501.959023:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224416768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12485us (14428us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789402501.959044:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:1.0:1789402501.959136:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6ff67d180/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789402501.959144:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224416768:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789402501.960646:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402501.960658:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.960675:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222a00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402501.960681:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.960696:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.961239:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.961429:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8aa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402501.961460:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402501.961462:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402501.961473:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402501.962252:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402501.963402:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199266048 00000100:00100000:3.0:1789402501.963417:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199266048 00010000:00010000:3.0:1789402501.963470:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473be expref: 14 pid: 6691 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402501.963521:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 83 00000100:00100000:3.0:1789402501.963532:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199266048:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402501.963550:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402501.963556:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473be expref: 14 pid: 6691 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.963571:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473be expref: 14 pid: 6691 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.963602:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402501.963606:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402501.963614:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.963640:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.963666:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402501.963744:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+14:2351:x1876324199266048:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 212us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402501.963752:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 83 00010000:00010000:2.0:1789402501.964776:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c6c193e/0x9403f4af875f8867 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473be expref: 13 pid: 6691 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402501.964802:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff642680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1876324224417024:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402501.964828:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.964839:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.964847:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.964870:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.964880:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402501.964899:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789402501.965624:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224416896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18408us (19765us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789402501.965637:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1789402501.967392:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6ff67a300/2, rc 0, transno 4294967321 00000100:00100000:1.0:1789402501.967419:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224416896:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789402501.967883:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402501.967896:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.967914:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402501.967929:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.967944:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.967972:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.967981:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fe3b3fc/0x9403f4af875f8aac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402501.968014:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402501.968041:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402501.968044:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402502.042384:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+12:2352:x1876324199265920:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 Request processed in 93558us (93969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402502.042405:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 67 00000001:00080000:1.0:1789402502.042719:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1789402502.042737:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1789402502.042752:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:0.0:1789402502.054278:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402502.054400:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199266304 00000100:00100000:2.0:1789402502.054416:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199266304 00000100:00100000:2.0:1789402502.054503:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 227 00000100:00100000:2.0:1789402502.054515:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+20:11614:x1876324199266304:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789402502.054589:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402502.054617:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83600/0x9403f4af875f8a90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47451 expref: 20 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.054641:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00000100:00080000:0.0:1789402502.054644:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789402502.054647:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402502.054679:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.054693:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.054724:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402502.054978:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc859393 reply state 000000001eddf2a6 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402502.054988:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789402502.055086:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:11614:x1876324199266304:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 573us (827us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789402502.055094:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 227 00010000:00010000:2.0:1789402502.057753:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.057769:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.057777:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.057784:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402502.057788:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.057795:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.057823:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402502.057827:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402502.057833:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.057861:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8ab3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402502.070038:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402502.070590:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199266432 00000100:00100000:3.0:1789402502.070605:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199266432 00000100:00100000:3.0:1789402502.070711:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 68 00000100:00100000:3.0:1789402502.070724:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+7:2352:x1876324199266432:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789402502.071015:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789402502.071020:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789402500 00002000:00010000:3.0:1789402502.071022:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789402500 00002000:00010000:3.0:1789402502.071025:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789402501 -> 1789402500 00002000:00010000:3.0:1789402502.071028:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00080000:0.0:1789402502.071316:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402502.071557:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199266432:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 774us (1472us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789402502.071570:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 68 00000100:00100000:0.0:1789402502.078315:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402502.078548:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199266688 00000100:00100000:1.0:1789402502.078563:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199266688 00000100:00100000:1.0:1789402502.078642:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 228 00000100:00100000:1.0:1789402502.078657:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+20:11614:x1876324199266688:12345-192.168.203.8@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789402502.078767:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.078790:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47443 expref: 20 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.078800:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.078849:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47443 expref: 20 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.078866:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47443 expref: 20 pid: 6712 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402502.078885:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff678e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224417152:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402502.079012:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402502.083895:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff678e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6712:1876324224417152:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402502.083961:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402502.095928:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402502.096585:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199266816 00000100:00100000:1.0:1789402502.096600:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199266816 00010000:00010000:1.0:1789402502.096662:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47443 expref: 21 pid: 6712 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402502.096723:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 84 00000100:00100000:1.0:1789402502.096737:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+21:2351:x1876324199266816:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402502.096757:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402502.096766:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47443 expref: 21 pid: 6712 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.096783:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47443 expref: 21 pid: 6712 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.096812:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de800/0x9403f4af875f8a74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47443 expref: 21 pid: 6712 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.096833:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:1.0:1789402502.096839:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.096850:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.096860:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.096923:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402502.097008:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402502.097008:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+20:2351:x1876324199266816:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 272us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402502.097028:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 84 00010000:00010000:2.0:1789402502.097035:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.097075:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.097083:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.097091:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.097096:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402502.097102:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.097109:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.097128:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402502.097132:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789402502.097138:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.097145:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222a00/0x9403f4af875f8aba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402502.097404:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+19:11614:x1876324199266688:12345-192.168.203.8@tcp:55:lhsmtool_posix.0 Request processed in 18691us (19046us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789402502.097416:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 228 00000100:00100000:0.0:1789402502.103458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402502.103638:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199266944 00000100:00100000:1.0:1789402502.103651:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199266944 00000100:00100000:1.0:1789402502.103734:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:1.0:1789402502.103746:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+8:2351:x1876324199266944:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789402502.103807:0:12073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.103832:0:12073:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 8 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.103841:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402502.103846:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789402502.103851:0:12073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.103892:0:12073:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 8 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.103909:0:12073:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 8 pid: 8217 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402502.103926:0:12073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff678e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12073:1876324224417280:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402502.104054:0:12073:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402502.107552:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402502.107907:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199267072 00000100:00100000:3.0:1789402502.107921:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199267072 00010000:00010000:3.0:1789402502.107981:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 9 pid: 8217 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402502.108037:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 85 00000100:00100000:3.0:1789402502.108050:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+9:2351:x1876324199267072:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402502.108070:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402502.108100:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 9 pid: 8217 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.108140:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 9 pid: 8217 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.108198:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402502.108203:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789402502.108212:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.108224:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.108251:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402502.108336:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+9:2351:x1876324199267072:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 288us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402502.108401:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 85 00010000:00010000:1.0:1789402502.109320:0:12073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d729854/0x9403f4af875f8a9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4745f expref: 8 pid: 8217 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402502.109394:0:12073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff678e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12073:1876324224417280:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402502.109426:0:12073:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.109438:0:12073:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.109446:0:12073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.109480:0:12073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.109489:0:12073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.109498:0:12073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.109768:0:12073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222800 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402502.109775:0:12073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.109826:0:12073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.109847:0:12073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.109856:0:12073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8ac1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402502.109957:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199266944:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 Request processed in 6212us (6514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402502.109967:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:2.0:1789402502.119003:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402502.119264:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199267328 00000100:00100000:3.0:1789402502.119280:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199267328 00000100:00100000:3.0:1789402502.119526:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 229 00000100:00100000:3.0:1789402502.119541:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+19:11614:x1876324199267328:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789402502.119656:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.119680:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.119697:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.120028:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.120042:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4744a expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.120052:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.120326:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4744a expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.120506:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4744a expref: 20 pid: 5844 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402502.120529:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224417408:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402502.120653:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e33a76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402502.125080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402502.125446:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224417408:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402502.125496:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402502.130869:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199267456 00000100:00100000:1.0:1789402502.130896:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199267456 00010000:00010000:0.0:1789402502.131239:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4744a expref: 21 pid: 5844 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402502.131304:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 86 00000100:00100000:0.0:1789402502.131316:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+21:2351:x1876324199267456:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402502.131335:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402502.131426:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4744a expref: 21 pid: 5844 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.131444:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4744a expref: 21 pid: 5844 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.131472:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8a82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4744a expref: 21 pid: 5844 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.131497:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:0.0:1789402502.131799:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.131811:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.131821:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.131862:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789402502.132030:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.132041:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789402502.132423:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000100:00100000:0.0:1789402502.132452:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4785302d-2648-4148-8042-c10a24a5dd29+21:2351:x1876324199267456:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 1135us (7390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402502.132463:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 86 00000001:00080000:3.0:1789402502.132653:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789402502.133840:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789402502.134086:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876324224417536:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789402502.134169:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402502.134290:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072780 going to sleep for 11 seconds 00000100:00100000:2.0:1789402502.134452:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224417536 00000100:00100000:2.0:1789402502.134464:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224417536 00000100:00100000:2.0:1789402502.134679:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789402502.134692:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876324224417536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789402502.134839:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876324224417536:12345-0@lo:1000:mdt00_002.0 Request processed in 149us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402502.134848:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789402502.135107:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1789402502.135114:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1789402502.135149:0:5846:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93c6ff67a300 x1876324224416896/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789402517 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402502.135163:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876324224417536:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789402502.137819:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789402502.138225:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876324224417664:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789402502.138317:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402502.138450:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072540 going to sleep for 11 seconds 00000100:00100000:2.0:1789402502.138544:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224417664 00000100:00100000:2.0:1789402502.138554:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224417664 00000100:00100000:2.0:1789402502.138633:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789402502.138646:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876324224417664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789402502.138951:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1876324224417664:12345-0@lo:1000:mdt00_002.0 Request processed in 307us (633us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789402502.138960:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789402502.139202:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876324224417664:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789402502.139255:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139269:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139278:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139285:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402502.139291:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139299:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139338:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:3.0:1789402502.139384:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402502.139393:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139401:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8acf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139441:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139449:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139455:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139461:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402502.139464:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139471:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139479:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402502.139483:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402502.139492:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223400/0x9403f4af875f8a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4742e expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139506:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223400/0x9403f4af875f8a19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4742e expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139525:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223400/0x9403f4af875f8a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4742e expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.139564:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223400/0x9403f4af875f8a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4742e expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402502.139578:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224417792:192.168.203.8@tcp:105: 00000100:00100000:3.0:1789402502.139692:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c700072540 going to sleep for 11 seconds 00000100:00100000:2.0:1789402502.143182:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876324224417792:192.168.203.8@tcp:105: 00010000:00010000:2.0:1789402502.143233:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143250:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8a12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143322:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143510:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143750:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143765:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143772:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143779:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143786:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402502.143791:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143800:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143814:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402502.143817:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402502.143823:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143829:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ad6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143855:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143862:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143868:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143874:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402502.143877:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143884:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143893:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402502.143896:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789402502.143899:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.143905:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c200/0x9403f4af875f8ac8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402502.145682:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000040:00080000:1.0:1789402502.146110:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789402502.146116:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789402502.146695:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+23:11614:x1876324199267328:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 26029us (26577us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789402502.146711:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 229 00000020:00080000:2.0:1789402502.146720:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789402502.147243:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789402502.147261:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789402502.147392:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199267584 00000100:00100000:1.0:1789402502.147404:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199267584 00000100:00100000:1.0:1789402502.147470:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 61 00000100:00100000:1.0:1789402502.147482:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+23:11613:x1876324199267584:12345-192.168.203.8@tcp:49:lfs.0 00000100:00100000:1.0:1789402502.147768:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+23:11613:x1876324199267584:12345-192.168.203.8@tcp:49:lfs.0 Request processed in 287us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402502.147776:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 61 00000100:00100000:3.0:1789402502.161287:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402502.161466:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199267840 00000100:00100000:0.0:1789402502.161479:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199267840 00000100:00100000:0.0:1789402502.161565:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 62 00000100:00100000:0.0:1789402502.161579:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+23:11614:x1876324199267840:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789402502.163393:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789402502.164231:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1789402502.164334:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.164394:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.164411:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.164421:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.164446:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.164452:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402502.164481:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402502.164535:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402502.164544:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.164552:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402502.164557:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.164567:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.164599:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c6c3a3ec00) 00010000:00010000:1.0:1789402502.164602:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789402502.164608:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.164614:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8add lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402502.164634:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402502.164636:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402502.164638:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402502.165535:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+25:11614:x1876324199267840:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 3949us (4471us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789402502.165550:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 62 00000020:00080000:0.0:1789402502.165558:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789402502.169492:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402502.170320:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199268096 00000100:00100000:3.0:1789402502.170340:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199268096 00000100:00100000:3.0:1789402502.170464:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 230 00000100:00100000:3.0:1789402502.170478:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+25:11613:x1876324199268096:12345-192.168.203.8@tcp:58:lfs.0 00000040:00080000:3.0:1789402502.171005:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789402502.171881:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+25:11613:x1876324199268096:12345-192.168.203.8@tcp:58:lfs.0 Request processed in 1396us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402502.171895:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 230 00000100:00100000:3.0:1789402502.248134:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402502.249794:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199268224 00000100:00100000:2.0:1789402502.249814:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199268224 00000100:00100000:2.0:1789402502.249931:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 231 00000100:00100000:2.0:1789402502.249955:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+25:11616:x1876324199268224:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402502.249996:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402502.250026:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ae4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47466 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.250118:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.250136:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.251040:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.251078:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.251090:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.251098:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.251478:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.251495:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47427 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.251819:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.251885:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47427 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402502.251904:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47427 expref: 26 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402502.251925:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff643480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224417920:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402502.252082:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d83bb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402502.256801:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff643480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876324224417920:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402502.256848:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402502.257854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402502.258409:0:12528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199268480 00000100:00100000:2.0:1789402502.258422:0:12528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199268480 00000100:00100000:2.0:1789402502.258554:0:12528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 63 00000100:00100000:2.0:1789402502.258566:0:12528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+27:5592:x1876324199268480:12345-192.168.203.8@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789402502.258905:0:12528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+28:5592:x1876324199268480:12345-192.168.203.8@tcp:35:ldlm_bl.0 Request processed in 340us (1056us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789402502.258914:0:12528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 63 00000100:00100000:0.0:1789402502.262309:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402502.262464:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199268608 00000100:00100000:3.0:1789402502.262477:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199268608 00010000:00010000:3.0:1789402502.262545:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47427 expref: 28 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402502.262600:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 87 00000100:00100000:3.0:1789402502.262631:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eac2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+28:2351:x1876324199268608:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402502.262651:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402502.262660:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47427 expref: 28 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.262676:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47427 expref: 28 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.262714:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f8a04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47427 expref: 28 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.262736:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402502.262741:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.262752:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.262761:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.262799:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402502.262862:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eac2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4785302d-2648-4148-8042-c10a24a5dd29+27:2351:x1876324199268608:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 232us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402502.262870:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 87 00010000:00010000:3.0:1789402502.264555:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.264574:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402502.264883:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789402502.264889:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402502.264918:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.264936:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265017:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265026:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265034:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265040:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402502.265045:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265055:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265074:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402502.265077:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402502.265084:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265090:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8aeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265124:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265131:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265138:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265143:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402502.265223:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265230:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265239:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c6c30f8700) 00010000:00010000:3.0:1789402502.265241:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402502.265244:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265250:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dec00/0x9403f4af875f8af2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265309:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8ae4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47466 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.265330:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47466 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402502.266398:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402502.266402:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402502.266406:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de400, rc 0) 00000100:00100000:3.0:1789402502.266541:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+26:11616:x1876324199268224:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 16594us (18418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402502.266552:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 231 00000004:00080000:1.0:1789402502.372266:0:8022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407520918758ns, next at 408520915239ns, rc = 0 00000100:00100000:3.0:1789402502.374596:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224418048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402502.375232:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402502.384323:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224418048 00000100:00100000:0.0:1789402502.384399:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224418048 00000100:00100000:0.0:1789402502.385123:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789402502.385139:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1876324224418048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789402502.385252:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789402502.385400:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1876324224418048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 264us (10171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402502.385407:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789402502.385598:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224418048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402502.626658:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402502.883692:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224418176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402502.883798:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402502.883982:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224418176 00000100:00100000:2.0:1789402502.883993:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224418176 00000100:00100000:2.0:1789402502.884072:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789402502.884084:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1876324224418176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402502.884129:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402502.884193:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1876324224418176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402502.884219:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789402502.884408:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224418176:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789402503.202592:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789402503.202607:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789402503.202655:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789402503.202662:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789402503.202838:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff679c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224418304:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789402503.205037:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789402503.217593:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402503.217730:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff679c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1876324224418304:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789402503.218913:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199268736 00000100:00100000:2.0:1789402503.218930:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199268736 00000100:00100000:2.0:1789402503.219019:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 232 00000100:00100000:2.0:1789402503.219032:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+26:11627:x1876324199268736:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789402503.219079:0:6712:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789402503.219228:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+26:11627:x1876324199268736:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 198us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402503.219237:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 232 00000100:00100000:2.0:1789402503.260619:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000040:00080000:2.0:1789402503.261560:0:12567:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789402503.261569:0:12567:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789402503.261624:0:12567:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789402503.261631:0:12567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789402503.265422:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199268992 00000100:00100000:1.0:1789402503.265442:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199268992 00000100:00100000:1.0:1789402503.265536:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 233 00000100:00100000:1.0:1789402503.265548:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+26:11627:x1876324199268992:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789402503.265575:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402503.265605:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223a00/0x9403f4af875f8b00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4746d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402503.265747:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402503.265766:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402503.265782:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402503.265797:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00020000:1.0:1789402503.265808:0:5846:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:1.0:1789402503.265969:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223a00/0x9403f4af875f8b00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4746d expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402503.265995:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4746d expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402503.266004:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:1.0:1789402503.266008:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402503.266011:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6222400, rc 0) 00000100:00100000:1.0:1789402503.266109:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+28:11627:x1876324199268992:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 562us (5503us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789402503.266117:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 233 00000100:00100000:3.0:1789402503.270570:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402503.270674:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402503.270881:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199269120 00000100:00100000:3.0:1789402503.270894:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199269120 00000100:00100000:3.0:1789402503.270967:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:3.0:1789402503.270978:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+28:2352:x1876324199269120:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402503.270997:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402503.271029:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222400/0x9403f4af875f8b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4746d expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402503.271050:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402503.271065:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402503.271126:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4785302d-2648-4148-8042-c10a24a5dd29+27:2352:x1876324199269120:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 150us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402503.271135:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:2.0:1789402503.273857:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199269376 00000100:00100000:2.0:1789402503.273878:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199269376 00000100:00100000:2.0:1789402503.274047:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 234 00000100:00100000:2.0:1789402503.274061:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+27:11627:x1876324199269376:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789402503.274184:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402503.274208:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402503.274221:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402503.274646:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402503.274665:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402503.274673:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402503.274680:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402503.274685:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402503.276054:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402503.276076:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402503.276080:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789402503.276087:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402503.276094:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f8b15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402503.276380:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4785302d-2648-4148-8042-c10a24a5dd29+28:11627:x1876324199269376:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 2316us (5699us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789402503.276393:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 234 00000040:00080000:3.0:1789402503.276924:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789402503.276930:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789402503.277474:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789402503.277490:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789402503.280973:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402503.281153:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199269632 00000100:00100000:1.0:1789402503.281176:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199269632 00000100:00100000:1.0:1789402503.281249:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 64 00000100:00100000:1.0:1789402503.281261:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+28:11627:x1876324199269632:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789402503.281584:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+29:11627:x1876324199269632:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 324us (621us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789402503.281593:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 64 00000001:00080000:1.0:1789402503.465966:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1789402503.465993:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1789402503.466001:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1789402503.650692:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402503.713568:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402503.713624:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402503.713654:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402503.713695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402503.713738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199270144 00000100:00100000:0.0:1789402503.713751:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199270144 00000100:00100000:0.0:1789402503.713835:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 161 00000100:00100000:1.0:1789402503.713936:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199270016 00000100:00100000:1.0:1789402503.713942:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199270016 00000100:00100000:1.0:1789402503.713977:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199269888 00000100:00100000:1.0:1789402503.713980:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199269888 00000100:00100000:1.0:1789402503.714003:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 94 00000100:00100000:1.0:1789402503.714015:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199270016:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402503.714110:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199270016:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 97us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402503.714118:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 94 00000100:00100000:1.0:1789402503.714142:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 95 00000100:00100000:1.0:1789402503.714148:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199269888:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402503.714184:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199269888:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 36us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402503.714211:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 95 00000100:00080000:3.0:1789402503.714490:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402503.714496:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402503.714570:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199269760 00000100:00100000:2.0:1789402503.714576:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199269760 00000100:00100000:2.0:1789402503.714621:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 299 00000100:00100000:2.0:1789402503.714629:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199269760:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402503.714666:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199269760:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 39us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402503.714682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 299 00000100:00100000:0.0:1789402503.714849:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199270144:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402503.714899:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199270144:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 64us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402503.716051:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 161 00010000:00010000:1.0:1789402504.674729:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789402505.315638:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789402505.315652:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789402505.315692:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789402505.315705:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789402505.358829:0:12621:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789402505.358842:0:12621:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789402505.358898:0:12621:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789402505.358905:0:12621:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789402505.555181:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402505.560227:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199270400 00000100:00100000:1.0:1789402505.560249:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199270400 00000100:00100000:1.0:1789402505.560421:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 235 00000100:00100000:1.0:1789402505.560494:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+29:11648:x1876324199270400:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402505.560530:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402505.560559:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8b1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47474 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789402505.560884:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789402505.560913:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222e00/0x9403f4af875f8b23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402505.560931:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222e00/0x9403f4af875f8b23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402505.560948:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222e00/0x9403f4af875f8b23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402505.560962:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00020000:1.0:1789402505.560971:0:5845:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2208192004097 00010000:00010000:1.0:1789402505.562938:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222c00/0x9403f4af875f8b1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47474 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402505.562979:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222e00/0x9403f4af875f8b23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47474 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402505.562991:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:1.0:1789402505.562994:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789402505.563013:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6222e00, rc 0) 00000100:00100000:1.0:1789402505.563914:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+31:11648:x1876324199270400:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 3472us (8738us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789402505.563927:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 235 00000100:00100000:2.0:1789402505.574317:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402505.574527:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199270528 00000100:00100000:3.0:1789402505.574540:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199270528 00000100:00100000:3.0:1789402505.574607:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 236 00000100:00100000:3.0:1789402505.574618:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+31:11648:x1876324199270528:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:3.0:1789402505.574708:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.574729:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.574744:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.574778:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.574796:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.574804:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.574811:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402505.574817:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.574826:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.574840:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402505.574844:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789402505.574850:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.574857:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c000/0x9403f4af875f8b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402505.574937:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4785302d-2648-4148-8042-c10a24a5dd29+31:11648:x1876324199270528:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 320us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402505.574945:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 236 00000100:00100000:3.0:1789402505.646987:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402505.647035:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199270656 00000100:00100000:3.0:1789402505.647047:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199270656 00000100:00100000:3.0:1789402505.647652:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 70 00000100:00100000:3.0:1789402505.647666:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199270656:12345-192.168.203.8@tcp:101:cat.0 00010000:00010000:3.0:1789402505.647704:0:12073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402505.647732:0:12073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c697c07b/0x9403f4af875f8b38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4747b expref: -99 pid: 12073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789402505.647771:0:12073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa81d84, atime: 0x6aa81d84, ctime: 0x6aa81d84, blocks: 0xb 00010000:00010000:3.0:1789402505.647798:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=410s v=(0 0) 00010000:00010000:3.0:1789402505.647804:0:12073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402505.647816:0:12073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c697c07b/0x9403f4af875f8b38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4747b expref: 8 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.647838:0:12073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c697c07b/0x9403f4af875f8b38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4747b expref: 8 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402505.647854:0:12073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90da00, rc 0) 00000100:00100000:3.0:1789402505.647934:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4785302d-2648-4148-8042-c10a24a5dd29+8:2351:x1876324199270656:12345-192.168.203.8@tcp:101:cat.0 Request processed in 271us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402505.647941:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 70 00000100:00080000:2.0:1789402505.648159:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789402505.651531:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402505.651582:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199270784 00000100:00100000:2.0:1789402505.651595:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199270784 00002000:00100000:2.0:1789402505.651770:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93c6ff642680 x1876324199270784/t0(0) o3->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:421/0 lens 488/0 e 0 to 0 dl 1789402516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789402505.653115:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ff642680 with x1876324199270784 ext(0->4095) 00002000:00010000:2.0:1789402505.653128:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6ff642680 00000100:00100000:2.0:1789402505.653278:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:2.0:1789402505.653298:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199270784:12345-192.168.203.8@tcp:3:cat.0 00000100:00100000:2.0:1789402505.653606:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4785302d-2648-4148-8042-c10a24a5dd29+8:2352:x1876324199270784:12345-192.168.203.8@tcp:3:cat.0 Request processed in 316us (2089us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789402505.653615:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 7 00002000:00100000:2.0:1789402505.653624:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93c6ff642680 x1876324199270784/t0(0) o3->4785302d-2648-4148-8042-c10a24a5dd29@192.168.203.8@tcp:421/0 lens 488/4536 e 0 to 0 dl 1789402516 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789402505.653633:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c6ff642680 with x1876324199270784 ext(0->4095) 00002000:00010000:2.0:1789402505.653636:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93c6ff642680 00010000:00010000:1.0:1789402505.698628:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402506.726604:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402506.989523:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224418688:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.989626:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402506.989695:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789402506.989702:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224418816:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.989733:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402506.989780:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224418688 00000100:00100000:2.0:1789402506.989790:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224418688 00000100:00100000:2.0:1789402506.989877:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789402506.989889:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224418688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.989954:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224418688:12345-0@lo:400:kworker.0 Request processed in 67us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402506.989962:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1789402506.989988:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402506.990238:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224418688:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.990895:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224418816 00000100:00100000:2.0:1789402506.990905:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224418816 00000100:00100000:2.0:1789402506.990962:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789402506.990972:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224418816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991044:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224418816:12345-0@lo:400:kworker.0 Request processed in 73us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402506.991051:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789402506.991078:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c5c282e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224418560:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991112:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402506.991148:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224419072:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991171:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402506.991194:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789402506.991202:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224418432:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991251:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402506.991283:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7003d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224418944:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991304:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402506.991339:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224419072 00000100:00100000:2.0:1789402506.991365:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224419072 00000100:00100000:2.0:1789402506.991397:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789402506.991404:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224419072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991445:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224419072:12345-0@lo:400:kworker.0 Request processed in 42us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402506.991453:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789402506.991474:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224418432 00000100:00100000:2.0:1789402506.991478:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224418432 00000100:00100000:2.0:1789402506.991502:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789402506.991507:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224418432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991542:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224418432:12345-0@lo:400:kworker.0 Request processed in 33us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402506.991548:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:2.0:1789402506.991576:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402506.991580:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402506.991605:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224418432:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991619:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224419072:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991653:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789402506.991659:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789402506.991677:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6ff67d180, transno 4294967310 00000100:00100000:2.0:1789402506.991690:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224418816:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224418560 00000100:00100000:2.0:1789402506.991742:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224418560 00000100:00100000:2.0:1789402506.991764:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224418944 00000100:00100000:2.0:1789402506.991766:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224418944 00000100:00100000:2.0:1789402506.991784:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789402506.991789:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224418560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991822:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224418560:12345-0@lo:400:kworker.0 Request processed in 33us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402506.991828:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789402506.991838:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789402506.991843:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224418944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991864:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224418944:12345-0@lo:400:kworker.0 Request processed in 22us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402506.991870:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1789402506.991892:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402506.991911:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7003d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224418944:0@lo:400:kworker.0 00000100:00100000:2.0:1789402506.991920:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c5c282e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224418560:0@lo:400:kworker.0 00000001:00080000:1.0:1789402507.102727:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:1.0:1789402507.102755:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000004:00080000:1.0:1789402507.102767:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1789402507.102781:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789402507.102814:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c700072780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789402507.102820:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e61e7b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c700072300 00000020:00080000:1.0:1789402507.102824:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c6e61e7500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c6ddf9f800 00000020:00080000:1.0:1789402507.102950:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789402507.103203:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1789402507.103229:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224419200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789402507.103321:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402507.103982:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224419200 00000100:00100000:2.0:1789402507.103995:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224419200 00000100:00100000:2.0:1789402507.104054:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789402507.104064:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1876324224419200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789402507.104363:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789402507.104368:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789402500 -> 1789402500 00002000:00010000:2.0:1789402507.104372:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789402500 -> 1789402500 00002000:00010000:2.0:1789402507.104375:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789402500 -> 1789402500 00002000:00010000:2.0:1789402507.104378:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789402507.104456:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1876324224419200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 393us (1134us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789402507.104465:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:1.0:1789402507.110533:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6ff679c00/2, rc 0, transno 4294967324 00000100:00100000:1.0:1789402507.110554:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224419200:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789402507.141827:0:12654:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1789402507.141966:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:3.0:1789402507.492121:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402507.492164:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224419328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402507.492260:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402507.498161:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224419328 00000100:00100000:2.0:1789402507.498184:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224419328 00000100:00100000:2.0:1789402507.498264:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789402507.498277:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876324224419328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789402507.498334:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402507.498850:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876324224419328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 573us (6588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402507.498861:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789402507.499110:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1789402507.499119:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6ff67a300, transno 4294967321 00000004:00080000:3.0:1789402507.499150:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1789402507.499185:0:3315:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93c6ff679c00 x1876324224419200/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789402523 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402507.499225:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224419328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402507.750749:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402508.002985:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402508.003020:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224419456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402508.003612:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402508.003742:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224419456 00000100:00100000:2.0:1789402508.003754:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224419456 00000100:00080000:1.0:1789402508.003821:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402508.003839:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789402508.003853:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224419456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402508.003901:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402508.004775:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224419456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 919us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402508.004789:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789402508.006703:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224419456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789402508.771612:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402508.839427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402508.839486:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402508.839514:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402508.839535:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402508.839559:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402508.839735:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199271296 00000100:00100000:1.0:1789402508.839748:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199271296 00000100:00100000:1.0:1789402508.839827:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199271168 00000100:00100000:1.0:1789402508.839831:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199271168 00000100:00100000:1.0:1789402508.839859:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 98 00000100:00100000:1.0:1789402508.839889:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:2353:x1876324199271296:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402508.839993:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+7:2353:x1876324199271296:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 107us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402508.840001:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 98 00000100:00100000:1.0:1789402508.840020:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 99 00000100:00100000:1.0:1789402508.840027:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199271168:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402508.840053:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4785302d-2648-4148-8042-c10a24a5dd29+5:2353:x1876324199271168:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402508.840060:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 99 00000100:00080000:0.0:1789402508.840333:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789402508.840339:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402508.840908:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199271040 00000100:00100000:3.0:1789402508.840919:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199271040 00000100:00100000:3.0:1789402508.840968:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199271424 00000100:00100000:3.0:1789402508.840972:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199271424 00000100:00100000:3.0:1789402508.840999:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 165 00000100:00100000:3.0:1789402508.841008:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ffac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:2353:x1876324199271040:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402508.841074:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ffac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:2353:x1876324199271040:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 67us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402508.841793:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 165 00000100:00100000:3.0:1789402508.841824:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 166 00000100:00100000:3.0:1789402508.841836:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6eec03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199271424:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402508.841889:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6eec03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2353:x1876324199271424:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 57us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402508.841895:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 166 00000100:00100000:3.0:1789402508.841921:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199270912 00000100:00100000:3.0:1789402508.841928:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199270912 00000100:00100000:3.0:1789402508.841978:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 301 00000100:00100000:3.0:1789402508.841985:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199270912:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402508.842015:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199270912:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 31us (2499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402508.842040:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 301 00000100:00080000:3.0:1789402508.843502:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789402509.795767:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402510.820788:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402511.329252:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402511.329822:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199271552 00000100:00100000:2.0:1789402511.329839:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199271552 00000100:00100000:2.0:1789402511.329941:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 237 00000100:00100000:2.0:1789402511.329957:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:11293:x1876324199271552:12345-192.168.203.8@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789402511.330115:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:11293:x1876324199271552:12345-192.168.203.8@tcp:60:lhsmtool_posix.0 Request processed in 154us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402511.330123:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 237 00000100:00080000:3.0:1789402511.330329:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402511.342644:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402511.342807:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199271808 00000100:00100000:1.0:1789402511.342820:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199271808 00000100:00100000:1.0:1789402511.342890:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 65 00000100:00100000:1.0:1789402511.342902:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:11293:x1876324199271808:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789402511.343370:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+19:11293:x1876324199271808:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 468us (738us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789402511.343380:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 65 00010000:00010000:1.0:1789402511.847242:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402512.099212:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402512.099244:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224419584:0@lo:400:kworker.0 00000100:00100000:1.0:1789402512.099339:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402512.099486:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224419968:0@lo:400:kworker.0 00000100:00100000:1.0:1789402512.099517:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402512.099559:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402512.099565:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224420096:0@lo:400:kworker.0 00000100:00100000:1.0:1789402512.099612:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402512.099808:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224419712:0@lo:400:kworker.0 00000100:00100000:3.0:1789402512.099844:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402512.099862:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402512.099867:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224419840:0@lo:400:kworker.0 00000100:00100000:3.0:1789402512.099900:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402512.100373:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6c9988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224420224:0@lo:400:kworker.0 00000100:00100000:3.0:1789402512.100407:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402512.100497:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224419968 00000100:00100000:3.0:1789402512.100506:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224419968 00000100:00100000:3.0:1789402512.100567:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224420224 00000100:00100000:3.0:1789402512.100570:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224420224 00000100:00100000:3.0:1789402512.100598:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789402512.100608:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224419968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402512.100929:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789402512.100940:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1876324224420224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402512.101000:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1876324224420224:12345-0@lo:400:kworker.0 Request processed in 62us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402512.101007:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789402512.101059:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6c9988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224420224:0@lo:400:kworker.0 00000100:00080000:1.0:1789402512.101109:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789402512.101115:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402512.101472:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224419584 00000100:00100000:2.0:1789402512.101478:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224419584 00000100:00100000:2.0:1789402512.101524:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789402512.101532:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224419584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402512.101583:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224419584:12345-0@lo:400:kworker.0 Request processed in 51us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402512.101589:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789402512.101646:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224420096 00000100:00100000:2.0:1789402512.101651:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224420096 00000100:00100000:2.0:1789402512.101685:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224419712 00000100:00100000:2.0:1789402512.101688:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224419712 00000100:00100000:2.0:1789402512.101703:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789402512.101708:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224420096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402512.101745:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224420096:12345-0@lo:400:kworker.0 Request processed in 36us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402512.101751:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789402512.101761:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224419840 00000100:00100000:2.0:1789402512.101764:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224419840 00000100:00100000:2.0:1789402512.101780:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789402512.101786:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224419712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402512.101821:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224419712:12345-0@lo:400:kworker.0 Request processed in 35us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402512.101827:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789402512.101841:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789402512.101847:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c5c1e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224419840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402512.101877:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c5c1e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224419840:12345-0@lo:400:kworker.0 Request processed in 31us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402512.101920:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789402512.102306:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224419840:0@lo:400:kworker.0 00000100:00100000:2.0:1789402512.102320:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224419712:0@lo:400:kworker.0 00000100:00100000:3.0:1789402512.102868:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224419968:12345-0@lo:400:kworker.0 Request processed in 2258us (3346us total) trans 0 rc 0/0 00000100:00080000:1.0:1789402512.102988:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789402512.103042:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224420096:0@lo:400:kworker.0 00000100:00100000:1.0:1789402512.103054:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224419968:0@lo:400:kworker.0 00000100:00100000:1.0:1789402512.103064:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224419584:0@lo:400:kworker.0 00000100:00100000:3.0:1789402512.104076:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000001:00080000:3.0:1789402512.160705:0:12654:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1789402512.189004:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1789402512.189024:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789402512.189131:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789402512.189144:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1789402512.610581:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402512.610607:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224420352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789402512.610685:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402512.610951:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224420352 00000100:00100000:1.0:1789402512.610960:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224420352 00000100:00100000:1.0:1789402512.611018:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789402512.611028:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224420352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402512.611064:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402512.611130:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224420352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402512.611137:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789402512.611248:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789402512.611254:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6ff679c00, transno 4294967324 00000100:00100000:0.0:1789402512.611277:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224420352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789402512.870076:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402513.122876:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224420480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402513.122966:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402513.123311:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224420480 00000100:00100000:2.0:1789402513.123320:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224420480 00000100:00100000:2.0:1789402513.123548:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789402513.123558:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224420480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402513.123592:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402513.123654:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224420480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402513.123660:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789402513.123745:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224420480:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789402513.580455:0:12824:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:15:11 (1789402511) 00010000:00010000:1.0:1789402513.893154:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402513.957890:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402513.957934:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402513.957962:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402513.957985:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402513.958007:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402513.958032:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199272192 00000100:00100000:1.0:1789402513.958040:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199272192 00000100:00100000:1.0:1789402513.958108:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199272320 00000100:00100000:1.0:1789402513.958111:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199272320 00000100:00100000:1.0:1789402513.958138:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 102 00000100:00100000:1.0:1789402513.958148:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199272192:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402513.958214:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+5:2351:x1876324199272192:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 67us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402513.958221:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 102 00000100:00100000:1.0:1789402513.958240:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 103 00000100:00100000:1.0:1789402513.958246:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199272320:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402513.958272:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4785302d-2648-4148-8042-c10a24a5dd29+7:2351:x1876324199272320:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402513.958278:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 103 00000100:00100000:1.0:1789402513.958295:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199272448 00000100:00100000:1.0:1789402513.958298:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199272448 00000100:00100000:1.0:1789402513.958324:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199272064 00000100:00100000:1.0:1789402513.958328:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199272064 00000100:00100000:3.0:1789402513.958337:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199271936 00000100:00100000:3.0:1789402513.958375:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199271936 00000100:00100000:1.0:1789402513.958403:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 170 00000100:00100000:3.0:1789402513.958408:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 303 00000100:00100000:1.0:1789402513.958411:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199272448:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402513.958414:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199271936:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402513.958444:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2351:x1876324199271936:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 29us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402513.958444:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2351:x1876324199272448:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 33us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402513.958452:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 303 00000100:00100000:1.0:1789402513.958452:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 170 00000100:00100000:1.0:1789402513.958464:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 171 00000100:00100000:1.0:1789402513.958545:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+18:2351:x1876324199272064:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402513.958580:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4785302d-2648-4148-8042-c10a24a5dd29+18:2351:x1876324199272064:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 38us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402513.958586:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 171 00000100:00080000:1.0:1789402513.958609:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789402513.958614:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789402513.958617:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789402514.918931:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789402515.567520:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789402515.567550:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789402515.568389:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789402515.568398:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789402515.938950:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402516.611836:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402516.611942:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199272576 00000100:00100000:1.0:1789402516.611954:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199272576 00000100:00100000:1.0:1789402516.612041:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 238 00000100:00100000:1.0:1789402516.612053:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:12312:x1876324199272576:12345-192.168.203.8@tcp:101:lsof.0 00010000:00010000:1.0:1789402516.612082:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402516.612106:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223a00/0x9403f4af875f8b3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47482 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402516.612187:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8b46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402516.612208:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8b46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402516.612241:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8b46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402516.612279:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789402516.612283:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402516.612324:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8b46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402516.612391:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223a00/0x9403f4af875f8b3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47482 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402516.612416:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8b46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47482 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402516.612425:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:1.0:1789402516.612428:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789402516.612431:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6223000, rc 0) 00000100:00100000:1.0:1789402516.612496:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:12312:x1876324199272576:12345-192.168.203.8@tcp:101:lsof.0 Request processed in 445us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402516.612504:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 238 00000100:00080000:2.0:1789402516.612717:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789402516.962572:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402517.218756:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224420608:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.218828:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402517.218880:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224421120:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.218907:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402517.218932:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789402517.218937:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224420992:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.218960:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402517.219004:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224420736:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.219029:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402517.219045:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224421248:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.219078:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402517.219096:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789402517.219102:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224420864:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.219122:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402517.219151:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224420608 00000100:00100000:1.0:1789402517.219158:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224420608 00000100:00100000:1.0:1789402517.219202:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789402517.219210:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224420608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.219258:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224420608:12345-0@lo:400:kworker.0 Request processed in 48us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402517.219265:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789402517.219294:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224421120 00000100:00100000:1.0:1789402517.219298:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224421120 00000100:00100000:1.0:1789402517.219328:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224420736 00000100:00100000:1.0:1789402517.219331:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224420736 00000100:00100000:1.0:1789402517.219367:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224420864 00000100:00100000:1.0:1789402517.219370:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224420864 00000100:00100000:1.0:1789402517.219387:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789402517.219393:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224421120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.219424:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224421120:12345-0@lo:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402517.219430:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789402517.219441:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789402517.219709:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224420992 00000100:00100000:3.0:1789402517.219714:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224420992 00000100:00100000:3.0:1789402517.219746:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224421248 00000100:00100000:3.0:1789402517.219749:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224421248 00000100:00100000:3.0:1789402517.219768:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789402517.219775:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224420992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402517.219812:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224420992:12345-0@lo:400:kworker.0 Request processed in 37us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402517.219819:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789402517.219831:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789402517.219837:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f8fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224421248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402517.219869:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f8fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224421248:12345-0@lo:400:kworker.0 Request processed in 31us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402517.219875:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789402517.220178:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224421248:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.221776:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c9988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224420736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.221871:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c9988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224420736:12345-0@lo:400:kworker.0 Request processed in 106us (2839us total) trans 0 rc 0/0 00000100:00080000:2.0:1789402517.221956:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402517.221961:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789402517.221964:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402517.224375:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789402517.224413:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224420864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402517.224825:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224420864:12345-0@lo:400:kworker.0 Request processed in 420us (5699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402517.224835:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789402517.229694:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224420864:0@lo:400:kworker.0 00000100:00100000:3.0:1789402517.229714:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224420736:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.234373:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789402517.234493:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224420992:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.234506:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224420608:0@lo:400:kworker.0 00000100:00100000:1.0:1789402517.234518:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224421120:0@lo:400:kworker.0 00000100:00100000:0.0:1789402517.734128:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402517.734151:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224421376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789402517.734231:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402517.734547:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224421376 00000100:00100000:2.0:1789402517.734556:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224421376 00000100:00100000:2.0:1789402517.734611:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789402517.734621:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224421376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789402517.734665:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402517.734729:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224421376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402517.734736:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789402517.734930:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224421376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789402517.986578:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402518.242815:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402518.242836:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224421504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402518.242900:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402518.243010:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224421504 00000100:00100000:2.0:1789402518.243030:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224421504 00000100:00100000:2.0:1789402518.243088:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789402518.243097:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224421504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402518.243130:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402518.243182:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224421504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402518.243190:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789402518.243273:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224421504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402518.556251:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402518.556416:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199272832 00000100:00100000:1.0:1789402518.556426:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199272832 00000100:00100000:1.0:1789402518.556493:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 66 00000100:00100000:1.0:1789402518.556502:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+18:12314:x1876324199272832:12345-192.168.203.8@tcp:35:umount.0 00000100:00100000:1.0:1789402518.556874:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+19:12314:x1876324199272832:12345-192.168.203.8@tcp:35:umount.0 Request processed in 371us (630us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789402518.556882:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 66 00000100:00080000:2.0:1789402518.557147:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402518.566337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402518.566594:0:12528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199273088 00000100:00100000:2.0:1789402518.566605:0:12528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199273088 00000100:00100000:2.0:1789402518.566668:0:12528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 67 00000100:00100000:2.0:1789402518.566679:0:12528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+19:12314:x1876324199273088:12345-192.168.203.8@tcp:35:umount.0 00000100:00100000:2.0:1789402518.567027:0:12528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4785302d-2648-4148-8042-c10a24a5dd29+20:12314:x1876324199273088:12345-192.168.203.8@tcp:35:umount.0 Request processed in 347us (699us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789402518.567036:0:12528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 67 00000100:00100000:3.0:1789402518.572728:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402518.572830:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199273344 00000100:00100000:0.0:1789402518.572841:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199273344 00000100:00100000:0.0:1789402518.572899:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 68 00000100:00100000:0.0:1789402518.572910:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c8e65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+20:12314:x1876324199273344:12345-192.168.203.8@tcp:35:umount.0 00000100:00100000:0.0:1789402518.573165:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c8e65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4785302d-2648-4148-8042-c10a24a5dd29+21:12314:x1876324199273344:12345-192.168.203.8@tcp:35:umount.0 Request processed in 255us (446us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789402518.573173:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 68 00000100:00100000:3.0:1789402518.579438:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402518.579636:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199273600 00000100:00100000:1.0:1789402518.579646:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199273600 00000100:00100000:1.0:1789402518.579725:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:1.0:1789402518.579736:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+21:12314:x1876324199273600:12345-192.168.203.8@tcp:35:umount.0 00000100:00100000:1.0:1789402518.580553:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4785302d-2648-4148-8042-c10a24a5dd29+22:12314:x1876324199273600:12345-192.168.203.8@tcp:35:umount.0 Request processed in 814us (1119us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789402518.580562:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 69 00000100:00100000:3.0:1789402518.585531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402518.585572:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402518.592909:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402518.602420:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402518.602468:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199274368 00000100:00100000:3.0:1789402518.602477:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199274368 00000100:00100000:3.0:1789402518.602535:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 72 00000100:00100000:3.0:1789402518.602545:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2350:x1876324199274368:12345-192.168.203.8@tcp:9:umount.0 00000020:00000080:3.0:1789402518.602574:0:6689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f810c 00000020:00010000:3.0:1789402518.602587:0:6689:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93c6d1685800: total 0 00000100:00080000:3.0:1789402518.602592:0:6689:0:(import.c:65:import_set_state_nolock()) ffff93c6ffaaf800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789402518.602628:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789402518.602905:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4785302d-2648-4148-8042-c10a24a5dd29+5:2350:x1876324199274368:12345-192.168.203.8@tcp:9:umount.0 Request processed in 360us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402518.602914:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 72 00000020:00010000:3.0:1789402518.602939:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93c6d1685800: total 0 00010000:00010000:3.0:1789402518.602969:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c6d1685800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789402518.603022:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c9eabea/0x9403f4af875f84a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472b4 expref: 4 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.603064:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c697c07b/0x9403f4af875f8b38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4747b expref: 3 pid: 12073 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.603079:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c6d1685800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789402518.603090:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402518.603093:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402518.603094:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789402518.603102:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402518.608322:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402518.608380:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199274496 00000100:00100000:3.0:1789402518.608389:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199274496 00000100:00100000:3.0:1789402518.608442:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 73 00000100:00100000:3.0:1789402518.608452:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+5:2350:x1876324199274496:12345-192.168.203.8@tcp:9:umount.0 00000020:00000080:3.0:1789402518.608479:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7ea4 00000100:00080000:3.0:1789402518.608487:0:6690:0:(import.c:65:import_set_state_nolock()) ffff93c6c74c9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789402518.608532:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789402518.608796:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4785302d-2648-4148-8042-c10a24a5dd29+2:2350:x1876324199274496:12345-192.168.203.8@tcp:9:umount.0 Request processed in 344us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402518.608815:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 73 00000100:00080000:3.0:1789402518.608852:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789402518.609831:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402518.615093:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199273728 00000100:00100000:2.0:1789402518.615108:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199273728 00000100:00100000:2.0:1789402518.615207:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199273856 00000100:00100000:2.0:1789402518.615211:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199273856 00000100:00100000:2.0:1789402518.615224:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199273984 00000100:00100000:2.0:1789402518.615226:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199273984 00000100:00100000:2.0:1789402518.615248:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:2.0:1789402518.615258:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+15:2353:x1876324199273728:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402518.615273:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402518.615303:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1507e00/0x9403f4af875f7bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47014 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402518.615319:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402518.615410:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+14:2353:x1876324199273728:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 152us (29887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402518.615418:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:2.0:1789402518.615438:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:2.0:1789402518.615445:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+13:2353:x1876324199273856:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402518.615452:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402518.615461:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215f200/0x9403f4af875f7b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b46fdc expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402518.615470:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402518.615485:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:2353:x1876324199273856:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 41us (29914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402518.615492:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:2.0:1789402518.615503:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:2.0:1789402518.615509:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:2354:x1876324199273984:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402518.615516:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402518.615524:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a82600/0x9403f4af875f7de0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470df expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402518.615532:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402518.615547:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2354:x1876324199273984:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 38us (22648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402518.615553:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:3.0:1789402518.629078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402518.629313:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199275520 00000100:00100000:1.0:1789402518.629324:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199275520 00000100:00100000:1.0:1789402518.629418:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 239 00000100:00100000:1.0:1789402518.629442:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+22:2350:x1876324199275520:12345-192.168.203.8@tcp:39:umount.0 00000020:00000080:1.0:1789402518.629475:0:5844:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7b40 00000020:00010000:1.0:1789402518.629491:0:5844:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93c6ddd7c000: total 0 00000100:00080000:1.0:1789402518.629496:0:5844:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789402518.629522:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1789402518.629773:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93c6ddd7c000: total 0 00010000:00010000:3.0:1789402518.629777:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402518.629829:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c6ddd7c000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789402518.629861:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402518.629864:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402518.629872:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de400/0x9403f4af875f8af9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47466 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.629890:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:3.0:1789402518.629892:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789402518.629896:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83800/0x9403f4af875f7e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47109 expref: 20 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.629909:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:3.0:1789402518.629911:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789402518.629915:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e600/0x9403f4af875f84fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472c9 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.629926:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c6c3a3e400) 00010000:00010000:3.0:1789402518.629929:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789402518.629932:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82e00/0x9403f4af875f8167 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b471db expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.629950:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402518.629952:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402518.629956:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f800/0x9403f4af875f8389 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47267 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.629989:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402518.629992:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789402518.629996:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f87f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b473a2 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.630009:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402518.630011:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789402518.630014:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6222e00/0x9403f4af875f8b23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47474 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.630025:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402518.630028:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402518.630031:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223400/0x9403f4af875f8a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4742e expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.630064:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c6d8cd8300) 00010000:00010000:3.0:1789402518.630066:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789402518.630070:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e800/0x9403f4af875f8518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472d0 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.630084:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6d8cd8d00) 00010000:00010000:3.0:1789402518.630086:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402518.630090:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83e200/0x9403f4af875f7e26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470f4 expref: 12 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.630104:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402518.630106:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789402518.630116:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dee00/0x9403f4af875f8469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4729f expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.630129:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c6c3a3ed00) 00010000:00010000:3.0:1789402518.630132:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789402518.630135:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6cb83f400/0x9403f4af875f8493 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b472ad expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.630153:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c6d2ca6900) 00010000:00010000:3.0:1789402518.630155:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789402518.630159:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c800/0x9403f4af875f7e0a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470ed expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402518.630175:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c6ddd7c000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789402518.630188:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402518.630190:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402518.630192:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402518.631735:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4785302d-2648-4148-8042-c10a24a5dd29+7:2350:x1876324199275520:12345-192.168.203.8@tcp:39:umount.0 Request processed in 2286us (2657us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789402518.631748:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 239 00000001:00100000:1.0:1789402518.814227:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:1.0:1789402518.814239:0:6714:0:(genops.c:885:class_export_put()) final put ffff93c6c74cc000/4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:2.0:1789402518.814301:0:12573:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6c74cc000/4785302d-2648-4148-8042-c10a24a5dd29 for lustre-OST0000 00000020:00000080:2.0:1789402518.814384:0:12573:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6c74c9800 for lustre-OST0000 00010000:00010000:3.0:1789402519.010604:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402519.070421:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402519.070580:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199275648 00000100:00100000:2.0:1789402519.070603:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199275648 00000100:00100000:2.0:1789402519.070672:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 175 00000100:00100000:2.0:1789402519.070682:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:2354:x1876324199275648:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402519.070770:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:2354:x1876324199275648:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 88us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402519.070778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 175 00000100:00080000:3.0:1789402519.073632:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789402520.034675:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402520.995678:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402520.995737:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402520.995794:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199275904 00000100:00100000:2.0:1789402520.995807:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199275904 00000100:00100000:3.0:1789402520.995813:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402520.995891:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199276032 00000100:00100000:2.0:1789402520.995895:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199276032 00000100:00100000:2.0:1789402520.995920:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199275776 00000100:00100000:2.0:1789402520.995924:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199275776 00000100:00100000:2.0:1789402520.995955:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:2.0:1789402520.995966:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ef3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+12:2351:x1876324199275904:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402520.995989:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402520.996015:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83f000/0x9403f4af875f7c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47053 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402520.996047:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402520.996113:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ef3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+11:2351:x1876324199275904:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 149us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402520.996121:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:2.0:1789402520.996141:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:2.0:1789402520.996148:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+10:2351:x1876324199276032:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402520.996157:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402520.996166:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f7dd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b470d8 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402520.996195:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402520.996216:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+9:2351:x1876324199276032:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 69us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402520.996222:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:2.0:1789402520.996235:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:2.0:1789402520.996241:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+8:2352:x1876324199275776:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402520.996250:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402520.996259:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a82200/0x9403f4af875f7c12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47029 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402520.996268:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402520.996286:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+7:2352:x1876324199275776:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 45us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402520.996292:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:1.0:1789402521.009687:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402521.010644:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199276288 00000100:00100000:2.0:1789402521.010660:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199276288 00000100:00080000:3.0:1789402521.011078:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402521.011162:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 240 00000100:00100000:2.0:1789402521.011177:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+6:2350:x1876324199276288:12345-192.168.203.8@tcp:39:umount.0 00000020:00000080:2.0:1789402521.011235:0:5846:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7c27 00000020:00010000:2.0:1789402521.011245:0:5846:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93c6ff70d000: total 0 00000100:00080000:2.0:1789402521.011251:0:5846:0:(import.c:65:import_set_state_nolock()) ffff93c6ff709000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789402521.011325:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1789402521.011680:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a+5:2350:x1876324199276288:12345-192.168.203.8@tcp:39:umount.0 Request processed in 505us (2006us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789402521.011689:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 240 00000020:00010000:3.0:1789402521.023098:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93c6ff70d000: total 0 00010000:00010000:2.0:1789402521.023260:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c6ff70d000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789402521.023311:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6d8cd8700) 00010000:00010000:2.0:1789402521.023317:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789402521.023331:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6e6223000/0x9403f4af875f8b46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47482 expref: 4 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402521.023400:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c6ff70d000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789402521.023412:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402521.023415:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402521.023417:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402521.049891:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402521.050077:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199276544 00000100:00100000:2.0:1789402521.050095:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199276544 00000100:00100000:2.0:1789402521.050172:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 305 00000100:00100000:2.0:1789402521.050184:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+7:2350:x1876324199276544:12345-192.168.203.8@tcp:251:umount.0 00000020:00000080:2.0:1789402521.050261:0:5839:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7b1d 00000020:00010000:2.0:1789402521.050270:0:5839:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93c6ddd7e800: total 0 00000100:00080000:2.0:1789402521.050276:0:5839:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7b800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789402521.050410:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9+3:2350:x1876324199276544:12345-192.168.203.8@tcp:251:umount.0 Request processed in 227us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402521.050419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 305 00000020:00010000:3.0:1789402521.053862:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93c6ddd7e800: total 0 00010000:00010000:3.0:1789402521.053875:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402521.053955:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c6ddd7e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789402521.054042:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6ef3df200/0x9403f4af875f7bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4701b expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402521.054076:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c6ddd7e800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789402521.054088:0:5832:0:(genops.c:885:class_export_put()) final put ffff93c6ddd7e800/95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9 00010000:00010000:3.0:1789402521.054116:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402521.054118:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402521.054121:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789402521.054166:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ddd7e800/95913ec1-7fdd-4726-ac1a-a2b0cbccf6f9 for MGS 00000020:00000080:0.0:1789402521.054223:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ddd7b800 for MGS 00010000:00010000:2.0:1789402521.058547:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402522.083616:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402522.341956:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224421632:0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.342072:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402522.342129:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224422144:0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.342163:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402522.342197:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789402522.342204:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224422016:0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.342233:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402522.342270:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224421888:0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.342297:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402522.342317:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789402522.342322:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224421760:0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.342379:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402522.342396:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224422272:0@lo:400:kworker.0 00000100:00100000:2.0:1789402522.342517:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224422144 00000100:00100000:2.0:1789402522.342528:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224422144 00000100:00100000:2.0:1789402522.342612:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224421888 00000100:00100000:2.0:1789402522.342615:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224421888 00000100:00100000:2.0:1789402522.342632:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224421760 00000100:00100000:2.0:1789402522.342634:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224421760 00000100:00100000:2.0:1789402522.342652:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789402522.342662:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224422144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402522.342744:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876324224422144:12345-0@lo:400:kworker.0 Request processed in 82us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402522.342753:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789402522.342774:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789402522.342780:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224421888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402522.342819:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876324224421888:12345-0@lo:400:kworker.0 Request processed in 40us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402522.342825:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789402522.342835:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789402522.342840:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224421760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402522.342862:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876324224421760:12345-0@lo:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402522.342867:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1789402522.342887:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402522.342951:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876324224422144:0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.343279:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402522.343319:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876324224421888:0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.343338:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876324224421760:0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.343393:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224421632 00000100:00100000:1.0:1789402522.343398:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224421632 00000100:00100000:1.0:1789402522.344848:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789402522.344867:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224421632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.345006:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e32ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224421632:12345-0@lo:400:kworker.0 Request processed in 147us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402522.345014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789402522.345078:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224422016 00000100:00100000:1.0:1789402522.345086:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224422016 00000100:00100000:1.0:1789402522.345134:0:12073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224422272 00000100:00100000:1.0:1789402522.345137:0:12073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224422272 00000100:00100000:1.0:1789402522.345156:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789402522.345162:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224422016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.345194:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224422016:12345-0@lo:400:kworker.0 Request processed in 33us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402522.345201:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789402522.345210:0:12073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789402522.345215:0:12073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224422272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402522.345247:0:12073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224422272:12345-0@lo:400:kworker.0 Request processed in 32us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402522.345253:0:12073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789402522.345302:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224422272:0@lo:400:kworker.0 00000100:00080000:2.0:1789402522.345429:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402522.345434:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402522.345461:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224422016:0@lo:400:kworker.0 00000100:00100000:2.0:1789402522.345471:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224421632:0@lo:400:kworker.0 00000001:00080000:2.0:1789402522.424604:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:2.0:1789402522.424624:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000001:00080000:2.0:1789402522.424631:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1789402522.424639:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a 00000001:00080000:2.0:1789402522.424645:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789402522.424666:0:5866:0:(genops.c:885:class_export_put()) final put ffff93c6ff70d000/cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a 00000020:00000080:2.0:1789402522.424684:0:5866:0:(genops.c:885:class_export_put()) final put ffff93c6ddd7c000/4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:2.0:1789402522.424699:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ff70d000/cb76c85a-bdd7-40ae-a4be-bceca0e4ad5a for lustre-MDT0000 00000020:00000080:2.0:1789402522.424763:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ddd7c000/4785302d-2648-4148-8042-c10a24a5dd29 for lustre-MDT0000 00000020:00000080:2.0:1789402522.424803:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ff709000 for lustre-MDT0000 00000020:00000080:2.0:1789402522.424808:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ddd7a000 for lustre-MDT0000 00000001:00100000:1.0:1789402522.441051:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:1.0:1789402522.441066:0:7645:0:(genops.c:885:class_export_put()) final put ffff93c6d1685800/4785302d-2648-4148-8042-c10a24a5dd29 00000020:00000080:3.0:1789402522.441532:0:12573:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6d1685800/4785302d-2648-4148-8042-c10a24a5dd29 for lustre-OST0001 00000020:00000080:3.0:1789402522.442277:0:12573:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ffaaf800 for lustre-OST0001 00000100:00100000:0.0:1789402522.851520:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224422400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789402522.851682:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402522.851784:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224422400 00000100:00100000:0.0:1789402522.851795:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224422400 00000100:00100000:0.0:1789402522.851848:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789402522.851865:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224422400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789402522.851911:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789402522.851965:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224422400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402522.851971:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789402522.852211:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224422400:0@lo:13:osp-pre-1-0.0 00000020:01000004:3.0:1789402522.952188:0:13025:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789402522.977796:0:13025:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789402522.977844:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.977860:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.977868:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.977875:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.977904:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789402522.977910:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789402522.977937:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789402522.977942:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789402522.977948:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789402522.977972:0:13025:0:(import.c:65:import_set_state_nolock()) ffff93c6fb1eb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789402522.978066:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224422528:0@lo:39:umount.0 00000100:00100000:0.0:1789402522.978130:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789402522.978239:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402522.978247:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.978255:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83fc00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:3.0:1789402522.978259:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.978267:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789402522.978274:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402522.978279:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789402522.978282:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789402522.978285:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789402522.978308:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.978329:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789402522.978375:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.978383:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83fc00/0x9403f4af875f7ba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7ba9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.978395:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402522.978397:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402522.978399:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402522.978499:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224422656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402522.978530:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402522.978573:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224422656 00000100:00100000:0.0:1789402522.978580:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224422656 00000100:00100000:0.0:1789402522.978704:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789402522.978715:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3313:x1876324224422656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789402522.978727:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402522.978748:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215e400/0x9403f4af875f7ba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7ba2 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402522.978761:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402522.978795:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8612d911-d8bf-490d-b22c-35e85a3b4473+18:3313:x1876324224422656:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402522.978802:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789402522.978840:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224422656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789402522.978949:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224422528 00000100:00100000:1.0:1789402522.978955:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224422528 00000100:00100000:1.0:1789402522.978992:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789402522.979000:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876324224422528:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789402522.979031:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f792c 00000100:00080000:1.0:1789402522.979040:0:5845:0:(import.c:65:import_set_state_nolock()) ffff93c6fb916000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789402522.979094:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3312:x1876324224422528:12345-0@lo:39:umount.0 Request processed in 95us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402522.979110:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1789402522.979117:0:5845:0:(genops.c:885:class_export_put()) final put ffff93c6fb913800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1789402522.979137:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789402522.979148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb913800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789402522.979202:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6fb916000 for lustre-MDT0000 00000100:00080000:0.0:1789402522.979220:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6fb1eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789402522.979237:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224422528:0@lo:39:umount.0 00000100:00080000:3.0:1789402522.979282:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789402522.979285:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789402522.979289:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789402522.980791:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980807:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980814:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980822:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980850:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789402522.980856:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980879:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980885:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980891:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980908:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789402522.980915:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980922:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980930:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980937:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980944:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789402522.980949:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980956:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980971:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980977:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402522.980983:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789402522.980986:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789402522.981011:0:13025:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789402522.981025:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789402522.981030:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789402522.981036:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789402522.981042:0:13025:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93c6eec19000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789402522.981047:0:13025:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93c6ffa25000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789402522.981053:0:13025:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff93c6c99919c0) has exports, disconnecting them 00000020:00080000:3.0:1789402522.981057:0:13025:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93c6eec19000), last request at 1789402522 00000020:00000080:3.0:1789402522.981064:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7a9f 00000100:00080000:3.0:1789402522.981085:0:13025:0:(import.c:65:import_set_state_nolock()) ffff93c6eec1b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789402522.981125:0:13025:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c6eec19000): rc 0 00000020:00000080:3.0:1789402522.981128:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6eec19000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789402522.981148:0:13025:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93c6ffa25000), last request at 1789402522 00000020:00000080:3.0:1789402522.981151:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f79d4 00000100:00080000:3.0:1789402522.981157:0:13025:0:(import.c:65:import_set_state_nolock()) ffff93c6ffa20800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789402522.981163:0:13025:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c6ffa25000): rc 0 00000020:00000080:3.0:1789402522.981165:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6ffa25000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1789402522.981174:0:13025:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f6202d03ae0 00000100:00080000:3.0:1789402522.981192:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789402522.981200:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1789402522.981212:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789402522.981288:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789402522.981308:0:13025:0:(import.c:65:import_set_state_nolock()) ffff93c6d16c6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789402522.981322:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789402522.981324:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1789402522.981332:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:0.0:1789402522.981857:0:12573:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6eec19000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789402522.981902:0:12573:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ffa25000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789402522.981925:0:12573:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6eec1b000 for lustre-MDT0000 00000020:00000080:0.0:1789402522.981930:0:12573:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ffa20800 for lustre-MDT0000 00000100:00100000:0.0:1789402522.981949:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224422784:0@lo:9:umount.0 00000100:00100000:0.0:1789402522.982008:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402522.982069:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224422784 00000100:00100000:0.0:1789402522.982077:0:8217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224422784 00000100:00100000:0.0:1789402522.982121:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789402522.982130:0:8217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff67d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876324224422784:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789402522.982151:0:8217:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7a21 00000100:00080000:0.0:1789402522.982159:0:8217:0:(import.c:65:import_set_state_nolock()) ffff93c6fc621000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789402522.982184:0:8217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:3.0:1789402522.982616:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789402522.982634:0:13025:0:(import.c:65:import_set_state_nolock()) ffff93c6ff6b3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789402522.982672:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93c6c99919c0) has no exports 00000100:00100000:0.0:1789402522.982909:0:8217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff67d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3312:x1876324224422784:12345-0@lo:9:umount.0 Request processed in 778us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402522.982918:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789402522.982946:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224422912:0@lo:9:umount.0 00000100:00100000:0.0:1789402522.982985:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789402522.983039:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6d16c6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789402522.983051:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789402522.983053:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789402522.983056:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224422784:0@lo:9:umount.0 00010000:00010000:1.0:1789402522.983242:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789402522.983250:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983260:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c0031400 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:1.0:1789402522.983264:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983274:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402522.983282:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402522.983287:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789402522.983290:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1789402522.983293:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1789402522.983319:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983326:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789402522.983360:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983368:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c0031400/0x9403f4af875f7bb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7bb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983393:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789402522.983407:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983413:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6cb83e400 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:1.0:1789402522.983416:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983422:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402522.983428:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402522.983433:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789402522.983435:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789402522.983437:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789402522.983451:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983457:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789402522.983469:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983475:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6cb83e400/0x9403f4af875f7ad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7ade expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983488:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789402522.983491:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983503:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfa00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:1.0:1789402522.983505:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983512:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402522.983517:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402522.983521:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789402522.983523:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789402522.983525:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789402522.983537:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983544:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789402522.983550:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983557:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dfa00/0x9403f4af875f7dcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7dd2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983566:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402522.983569:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983575:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c1507a00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:1.0:1789402522.983578:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983591:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402522.983598:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402522.983604:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789402522.983618:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789402522.983620:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789402522.983633:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983640:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789402522.983646:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983653:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1507a00/0x9403f4af875f788b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7892 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983667:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402522.983669:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402522.983671:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402522.983682:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224423040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789402522.983719:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402522.983752:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789402522.983758:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224423424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789402522.983780:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402522.983806:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224423040 00000100:00100000:1.0:1789402522.983811:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224423040 00000100:00100000:1.0:1789402522.983851:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224423424 00000100:00100000:1.0:1789402522.983854:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224423424 00000100:00100000:1.0:1789402522.983876:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789402522.983883:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+19:3314:x1876324224423040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789402522.983895:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402522.983907:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c0031800/0x9403f4af875f7bb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7bb0 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.983921:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402522.983947:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+18:3314:x1876324224423040:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402522.983954:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789402522.983968:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789402522.983974:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+17:3314:x1876324224423424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789402522.983981:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402522.983989:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83f600/0x9403f4af875f7892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f788b expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402522.984001:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789402522.984034:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3314:x1876324224423424:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402522.984040:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789402522.984064:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224423424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789402522.984072:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8612d911-d8bf-490d-b22c-35e85a3b4473:3314:1876324224423040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402522.984282:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402522.984599:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224423168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402522.984644:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402522.984674:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789402522.984680:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224423296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402522.984698:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402522.984721:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224423168 00000100:00100000:0.0:1789402522.984725:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224423168 00000100:00100000:0.0:1789402522.984748:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224423296 00000100:00100000:0.0:1789402522.984751:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224423296 00000100:00100000:0.0:1789402522.984764:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789402522.984770:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+17:3315:x1876324224423168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789402522.984778:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402522.984788:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215f800/0x9403f4af875f7ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7ad7 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402522.984800:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402522.984825:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+16:3315:x1876324224423168:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402522.984831:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789402522.984842:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789402522.984848:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+15:3315:x1876324224423296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789402522.984855:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402522.984872:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a82800/0x9403f4af875f7dd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7dcb expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402522.984880:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402522.984901:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8612d911-d8bf-490d-b22c-35e85a3b4473+14:3315:x1876324224423296:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402522.984907:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789402522.985198:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224423296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789402522.985207:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8612d911-d8bf-490d-b22c-35e85a3b4473:3315:1876324224423168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789402522.985322:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224422912 00000100:00100000:3.0:1789402522.985327:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224422912 00000100:00100000:3.0:1789402522.985510:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789402522.985519:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876324224422912:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789402522.985541:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7b16 00000100:00080000:3.0:1789402522.985551:0:6691:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd61000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789402522.985579:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:2.0:1789402522.985765:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402522.986092:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3312:x1876324224422912:12345-0@lo:9:umount.0 Request processed in 574us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402522.986100:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789402522.986136:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6ff6b3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789402522.986148:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789402522.986150:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789402522.986154:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224422912:0@lo:9:umount.0 00000020:00080000:0.0:1789402522.995954:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93c6c99919c0) has no exports 00000020:00000080:0.0:1789402523.046044:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f78e6 00000020:00000080:0.0:1789402523.046060:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6e06f0000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789402523.046121:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789402523.046211:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789402523.046222:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789402523.046226:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff93c6e33419c0) has no exports 00000020:00000080:1.0:1789402523.046847:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f78df 00000020:00000080:1.0:1789402523.046854:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fc620000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789402523.046903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6e06f0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789402523.046986:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fc620000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789402523.047052:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789402523.047061:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789402523.047064:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6dd9c6800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789402523.047066:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6dd9c6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789402523.047073:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1789402523.047208:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c6e319d360 - data ffff93c6ffca4000/ffff93c6fb389800 00000020:01000000:1.0:1789402523.047551:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c6ea907ba0 - data ffff93c6f2238a20/ffff93c6fc17c800 00000001:00000004:1.0:1789402523.068435:0:13025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:2.0:1789402523.106483:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789402523.125808:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789402523.125816:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789402523.125838:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789402523.125841:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789402523.126179:0:6841:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789402523.126185:0:6841:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789402523.126194:0:6841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789402523.131232:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789402523.131240:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789402523.131261:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789402523.131264:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789402523.131660:0:8021:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789402523.131666:0:8021:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789402523.131677:0:8021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789402523.254462:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f78ae 00000020:00000080:0.0:1789402523.254475:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fb914800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789402523.254787:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb914800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789402523.256140:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f78c3 00000020:00000080:0.0:1789402523.256151:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fb910800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789402523.256172:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789402523.256178:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789402523.256185:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789402523.256190:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff93c6c9990000) has no exports 00000004:01000000:0.0:1789402523.256376:0:13025:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789402523.256386:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7b01 00000020:00000080:0.0:1789402523.256391:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6ddd7b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789402523.256395:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789402523.256398:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789402523.256404:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789402523.256406:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff93c6fb33b380) has no exports 00000020:00000080:0.0:1789402523.256413:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7afa 00000020:00000080:0.0:1789402523.256416:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6ff6b2000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789402523.256632:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb910800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789402523.256645:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ddd7b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789402523.256653:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ff6b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789402523.256758:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789402523.256767:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789402523.256772:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789402523.256778:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789402523.256780:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789402523.256823:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789402523.256831:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789402523.256836:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7a1a 00000020:00000080:0.0:1789402523.256841:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fa962800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789402523.256845:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789402523.256848:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789402523.256851:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789402523.256854:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff93c6d8b1cd40) has no exports 00000020:00000080:0.0:1789402523.256858:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7a13 00000020:00000080:0.0:1789402523.256861:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6de93d000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789402523.257196:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789402523.257200:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789402523.257202:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789402523.257206:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789402523.257208:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789402523.257236:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789402523.257242:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789402523.257274:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789402523.257279:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789402523.257283:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fa967800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789402523.257286:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fa967800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789402523.257292:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789402523.257526:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ff6b3000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789402523.257532:0:8:0:(genops.c:885:class_export_put()) final put ffff93c6ddd7f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789402523.257534:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ddd7f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789402523.257538:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789402523.257585:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fa962800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789402523.257590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6de93d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789402523.257594:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6d16c6800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789402523.257598:0:8:0:(genops.c:885:class_export_put()) final put ffff93c6fa964800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789402523.257600:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fa964800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789402523.257603:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789402523.261570:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f78ca 00000020:00000080:0.0:1789402523.261587:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fb915000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789402523.262305:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789402523.262316:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789402523.262325:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789402523.262329:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff93c6c9994d40) has no exports 00000020:00000080:0.0:1789402523.262911:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789402523.262919:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789402523.262925:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f78d1 00000020:00000080:0.0:1789402523.262934:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fb916800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789402523.266231:0:13025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6e31a1800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789402523.266240:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6e31a1800 3 00000020:01000004:0.0:1789402523.266244:0:13025:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c6e31a1800 from lustre-MDT0000 00000020:00000080:0.0:1789402523.266270:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789402523.266282:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789402523.266287:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fb917800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789402523.266290:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb917800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789402523.266299:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789402523.266366:0:13025:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789402523.266370:0:13025:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789402523.266374:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789402523.266377:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789402523.266381:0:13025:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789402523.266387:0:13025:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff93c6c99ad800 8612d911-d8bf-490d-b22c-35e85a3b4473 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789402523.266394:0:13025:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff93c6e3340000) has exports, disconnecting them 00000020:00080000:0.0:1789402523.266399:0:13025:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93c6c99ad800), last request at 1789402290 00000020:00000080:0.0:1789402523.266412:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f786f 00000020:00010000:0.0:1789402523.266417:0:13025:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93c6c99ad800: total 2 00000100:00080000:0.0:1789402523.266421:0:13025:0:(import.c:65:import_set_state_nolock()) ffff93c6c99a9000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789402523.266435:0:13025:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c6c99ad800): rc 0 00000020:00080000:0.0:1789402523.266439:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff93c6e3340000) has no exports 00000100:00100000:0.0:1789402523.266539:0:5838:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff93c6da9e6200:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1789402523.266617:0:5836:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff93c6da9e7c00:5836] 0 exiting: rc = 1 00000020:00010000:1.0:1789402523.266714:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93c6c99ad800: total 2 00010000:00010000:1.0:1789402523.266748:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c6c99ad800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789402523.266775:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83f200/0x9403f4af875f7db6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7daf expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402523.266790:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215ea00/0x9403f4af875f7b9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7b94 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402523.266805:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c1506a00/0x9403f4af875f7987 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7980 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402523.266819:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6ef3dfe00/0x9403f4af875f7bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7bbe expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402523.266829:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6cb83fe00/0x9403f4af875f7dc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7dbd expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402523.266841:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f7b71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7b6a expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402523.266861:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c0030e00/0x9403f4af875f7b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7b78 expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402523.266873:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c70215e000/0x9403f4af875f7b8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9403f4af875f7b86 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402523.266882:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c6c99ad800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789402523.266892:0:5832:0:(genops.c:885:class_export_put()) final put ffff93c6c99ad800/8612d911-d8bf-490d-b22c-35e85a3b4473 00010000:00010000:1.0:1789402523.266908:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402523.266910:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402523.266912:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402523.269460:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff93c6e0a20000:5839] 2 exiting: rc = 0 00000100:00100000:1.0:1789402523.269636:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269645:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269651:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269657:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269664:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269670:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269678:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269683:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269689:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269695:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269701:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269707:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269713:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269720:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269727:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269732:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269738:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269743:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269750:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269756:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269777:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269782:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269788:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269794:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269799:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269804:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269810:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269815:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269821:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269827:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269833:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269839:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269845:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269850:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269856:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269861:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269867:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269872:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269877:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269883:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269889:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269894:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269900:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269906:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269912:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269918:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269923:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269929:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269934:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269939:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269944:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269949:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269954:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269959:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269964:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269979:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269984:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269990:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.269995:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.270001:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.270007:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.270022:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.270236:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.270245:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789402523.270658:0:13025:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789402523.270661:0:13025:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:2.0:1789402523.272443:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb915000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789402523.272454:0:8:0:(genops.c:885:class_export_put()) final put ffff93c6fb917000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789402523.272457:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb917000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789402523.272464:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1789402523.272747:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb916800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789402523.272752:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6c99ad800/8612d911-d8bf-490d-b22c-35e85a3b4473 for MGS 00000020:00000080:2.0:1789402523.280543:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6c99a9000 for MGS 00000020:01000000:1.0:1789402523.284525:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c6e319d6c0 - data ffff93c6f20ebd80/ffff93c6fb388400 00000020:01000000:1.0:1789402523.284655:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c6f1ef7600 - data ffff93c6c377d360/ffff93c6f8f4e000 00000020:00000080:0.0:1789402523.286480:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7853 00000020:00000080:0.0:1789402523.286490:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6d16c0800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789402523.286511:0:13025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6e31a1800 from MGS, refs=2 00000020:01000004:0.0:1789402523.286525:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6e31a1800 2 00000020:01000004:0.0:1789402523.286529:0:13025:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c6e31a1800 from MGS 00000020:00000080:0.0:1789402523.286551:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789402523.286559:0:13025:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789402523.286562:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6d8aa0800/MGS 00000020:00000080:0.0:1789402523.286565:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6d8aa0800/MGS for MGS 00000020:01000000:0.0:1789402523.286582:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789402523.286636:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789402523.286641:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789402523.286646:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789402523.286653:0:13025:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93c6fb1ee800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789402523.286659:0:13025:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff93c6c9904d40) has exports, disconnecting them 00000020:00080000:0.0:1789402523.286663:0:13025:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93c6fb1ee800), last request at 1789402291 00000020:00000080:0.0:1789402523.286667:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f791e 00000020:00080000:0.0:1789402523.286680:0:13025:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c6fb1ee800): rc 0 00000020:00000080:0.0:1789402523.286684:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fb1ee800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789402523.286989:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6d16c0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789402523.287002:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb1ee800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789402523.287432:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789402523.287437:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789402523.287440:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789402523.287445:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789402523.287497:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6fb1eb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789402523.287642:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789402523.287648:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789402523.287652:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6fb1ee000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789402523.287655:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb1ee000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789402523.287660:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789402523.287702:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6e31a1800 1 00000020:00000080:0.0:1789402523.287706:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7845 00000020:00000080:0.0:1789402523.287711:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6d8aa1800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789402523.289077:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789402523.289090:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789402523.289097:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789402523.289112:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff93c6f1f419c0) has no exports 00000020:00000080:2.0:1789402523.289807:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6d8aa1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789402523.363369:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789402523.363387:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789402523.363393:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6f8f97800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789402523.363399:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6f8f97800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789402523.363407:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789402523.363553:0:13025:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c6e31a2800 00000020:01000000:1.0:1789402523.363572:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789402523.363576:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789402523.363580:0:13025:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789402523.363584:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff93c6c9993380) has no exports 00000100:00100000:1.0:1789402523.363657:0:5845:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff93c6f8f04800:5845] 1 exiting: rc = 0 00000100:00100000:3.0:1789402523.366035:0:5846:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff93c6da9e4400:5846] 2 exiting: rc = 0 00000100:00100000:0.0:1789402523.368695:0:6712:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff93c6ff8ce200:6712] 3 exiting: rc = 0 00000100:00100000:1.0:1789402523.369674:0:5844:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff93c6f8f05200:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1789402523.369751:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369759:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369765:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369771:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369779:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369784:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369790:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369797:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369813:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369819:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369824:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369830:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369835:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369840:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369845:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369851:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369858:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369863:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369868:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369875:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369880:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369886:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369890:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369895:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369900:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369904:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369909:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369914:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369919:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369924:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369929:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369935:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369940:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369945:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369950:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369955:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369960:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369964:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369970:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369974:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369979:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369985:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.369990:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370001:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370006:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370022:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370028:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370034:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370039:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370044:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370050:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370055:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370060:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370066:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370072:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370078:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370083:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370089:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370094:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370099:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370104:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370109:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370114:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.370120:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.378646:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93c6c997de00:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1789402523.378822:0:12528:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff93c5c367de00:12528] 2 exiting: rc = 0 00000100:00100000:2.0:1789402523.378904:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93c6c997c000:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1789402523.379878:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379887:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379895:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379900:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379906:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379910:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379916:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379922:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379927:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379933:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379939:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379945:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379951:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379970:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379975:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379981:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379986:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379991:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.379996:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380000:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380005:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380021:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380028:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380033:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380038:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380044:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380049:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380054:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380059:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380065:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380070:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380075:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380080:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380085:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380089:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380095:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380100:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380105:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380111:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380116:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380122:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380127:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380133:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380138:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380143:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380148:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380154:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380159:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380172:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380177:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380182:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380186:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380192:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380197:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380202:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380207:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380212:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380217:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380223:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380229:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380234:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380240:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380245:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.380251:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.381147:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff93c6c9960e00:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789402523.381270:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff93c6c98ec200:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1789402523.381840:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381848:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381855:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381862:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381878:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381884:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381892:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381900:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381906:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381912:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381920:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381927:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381934:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381940:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381964:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381972:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381977:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381984:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381993:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.381999:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382005:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382020:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382027:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382033:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382038:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382045:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382066:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382076:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382082:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382087:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382094:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382101:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382107:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382114:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382120:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382125:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382130:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382137:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382157:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382170:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382177:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382182:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382188:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382193:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382199:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382205:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382212:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382218:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382225:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382233:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382254:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382263:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382269:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382275:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382283:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382290:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382297:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382303:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382837:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382843:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382850:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382856:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382862:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.382868:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430066:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93c6c98ed400:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1789402523.430192:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93c6c997c200:5852] 1 exiting: rc = 0 00000100:00100000:2.0:1789402523.430286:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430293:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430299:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430304:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430322:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430328:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430333:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430337:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430366:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430385:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430390:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430396:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430400:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430406:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430412:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430418:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430423:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430428:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430434:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430439:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430444:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430450:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430458:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430464:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430470:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430477:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430482:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430489:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430497:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430503:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430512:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430517:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430528:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430745:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430751:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430757:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430761:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430766:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430771:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430776:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430781:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430786:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430791:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430796:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430810:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430815:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430820:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430825:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430830:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430836:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430841:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430846:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430851:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430856:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430861:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430867:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430871:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430877:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430883:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430889:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430894:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430900:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430905:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.430911:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.435192:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93c6c98ed000:5854] 1 exiting: rc = 0 00000100:00100000:2.0:1789402523.439833:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93c6c997d400:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1789402523.440062:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440069:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440075:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440081:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440087:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440093:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440098:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440103:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440107:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440112:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440117:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440122:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440127:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440133:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440138:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440144:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440168:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440173:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440178:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440183:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440188:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440193:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440198:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440202:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440207:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440211:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440216:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440220:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440225:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440230:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440235:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440240:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440244:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440248:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440253:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440258:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440262:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440267:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440272:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440277:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440282:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440287:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440292:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440298:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440302:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440306:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440311:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440316:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440321:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440325:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440329:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440468:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440475:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440480:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440485:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440490:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440495:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440499:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440504:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440508:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440512:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440516:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440520:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.440525:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402523.441269:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff93c6c997c800:5855] 0 exiting: rc = 1 00000100:00100000:2.0:1789402523.442475:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff93c6c997d200:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1789402523.442697:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442704:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442709:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442714:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442719:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442724:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442729:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442734:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442740:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442745:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442751:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442755:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442761:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442765:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442770:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442775:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442780:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442785:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442789:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442794:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442799:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442804:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442819:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442824:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442829:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442834:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442839:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442844:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442848:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442853:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442858:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442864:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442869:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442874:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442879:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442884:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442888:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442893:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442898:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442903:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442908:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442912:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442917:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442922:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442926:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442931:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442936:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442940:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442945:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442949:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442954:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442958:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442963:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442967:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442972:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442976:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442980:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442990:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.442995:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.443000:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.443005:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.443009:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.443023:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.443028:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.443861:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff93c6c997dc00:5859] 2 exiting: rc = 0 00000100:00100000:2.0:1789402523.444115:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff93c6c997d800:5857] 0 exiting: rc = 1 00000100:00100000:3.0:1789402523.444367:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff93c6c997c400:5858] 1 exiting: rc = 0 00000100:00100000:1.0:1789402523.444738:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444746:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444752:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444757:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444763:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444769:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444775:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444780:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444785:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444791:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444796:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444801:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444806:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444811:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444816:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444821:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444827:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444832:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444837:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444841:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444846:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444852:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444869:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444875:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444880:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444885:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444889:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444906:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444911:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444917:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444923:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444929:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444935:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444940:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444945:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444949:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444955:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444961:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444968:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444974:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444979:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444984:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444989:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444994:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.444999:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445005:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445034:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445041:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445046:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445052:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445057:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445062:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445068:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445073:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445079:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445084:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445088:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445094:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445100:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445105:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445111:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445116:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445131:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789402523.445137:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789402523.457978:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789402523.457993:0:13025:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789402523.457999:0:13025:0:(genops.c:885:class_export_put()) final put ffff93c6e2543000/MDS_uuid 00000020:00000080:1.0:1789402523.458003:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6e2543000/MDS_uuid for MDS 00000020:01000000:1.0:1789402523.458009:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789402523.458156:0:13025:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:0.0:1789402523.943102:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789402523.943110:0:6714:0:(genops.c:885:class_export_put()) final put ffff93c6fa966800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789402523.943133:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fa966800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789402523.943171:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6fc621000 for lustre-OST0000 00010000:00010000:3.0:1789402524.136861:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402525.158401:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402526.179641:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789402526.317152:0:13175:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789402526.335764:0:13175:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789402526.335811:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402526.335826:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402526.335834:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402526.335841:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402526.335897:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789402526.335903:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789402526.335925:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789402526.335929:0:13175:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789402526.335935:0:13175:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789402526.335956:0:13175:0:(import.c:65:import_set_state_nolock()) ffff93c6e0b14000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789402526.336023:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876324224423552:0@lo:39:umount.0 00000400:00000100:3.0:1789402526.336085:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876324224423552 offset 0 length 224: 4 00010000:00010000:2.0:1789402526.336173:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402526.336181:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402526.336189:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82c00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402526.336193:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402526.336201:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402526.336214:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402526.336219:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789402526.336222:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789402526.336234:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789402526.336258:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402526.336264:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789402526.336309:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789402526.336331:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402526.336338:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82c00/0x9403f4af875f7b86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9403f4af875f7b8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402526.336377:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402526.336378:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402526.336380:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402526.338340:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224423680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402526.338428:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402526.338647:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224423680 00000100:00100000:2.0:1789402526.338656:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224423680 00000100:00100000:2.0:1789402526.338703:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789402526.338710:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3313:x1876324224423680:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789402526.338717:0:5831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789402526 with bad export cookie 10665637377271101551 00000100:00100000:3.0:1789402526.352705:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3313:x1876324224423680:12345-0@lo:103:ldlm_bl.0 Request processed in 13987us (14270us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789402526.352719:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789402526.354841:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.108@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789402526.354848:0:3313:0:(import.c:65:import_set_state_nolock()) ffff93c6e31a4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789402526.354854:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789402526.363022:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.108@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789402526.363027:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789402526.363038:0:3313:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c6da91f800 x1876324224423680/t0(0) o103->MGC192.168.203.108@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789402542 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789402526.363051:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789402526.363054:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789402526.363055:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789402526.363060:0:3313:0:(import.c:65:import_set_state_nolock()) ffff93c6e31a4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789402526.363065:0:3313:0:(import.c:545:import_select_connection()) MGC192.168.203.108@tcp: connect to NID 0@lo last attempt 195 00000100:00080000:0.0:1789402526.363080:0:3313:0:(import.c:666:import_select_connection()) MGC192.168.203.108@tcp: import ffff93c6e31a4800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402526.363113:0:3313:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6e622d880 x1876324224423808/t0(0) o250->MGC192.168.203.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789402526.363192:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8612d911-d8bf-490d-b22c-35e85a3b4473:3312:1876324224423808:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789402526.363241:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876324224423808 offset 0 length 520: 4 00000100:00100000:0.0:1789402526.363308:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8612d911-d8bf-490d-b22c-35e85a3b4473:3313:1876324224423680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789402527.202581:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789402527.461050:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789402527.461057:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789402527.461213:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789402527.461231:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224423936:0@lo:400:kworker.0 00000400:00000100:1.0:1789402527.461277:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876324224423936 offset 0 length 224: 4 00000001:00100000:2.0:1789402527.484874:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789402527.484883:0:7645:0:(genops.c:885:class_export_put()) final put ffff93c6ddd67000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789402527.484954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ddd67000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789402527.485007:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ddd61000 for lustre-OST0001 00010000:00010000:2.0:1789402528.226486:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402529.250730:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402530.274634:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402531.298730:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789402531.492653:0:12573:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789402531.492671:0:12573:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789402531.492829:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224424064:0@lo:400:kworker.0 00000400:00000100:1.0:1789402531.492905:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876324224424064 offset 0 length 224: 4 00010000:00010000:2.0:1789402532.323045:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402533.346714:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402534.370535:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402535.394744:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402536.420266:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789402536.674499:0:12573:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789402536.674514:0:12573:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789402536.676290:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224424192:0@lo:400:kworker.0 00000400:00000100:1.0:1789402536.676411:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876324224424192 offset 0 length 224: 4 00000100:00100000:3.0:1789402536.678203:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789402526/real 1789402526] req@ffff93c6e622d880 x1876324224423808/t0(0) o250->MGC192.168.203.108@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789402536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402536.678242:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c6e622d880 x1876324224423808/t0(0) o250->MGC192.168.203.108@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789402536 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402536.678255:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789402526/real 1789402526] req@ffff93c6fb1f8a80 x1876324224423552/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789402536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402536.678267:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c6fb1f8a80 x1876324224423552/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789402536 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789402536.678288:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6e31a4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789402536.683668:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789402536.683686:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8612d911-d8bf-490d-b22c-35e85a3b4473:3312:1876324224423808:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1789402536.683703:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6e0b14000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789402536.683723:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876324224423552:0@lo:39:umount.0 00000100:00080000:0.0:1789402536.683938:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789402536.683944:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789402536.683948:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c6e31a4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789402536.683955:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.108@tcp: connect to NID 0@lo last attempt 431 00000100:00080000:0.0:1789402536.683961:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.108@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789402536.683978:0:8:0:(import.c:666:import_select_connection()) MGC192.168.203.108@tcp: import ffff93c6e31a4800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402536.684027:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6e622c380 x1876324224424320/t0(0) o250->MGC192.168.203.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789402536.684172:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789402536.684179:0:13175:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789402536.684186:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789402536.685146:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402536.685165:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402536.685173:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402536.685181:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402536.685210:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402536.685219:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402536.685225:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402536.685251:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402536.685257:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402536.685278:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789402536.685284:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789402536.685318:0:13175:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1789402536.685652:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789402536.685663:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402536.685671:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c0030000 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402536.685676:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402536.685686:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402536.685694:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402536.685700:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789402536.685702:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789402536.685705:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789402536.685731:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c6e31a4800 00010000:00010000:0.0:1789402536.685736:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402536.685744:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c0030000/0x9403f4af875f7b94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7b9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402536.685763:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402536.685767:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402536.685773:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df000 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402536.685776:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402536.685783:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402536.685790:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402536.685795:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789402536.685797:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789402536.685799:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789402536.685804:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c6e31a4800 00010000:00010000:0.0:1789402536.685807:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402536.685815:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f7dbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402536.685837:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402536.685839:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402536.685841:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402536.685878:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789402536.686028:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789402536.686036:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789402536.686045:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789402536.686052:0:13175:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93c6c9903380) has no exports 00000020:00080000:2.0:1789402536.686089:0:13175:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93c6c9903380) has no exports 00000100:00100000:3.0:1789402536.686579:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8612d911-d8bf-490d-b22c-35e85a3b4473:3312:1876324224424320:0@lo:250:kworker.0 00000400:00000100:3.0:1789402536.686657:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876324224424320 offset 0 length 520: 4 00000020:01000000:3.0:1789402536.699807:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c6e0a9c3c0 - data ffff93c6ffdb1bd0/ffff93c700558800 00000020:01000000:3.0:1789402536.700047:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c6c9adf540 - data ffff93c6f2238d80/ffff93c6ff7e6c00 00100000:10000000:1.0:1789402536.710935:0:13175:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789402536.735158:0:13175:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f79a3 00000020:00000080:2.0:1789402536.735172:0:13175:0:(genops.c:885:class_export_put()) final put ffff93c700376800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789402536.735197:0:13175:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6e61ce000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789402536.735202:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6e61ce000 2 00000020:01000004:2.0:1789402536.735205:0:13175:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c6e61ce000 from lustre-OST0000 00000020:00000080:2.0:1789402536.735238:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789402536.735251:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789402536.735254:0:13175:0:(genops.c:885:class_export_put()) final put ffff93c700372800/lustre-OST0000_UUID 00000020:00000080:2.0:1789402536.735258:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff93c700372800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789402536.735269:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789402536.735326:0:13175:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789402536.735332:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789402536.735337:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789402536.735384:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789402536.735393:0:13175:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93c6fb1eb000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789402536.735401:0:13175:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff93c6f1f43380) has exports, disconnecting them 00000020:00080000:2.0:1789402536.735423:0:13175:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93c6fb1eb000), last request at 1789402310 00000020:00000080:2.0:1789402536.735428:0:13175:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f79cd 00000020:00080000:2.0:1789402536.735450:0:13175:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c6fb1eb000): rc 0 00000020:00000080:2.0:1789402536.735455:0:13175:0:(genops.c:885:class_export_put()) final put ffff93c6fb1eb000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789402536.737561:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c700376800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789402536.737585:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb1eb000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789402536.738571:0:13175:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789402536.738580:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789402536.738586:0:13175:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789402536.738594:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789402536.738843:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789402536.738854:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1789402536.738864:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6e61ce000 1 00000020:00000080:3.0:1789402536.738872:0:13175:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f795d 00000020:00000080:3.0:1789402536.738885:0:13175:0:(genops.c:885:class_export_put()) final put ffff93c6fb1ef800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789402536.738892:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789402536.738903:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789402536.738907:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789402536.738924:0:13175:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff93c6f1f44d40) has no exports 00000020:00000080:0.0:1789402536.739019:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6e0b14000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789402536.739029:0:8:0:(genops.c:885:class_export_put()) final put ffff93c6ff7f6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789402536.739031:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ff7f6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789402536.739042:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789402536.739144:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb1ef800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789402536.758818:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789402536.758843:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789402536.758851:0:13175:0:(genops.c:885:class_export_put()) final put ffff93c6e61c9000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789402536.758857:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6e61c9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789402536.758871:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789402536.759047:0:13175:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c6e61cb000 00000020:02000400:0.0:1789402536.759107:0:13175:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789402537.445242:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402538.469794:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402539.491598:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789402539.514519:0:13329:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789402539.529745:0:13329:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789402539.529819:0:13329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402539.529834:0:13329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402539.529841:0:13329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402539.529847:0:13329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402539.529874:0:13329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789402539.529879:0:13329:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789402539.529908:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1789402539.529911:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1789402539.529916:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402539.529923:0:13329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c6da91ce00 x1876324224423936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402543 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789402539.529924:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c70215fa00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402539.529927:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402539.529936:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402539.529943:0:13329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c6da91f800 x1876324224424064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402547 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:0.0:1789402539.529952:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402539.529953:0:13329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c6da91d880 x1876324224424192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402552 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789402539.529958:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789402539.529961:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789402539.529963:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1789402539.529971:0:13329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1789402539.529975:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c6e31a4800 00000100:00080000:1.0:1789402539.529978:0:13329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1789402539.529979:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402539.529985:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c70215fa00/0x9403f4af875f7b6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7b71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402539.529994:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402539.529996:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402539.529998:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789402539.530000:0:13329:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789402539.530106:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876324224424448:0@lo:39:umount.0 00000400:00000100:0.0:1789402539.530155:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876324224424448 offset 0 length 224: 4 00000100:00100000:3.0:1789402539.530680:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224424192:0@lo:400:kworker.0 00000100:00100000:2.0:1789402539.533122:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224424064:0@lo:400:kworker.0 00000100:00100000:2.0:1789402539.533136:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224423936:0@lo:400:kworker.0 00010000:00010000:3.0:1789402540.514932:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402541.540585:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789402541.794665:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789402541.794675:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789402542.562608:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402543.587706:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402544.610552:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402545.634669:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402546.658452:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789402546.914719:0:12573:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789402546.914731:0:12573:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789402547.683463:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402548.707677:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402549.730591:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789402539/real 1789402539] req@ffff93c6fb1f9f80 x1876324224424448/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789402549 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789402549.730600:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402549.730621:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c6fb1f9f80 x1876324224424448/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789402549 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789402549.730639:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789402549.730659:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876324224424448:0@lo:39:umount.0 00000100:00080000:1.0:1789402549.730705:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789402549.730710:0:13329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789402549.730714:0:13329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789402549.731682:0:13329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402549.731698:0:13329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402549.731705:0:13329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402549.731712:0:13329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402549.731735:0:13329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402549.731741:0:13329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402549.731748:0:13329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402549.731754:0:13329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402549.731760:0:13329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402549.731789:0:13329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789402549.731794:0:13329:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789402549.731821:0:13329:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789402549.731826:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789402549.731830:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789402549.731835:0:13329:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789402549.731839:0:13329:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93c6d8b1b380) has no exports 00000020:00080000:1.0:1789402549.731861:0:13329:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93c6d8b1b380) has no exports 00000020:01000000:1.0:1789402549.733641:0:13329:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c6e0a9c240 - data ffff93c6ffdb1870/ffff93c7003c9c00 00000020:01000000:1.0:1789402549.733794:0:13329:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c6c97063c0 - data ffff93c6c36fe0d8/ffff93c6fb336800 00010000:00010000:0.0:1789402549.733869:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789402549.733879:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402549.733889:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c70215f600 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402549.733903:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402549.733913:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402549.733920:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402549.733927:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789402549.733929:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789402549.733932:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789402549.733944:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c6e31a4800 00010000:00010000:0.0:1789402549.733948:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402549.733955:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c70215f600/0x9403f4af875f7b78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7b7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402549.733967:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402549.733971:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402549.733977:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82a00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:0.0:1789402549.733980:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402549.733987:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789402549.733993:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402549.734010:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789402549.734012:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789402549.734014:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789402549.734020:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c6e31a4800 00010000:00010000:0.0:1789402549.734023:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402549.734029:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82a00/0x9403f4af875f7daf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402549.734042:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402549.734043:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402549.734045:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402549.734328:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789402549.744995:0:13329:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789402549.766832:0:13329:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7a6e 00000020:00000080:1.0:1789402549.766841:0:13329:0:(genops.c:885:class_export_put()) final put ffff93c6ff7f2800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789402549.766858:0:13329:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6ff7f4000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789402549.766862:0:13329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6ff7f4000 2 00000020:01000004:1.0:1789402549.766865:0:13329:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c6ff7f4000 from lustre-OST0001 00000020:00000080:1.0:1789402549.766888:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789402549.766898:0:13329:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789402549.766901:0:13329:0:(genops.c:885:class_export_put()) final put ffff93c6e0ae2000/lustre-OST0001_UUID 00000020:00000080:1.0:1789402549.766904:0:13329:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6e0ae2000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789402549.766911:0:13329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1789402549.766982:0:12573:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ff7f2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1789402549.767288:0:13329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8612d911-d8bf-490d-b22c-35e85a3b4473->MGS 00010000:00010000:1.0:1789402549.767306:0:13329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7987 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402549.767319:0:13329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7987 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402549.767325:0:13329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789402549.767784:0:13329:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789402549.767788:0:13329:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789402549.767801:0:13329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c6e31a4800 00010000:00010000:1.0:1789402549.767806:0:13329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c70215f000/0x9403f4af875f7980 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7987 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402549.767834:0:13329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9403f4af875f7bc5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789402549.767841:0:13329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9403f4af875f7bc5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402549.767847:0:13329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789402549.767849:0:13329:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789402549.767850:0:13329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789402549.767860:0:13329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c6e31a4800 00010000:00010000:1.0:1789402549.767863:0:13329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c1506800/0x9403f4af875f7bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9403f4af875f7bc5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789402549.767878:0:13329:0:(import.c:65:import_set_state_nolock()) ffff93c6e31a4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789402549.767882:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789402549.767884:0:13329:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789402549.767886:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789402549.767891:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789402549.767901:0:13329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c6e622c380 x1876324224424320/t0(0) o250->MGC192.168.203.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789402551 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789402549.767922:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789402549.767925:0:13329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1789402549.768292:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8612d911-d8bf-490d-b22c-35e85a3b4473:3312:1876324224424320:0@lo:250:kworker.0 10000000:01000000:1.0:1789402549.769639:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789402549.769652:0:13329:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7861 00000020:00000080:1.0:1789402549.769669:0:13329:0:(genops.c:885:class_export_put()) final put ffff93c6e2541000/8612d911-d8bf-490d-b22c-35e85a3b4473 00000020:01000000:1.0:1789402549.769687:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.108@tcp (flags='') 00000020:00000080:1.0:1789402549.769704:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789402549.769710:0:13329:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.108@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789402549.769715:0:13329:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff93c6c99019c0) has no exports 00000020:00000080:0.0:1789402549.770761:0:12573:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6e2541000/8612d911-d8bf-490d-b22c-35e85a3b4473 for MGC192.168.203.108@tcp 10000000:01000000:2.0:1789402549.771430:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789402549.771593:0:13329:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.108@tcp: client import never connected 00000100:00080000:1.0:1789402549.771598:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789402549.771601:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789402549.771604:0:13329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789402549.771606:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789402549.771658:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789402549.771674:0:13329:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.108@tcp (uuid 8612d911-d8bf-490d-b22c-35e85a3b4473) 00000020:01000000:1.0:1789402549.771680:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789402549.771686:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789402549.771694:0:13329:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789402549.771701:0:13329:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93c6ddd7a800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789402549.771706:0:13329:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff93c6fb33cd40) has exports, disconnecting them 00000020:00080000:1.0:1789402549.771711:0:13329:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93c6ddd7a800), last request at 1789402330 00000020:00000080:1.0:1789402549.771718:0:13329:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7a98 00000020:00080000:1.0:1789402549.771731:0:13329:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c6ddd7a800): rc 0 00000020:00000080:1.0:1789402549.771735:0:13329:0:(genops.c:885:class_export_put()) final put ffff93c6ddd7a800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789402549.771940:0:12573:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6e31a4800 for MGC192.168.203.108@tcp 00000020:00000080:0.0:1789402549.771947:0:12573:0:(genops.c:885:class_export_put()) final put ffff93c6e31a1000/8612d911-d8bf-490d-b22c-35e85a3b4473 00000020:00000080:0.0:1789402549.771950:0:12573:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6e31a1000/8612d911-d8bf-490d-b22c-35e85a3b4473 for MGC192.168.203.108@tcp 00000020:01000000:0.0:1789402549.771955:0:12573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.108@tcp (8612d911-d8bf-490d-b22c-35e85a3b4473) 00000020:00000080:0.0:1789402549.772929:0:12573:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ddd7a800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789402549.775470:0:13329:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789402549.775478:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789402549.775483:0:13329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789402549.775490:0:13329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789402549.775562:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789402549.775704:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:2.0:1789402549.775767:0:12573:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93c6ddd7e000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1789402549.775927:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93c6d2ffee00:5828] 1 exiting: rc = 0 00000100:00100000:2.0:1789402549.776018:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93c6da9e4000:5827] 0 exiting: rc = 1 00000100:00100000:0.0:1789402549.776106:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.776326:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93c6c82d2200:5829] 0 exiting: rc = 1 00000100:00100000:2.0:1789402549.776443:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93c6c82d3e00:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1789402549.778532:0:8454:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93c6da8bd800:8454] 3 exiting: rc = 0 00000100:00100000:2.0:1789402549.782513:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93c6c82d3c00:5831] 2 exiting: rc = 0 00000100:00100000:0.0:1789402549.782666:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782676:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782683:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782691:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782698:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782704:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782710:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782716:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782721:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782728:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782734:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782739:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782750:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782756:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782763:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782770:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782776:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782782:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782787:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782793:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782798:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782804:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782820:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782827:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782832:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782837:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782843:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782849:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782855:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782860:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782865:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782871:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782876:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782882:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782902:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782908:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782914:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782919:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782925:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782931:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782936:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782942:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782947:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782953:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782958:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782964:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782969:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782975:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782981:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782987:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782993:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.782998:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783004:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783010:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783016:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783022:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783028:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783034:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783040:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783046:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783052:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783059:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783064:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.783070:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789402549.783888:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789402549.783898:0:13329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789402549.783904:0:13329:0:(genops.c:885:class_export_put()) final put ffff93c6ff6b6800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789402549.783909:0:13329:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ff6b6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789402549.783915:0:13329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789402549.783962:0:13329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6ff7f4000 1 00000020:00000080:0.0:1789402549.783967:0:13329:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9403f4af875f7a3d 00000020:00000080:0.0:1789402549.783974:0:13329:0:(genops.c:885:class_export_put()) final put ffff93c6eec1e800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789402549.783995:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789402549.784000:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789402549.784004:0:13329:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789402549.784008:0:13329:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff93c6f1f40000) has no exports 00000020:00000080:2.0:1789402549.784069:0:12573:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6eec1e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789402549.807244:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789402549.807257:0:13329:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789402549.807263:0:13329:0:(genops.c:885:class_export_put()) final put ffff93c6ff7f2000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789402549.807267:0:13329:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6ff7f2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789402549.807287:0:13329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789402549.807487:0:13329:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c6ff7f3000 00000020:01000000:2.0:1789402549.807514:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789402549.807518:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789402549.807522:0:13329:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789402549.807525:0:13329:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff93c6e3344d40) has no exports 00000020:00000080:2.0:1789402549.807547:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789402549.807553:0:13329:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789402549.807556:0:13329:0:(genops.c:885:class_export_put()) final put ffff93c6fb1e9000/OSS_uuid 00000020:00000080:2.0:1789402549.807559:0:13329:0:(genops.c:844:class_export_destroy()) destroying export ffff93c6fb1e9000/OSS_uuid for OSS 00000020:01000000:2.0:1789402549.807566:0:13329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789402549.807594:0:5840:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789402549.807756:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff93c6eed63000:6690] 1 exiting: rc = 0 00000100:00100000:2.0:1789402549.807807:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff93c6eed63c00:6689] 0 exiting: rc = 1 00000100:00100000:2.0:1789402549.809514:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff93c6ef093200:6691] 2 exiting: rc = 0 00000100:00100000:0.0:1789402549.810771:0:8217:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff93c6fb326200:8217] 3 exiting: rc = 0 00000100:00100000:0.0:1789402549.810850:0:12073:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff93c6e3308e00:12073] 4 exiting: rc = 0 00000100:00100000:2.0:1789402549.811059:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811067:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811073:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811080:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811084:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811090:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811095:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811100:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811106:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811111:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811116:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811120:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811125:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811130:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811135:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811139:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811144:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811149:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811154:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811170:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811175:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811180:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811186:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811191:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811196:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811201:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811206:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811211:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811215:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811221:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811225:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811230:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811236:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811243:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811248:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811253:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811258:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811263:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811269:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811274:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811279:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811284:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811289:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811294:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811299:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811304:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811309:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811314:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811318:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811324:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811330:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811335:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811412:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811418:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811431:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811436:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811442:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811447:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811452:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811458:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811464:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811470:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811476:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.811486:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.812274:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93c6da8cb000:6693] 1 exiting: rc = 0 00000100:00100000:0.0:1789402549.813477:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93c6ef093800:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1789402549.813599:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813609:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813615:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813621:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813626:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813631:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813637:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813643:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813649:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813654:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813660:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813666:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813671:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813677:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813683:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813688:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813693:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813699:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813705:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813710:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813715:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813720:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813726:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813731:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813738:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813754:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813759:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813764:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813769:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813775:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813780:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813785:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813791:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813796:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813802:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813821:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813827:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813832:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813837:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813841:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813847:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813852:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813857:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813862:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813867:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813873:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813878:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813883:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813888:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813893:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813899:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813904:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813909:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813915:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813920:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813925:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813930:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813935:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813939:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813944:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813956:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813961:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813966:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.813971:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.815002:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93c6c31b1e00:6696] 2 exiting: rc = 0 00000100:00100000:2.0:1789402549.815547:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93c6ef093c00:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1789402549.819637:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93c6ef093000:6695] 1 exiting: rc = 0 00000100:00100000:0.0:1789402549.819742:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819750:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819757:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819763:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819769:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819774:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819780:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819785:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819791:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819798:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819820:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819827:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819832:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819838:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819844:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819849:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819854:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819860:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819866:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819871:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819876:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819893:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819899:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819904:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819910:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819915:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819921:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819926:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819931:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819936:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819942:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819947:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819952:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819958:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819975:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819981:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819987:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819992:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.819996:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820002:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820007:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820012:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820018:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820023:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820028:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820034:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820040:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820045:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820050:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820056:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820061:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820067:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820072:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820077:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820083:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820088:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820099:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820104:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820110:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820127:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820134:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820139:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820145:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.820151:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.827298:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93c6eed62e00:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1789402549.827510:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93c6eed63e00:6698] 1 exiting: rc = 0 00000100:00100000:0.0:1789402549.827566:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827575:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827581:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827587:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827592:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827598:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827604:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827609:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827615:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827620:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827626:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827632:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827638:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827643:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827648:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827653:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827659:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827664:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827669:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827674:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827678:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827683:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827689:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827694:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827700:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827705:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827722:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827727:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827732:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827737:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827743:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827748:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827753:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827758:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827763:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827769:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827774:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827779:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827784:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827789:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827795:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827800:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827805:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827820:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827826:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827832:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827838:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827843:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827849:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827855:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827861:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827866:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827871:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827878:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827883:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827888:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827893:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827898:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827903:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827908:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827913:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827925:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827930:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.827935:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789402549.828893:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93c6eed62c00:6699] 0 exiting: rc = 1 00000100:00100000:2.0:1789402549.828970:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93c6da8b7800:6700] 1 exiting: rc = 0 00000100:00100000:0.0:1789402549.829118:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829127:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829136:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829143:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829151:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829160:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829168:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829182:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829222:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829231:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829239:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829248:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829254:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829313:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829322:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829328:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829333:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829462:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829474:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829482:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829492:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829528:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829538:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829546:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829553:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829582:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829596:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829632:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829638:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829645:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829650:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829656:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829671:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829677:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829683:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829688:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829694:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829715:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829724:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829732:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829738:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829745:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829751:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829757:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829763:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829770:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829775:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829781:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829788:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829818:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829828:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829836:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829842:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829847:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829853:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829861:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829870:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829879:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829885:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829893:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829899:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829922:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829929:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789402549.829936:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789402549.855164:0:13329:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789402566.543903:0:13949:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789402574.815884:0:14409:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789402574.815888:0:14409:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789402574.816014:0:14409:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c6ffaae000 00000020:01000004:2.0:1789402574.816029:0:14409:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789402574.816037:0:14409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789402574.816050:0:14409:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93c6e3343380) 00000020:00000080:2.0:1789402574.816061:0:14409:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789402574.832759:0:14409:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789402574.835746:0:14409:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789402574.836104:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 379: rc = 0 00100000:10000000:3.0:1789402574.836494:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 379: rc = 0 00100000:10000000:3.0:1789402574.836806:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 379: rc = 0 00100000:10000000:3.0:1789402574.836904:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 379: rc = 0 00100000:10000000:3.0:1789402574.837092:0:14409:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789402574.837232:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 379: rc = 0 00100000:10000000:3.0:1789402574.837429:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 379: rc = 0 00100000:10000000:3.0:1789402574.837677:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 381: rc = 0 00100000:10000000:3.0:1789402574.839332:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 198: rc = 0 00100000:10000000:3.0:1789402574.839474:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 198: rc = 0 00100000:10000000:3.0:1789402574.839910:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 408: rc = 0 00100000:10000000:3.0:1789402574.840452:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 408: rc = 0 00100000:10000000:3.0:1789402574.840819:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 408: rc = 0 00100000:10000000:3.0:1789402574.841082:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 408: rc = 0 00100000:10000000:3.0:1789402574.841528:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 408: rc = 0 00100000:10000000:3.0:1789402574.841800:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 408: rc = 0 00100000:10000000:3.0:1789402574.842049:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 408: rc = 0 00100000:10000000:3.0:1789402574.842663:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 408: rc = 0 00100000:10000000:3.0:1789402574.842906:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 408: rc = 0 00100000:10000000:3.0:1789402574.843124:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 408: rc = 0 00100000:10000000:3.0:1789402574.843561:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 408: rc = 0 00100000:10000000:3.0:1789402574.843806:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 408: rc = 0 00100000:10000000:3.0:1789402574.844442:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 662: rc = 0 00100000:10000000:3.0:1789402574.844772:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 662: rc = 0 00100000:10000000:3.0:1789402574.844986:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 662: rc = 0 00100000:10000000:3.0:1789402574.846052:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 662: rc = 0 00100000:10000000:3.0:1789402574.846411:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 662: rc = 0 00100000:10000000:3.0:1789402574.847135:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 662: rc = 0 00100000:10000000:3.0:1789402574.847968:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 662: rc = 0 00100000:10000000:3.0:1789402574.848494:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 662: rc = 0 00100000:10000000:3.0:1789402574.848820:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 662: rc = 0 00100000:10000000:3.0:1789402574.849080:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 662: rc = 0 00100000:10000000:3.0:1789402574.850077:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 662: rc = 0 00100000:10000000:3.0:1789402574.850974:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 662: rc = 0 00100000:10000000:3.0:1789402574.851516:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 662: rc = 0 00100000:10000000:3.0:1789402574.851797:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 662: rc = 0 00100000:10000000:3.0:1789402574.852027:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 662: rc = 0 00100000:10000000:2.0:1789402574.852965:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 662: rc = 0 00100000:10000000:2.0:1789402574.853675:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 662: rc = 0 00100000:10000000:2.0:1789402574.854039:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 662: rc = 0 00100000:10000000:2.0:1789402574.856011:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 662: rc = 0 00100000:10000000:2.0:1789402574.857165:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 662: rc = 0 00100000:10000000:2.0:1789402574.857458:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 662: rc = 0 00100000:10000000:2.0:1789402574.857722:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 662: rc = 0 00100000:10000000:2.0:1789402574.858198:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 662: rc = 0 00100000:10000000:2.0:1789402574.858468:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 662: rc = 0 00100000:10000000:2.0:1789402574.858948:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 662: rc = 0 00100000:10000000:2.0:1789402574.859730:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 662: rc = 0 00100000:10000000:2.0:1789402574.859982:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 662: rc = 0 00100000:10000000:2.0:1789402574.861707:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 662: rc = 0 00100000:10000000:2.0:1789402574.861981:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 662: rc = 0 00100000:10000000:2.0:1789402574.863043:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 662: rc = 0 00100000:10000000:2.0:1789402574.863725:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 662: rc = 0 00100000:10000000:2.0:1789402574.863978:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 662: rc = 0 00100000:10000000:2.0:1789402574.864977:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 771: rc = 0 00100000:10000000:2.0:1789402574.865994:0:14409:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789402574.866977:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:2.0:1789402574.867244:0:14409:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789402574.867319:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:2.0:1789402574.867539:0:14409:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789402574.867608:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:2.0:1789402574.867951:0:14409:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789402574.868022:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 199: rc = 0 00100000:10000000:2.0:1789402574.868226:0:14409:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789402574.868297:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 199: rc = 0 00100000:10000000:2.0:1789402574.868512:0:14409:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789402574.868584:0:14409:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 199: rc = 0 00000020:00000080:2.0:1789402574.868850:0:14409:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789402574.868857:0:14409:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789402574.868866:0:14409:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f8b54 00000020:01000004:2.0:1789402574.868873:0:14409:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789402574.868878:0:14409:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789402574.868882:0:14409:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c6ffaae000 from MGS 00000020:01000004:2.0:1789402574.868885:0:14409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789402574.868894:0:14409:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93c6e3344d40) 00000020:00000080:2.0:1789402574.868902:0:14409:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789402574.868950:0:14409:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6ffaae000 from MGS, refs=2 00080000:01000000:2.0:1789402574.868955:0:14409:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789402574.868959:0:14409:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f8b62 00000100:00100000:2.0:1789402574.869052:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789402574.869184:0:14409:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789402574.869191:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789402574.872535:0:14409:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789402574.872557:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789402574.873166:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402574.873340:0:14409:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789402574.873403:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789402574.874265:0:14409:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789402574.874275:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789402574.875047:0:14409:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789402574.875055:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789402574.875736:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402574.875739:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402574.875741:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402574.875969:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402574.875972:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402574.875973:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402574.877129:0:14409:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789402574.884317:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789402574.906499:0:14409:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789402574.906518:0:14409:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789402574.906521:0:14409:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789402574.919416:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789402574.921853:0:14409:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789402574.921998:0:14409:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789402574.922493:0:14409:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789402574.923300:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402574.923499:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789402574.923506:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789402574.924649:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789402574.924660:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789402574.927338:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789402574.927371:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789402574.936275:0:14409:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789402574.936299:0:14409:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.108@tcp' 00000020:01000004:1.0:1789402574.936301:0:14409:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789402574.936330:0:14409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.108@tcp (typ=mgc) 00000020:00000080:1.0:1789402574.936366:0:14409:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.108@tcp (ffff93c6fb338000) 00000020:00000080:1.0:1789402574.936382:0:14409:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789402574.936460:0:14409:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c5c1b46800@MGC192.168.203.108@tcp: add connection 192.168.203.108@tcp at head 00010000:00010000:1.0:1789402574.936689:0:14409:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.108@tcp-0 is initialized 00000040:01000000:1.0:1789402574.936696:0:14409:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.108@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789402574.939669:0:14424:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789402574.939780:0:14409:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.108@tcp (uuid 02178a1e-a899-49a2-9d98-ac5bd5af3b2b) 00000020:00000080:1.0:1789402574.939806:0:14409:0:(genops.c:1384:class_connect()) connect: client 02178a1e-a899-49a2-9d98-ac5bd5af3b2b, cookie 0x9403f4af875f8b70 00000100:00080000:1.0:1789402574.939827:0:14409:0:(import.c:545:import_select_connection()) MGC192.168.203.108@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789402574.939839:0:14409:0:(import.c:666:import_select_connection()) MGC192.168.203.108@tcp: import ffff93c5c1b46800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:1.0:1789402574.939873:0:14409:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6fb1f8700 x1876324224424576/t0(0) o250->MGC192.168.203.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789402574.939905:0:14409:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 02178a1e-a899-49a2-9d98-ac5bd5af3b2b->MGS 00000020:01000004:1.0:1789402574.939929:0:14409:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789402574.939935:0:14409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789402574.939949:0:14409:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93c6fb3399c0) 00000020:00000080:1.0:1789402574.939962:0:14409:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789402574.940654:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3312:1876324224424576:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789402574.940723:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402574.942562:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224424576 00000100:00100000:0.0:1789402574.942576:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224424576 00000100:00100000:0.0:1789402574.942615:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402574.942635:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1876324224424576:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789402574.942661:0:14420:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 02178a1e-a899-49a2-9d98-ac5bd5af3b2b@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:0.0:1789402574.942697:0:14420:0:(genops.c:1384:class_connect()) connect: client 02178a1e-a899-49a2-9d98-ac5bd5af3b2b, cookie 0x9403f4af875f8b7e 00000100:00080000:0.0:1789402574.942833:0:14420:0:(import.c:65:import_set_state_nolock()) ffff93c6e31a2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789402574.942914:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+5:3312:x1876324224424576:12345-0@lo:250:mount.lustre.0 Request processed in 279us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402574.942922:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402574.942968:0:3312:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.108@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789402574.942977:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.108@tcp: connect to target with instance 0 00000100:00080000:0.0:1789402574.942985:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.108@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789402574.942989:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789402574.942992:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c5c1b46800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789402574.942995:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789402574.943003:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789402574.943008:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3312:1876324224424576:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1789402574.944426:0:14423:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789402574.962379:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789402574.962656:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789402574.962663:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789402574.968819:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789402574.968840:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789402574.969253:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789402574.969260:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789402574.970057:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789402574.970267:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789402574.970275:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789402574.970986:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789402574.970995:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789402575.002051:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789402575.002255:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789402575.002263:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789402575.003309:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789402575.003319:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789402575.003948:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789402575.004108:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789402575.004113:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789402575.006332:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789402575.006488:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789402575.006981:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402575.007164:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789402575.007168:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789402575.007862:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789402575.007871:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789402575.008714:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402575.008868:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789402575.008873:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789402575.009577:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789402575.009584:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789402575.041964:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402575.042183:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789402575.042189:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789402575.050196:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789402575.050212:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789402575.051275:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789402575.051286:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789402575.052419:0:14409:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789402575.052441:0:14409:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789402575.052446:0:14409:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.108@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789402575.052699:0:14409:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.108@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789402575.052737:0:14409:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.108@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789402575.052741:0:14409:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789402575.052743:0:14409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789402575.052744:0:14409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789402575.052746:0:14409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789402575.052747:0:14409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789402575.052748:0:14409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789402575.052749:0:14409:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789402575.052751:0:14409:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789402575.052752:0:14409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789402575.052754:0:14409:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789402575.052756:0:14409:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789402575.052758:0:14409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789402575.052759:0:14409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789402575.052760:0:14409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789402575.052761:0:14409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789402575.052762:0:14409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789402575.052763:0:14409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789402575.052764:0:14409:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789402575.052765:0:14409:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789402575.052766:0:14409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789402575.052767:0:14409:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789402575.052792:0:14409:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789402575.052810:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224424704:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789402575.054454:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402575.054510:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c92efe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789402575.056693:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224424704 00000100:00100000:2.0:1789402575.056706:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224424704 00000100:00100000:2.0:1789402575.056758:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789402575.056772:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+5:14409:x1876324224424704:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789402575.056828:0:14422:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789402575.056831:0:14422:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789402575.056834:0:14422:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789402575.057521:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789402575.058197:0:14422:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789402575.060452:0:14444:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789402575.060459:0:14444:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789402575.060462:0:14444:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789402575.060498:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789402575.061662:0:14422:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789402575.061674:0:14422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789402575.074174:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+5:14409:x1876324224424704:12345-0@lo:253:mount.lustre.0 Request processed in 17399us (19716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402575.074193:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402575.074301:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224424704:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789402575.074316:0:14409:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789402575.074319:0:14409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789402575.074321:0:14409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789402575.074322:0:14409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789402575.074324:0:14409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789402575.074325:0:14409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789402575.074327:0:14409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789402575.074328:0:14409:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789402575.074330:0:14409:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789402575.074332:0:14409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789402575.074392:0:14409:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789402575.074431:0:14409:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c6ffaae000 from lustre-MDT0000 10000000:01000000:1.0:1789402575.074458:0:14409:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789402575.074461:0:14409:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789402575.074466:0:14409:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93c6fb338000 10000000:01000000:1.0:1789402575.074471:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789402575.074479:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c6fb338000 from 1 10000000:01000000:1.0:1789402575.074482:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789402575.074521:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.076353:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.076370:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402575.076404:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224424832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789402575.076481:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402575.076542:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c14c7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789402575.077094:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224424832 00000100:00100000:3.0:1789402575.077104:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224424832 00000100:00100000:3.0:1789402575.077158:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789402575.077169:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+5:14409:x1876324224424832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789402575.077184:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402575.077206:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6fb90da00/0x9403f4af875f8b8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8b85 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.077234:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6fb90da00/0x9403f4af875f8b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8b85 expref: 6 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.077245:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6fb90da00/0x9403f4af875f8b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8b85 expref: 6 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.077268:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90da00, rc 0) 00000100:00100000:3.0:1789402575.077329:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+6:14409:x1876324224424832:12345-0@lo:101:mount.lustre.0 Request processed in 162us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402575.077336:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789402575.078484:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224424832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789402575.078506:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.078516:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402575.078690:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224424960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402575.078733:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402575.078771:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c14c7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789402575.079464:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224424960 00000100:00100000:3.0:1789402575.079472:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224424960 00000100:00100000:3.0:1789402575.079520:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789402575.079631:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+6:14409:x1876324224424960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402575.079921:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+6:14409:x1876324224424960:12345-0@lo:501:mount.lustre.0 Request processed in 392us (1186us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789402575.079936:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789402575.084247:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224424960:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789402575.085431:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789402575.085463:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.085475:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402575.085484:0:14409:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c6ffaae000 10000000:01000000:0.0:1789402575.085493:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789402575.085498:0:14409:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93c6ffaae000 10000000:01000000:0.0:1789402575.085501:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789402575.085504:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93c6ffaae000 from 1 10000000:01000000:0.0:1789402575.085507:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789402575.085681:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f8b93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.085690:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f8b93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.085701:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f8b93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402575.085725:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224425088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789402575.085805:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402575.085944:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c70007acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402575.086140:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224425088 00000100:00100000:1.0:1789402575.086147:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224425088 00000100:00100000:1.0:1789402575.086198:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789402575.086209:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+6:14409:x1876324224425088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789402575.086221:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402575.086236:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6e6223000/0x9403f4af875f8b9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8b93 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.086258:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6e6223000/0x9403f4af875f8b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8b93 expref: 7 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.086269:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6e6223000/0x9403f4af875f8b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8b93 expref: 7 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.086277:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6223000, rc 0) 00000100:00100000:1.0:1789402575.086327:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+7:14409:x1876324224425088:12345-0@lo:101:mount.lustre.0 Request processed in 121us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402575.086334:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789402575.086474:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224425088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789402575.086488:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f8b93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b9a expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.086498:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f8b93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8b9a expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402575.086512:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789402575.086524:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f8b93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b9a expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.086539:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83800/0x9403f4af875f8b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b9a expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402575.086547:0:14409:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789402575.086551:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789402575.086556:0:14409:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93c6ffaae000 10000000:01000000:0.0:1789402575.086558:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789402575.086561:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789402575.086563:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789402575.086578:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82600/0x9403f4af875f8ba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.086585:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82600/0x9403f4af875f8ba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.086593:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82600/0x9403f4af875f8ba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402575.086614:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224425216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789402575.086654:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402575.086683:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c70007acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402575.086788:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224425216 00000100:00100000:3.0:1789402575.086794:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224425216 00000100:00100000:3.0:1789402575.086829:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789402575.086836:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+7:14409:x1876324224425216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789402575.086844:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402575.086854:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6fb90c800/0x9403f4af875f8ba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8ba1 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.086868:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6fb90c800/0x9403f4af875f8ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8ba1 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.086876:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6fb90c800/0x9403f4af875f8ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8ba1 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.086883:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c800, rc 0) 00000100:00100000:3.0:1789402575.086925:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+8:14409:x1876324224425216:12345-0@lo:101:mount.lustre.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402575.086949:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789402575.087160:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224425216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789402575.087173:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82600/0x9403f4af875f8ba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8ba8 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.087180:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82600/0x9403f4af875f8ba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8ba8 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402575.087231:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224425344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789402575.087260:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402575.087281:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d81e8600 going to sleep for 11 seconds 00000100:00100000:3.0:1789402575.087335:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224425344 00000100:00100000:3.0:1789402575.087340:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224425344 00000100:00100000:3.0:1789402575.087398:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789402575.087405:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+8:14409:x1876324224425344:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402575.088132:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+9:14409:x1876324224425344:12345-0@lo:501:mount.lustre.0 Request processed in 725us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402575.088140:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789402575.092480:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224425344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402575.097282:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224425472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402575.097400:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.097443:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c3391600 going to sleep for 11 seconds 00000100:00100000:2.0:1789402575.097635:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224425472 00000100:00100000:2.0:1789402575.097643:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224425472 00000100:00100000:2.0:1789402575.097698:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789402575.097707:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+9:14409:x1876324224425472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789402575.098103:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+9:14409:x1876324224425472:12345-0@lo:503:mount.lustre.0 Request processed in 397us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402575.098112:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789402575.098328:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224425472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402575.098967:0:14445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14445:1876324224425600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402575.099009:0:14445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.099189:0:14445:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c33910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402575.100752:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224425600 00000100:00100000:1.0:1789402575.100765:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224425600 00000100:00100000:0.0:1789402575.102164:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789402575.102176:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+9:14445:x1876324224425600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402575.106179:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+9:14445:x1876324224425600:12345-0@lo:502:llog_process_th.0 Request processed in 3996us (7160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402575.106194:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789402575.106856:0:14445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14445:1876324224425600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789402575.106895:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402575.106906:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402575.106908:0:14445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789402575.106914:0:14445:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789402575.106916:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789402575.107090:0:14445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93c6d8b18000) 00000020:00000080:3.0:1789402575.107112:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789402575.107120:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789402575.107193:0:14445:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789402575.107200:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f8bb6 00000020:00000080:3.0:1789402575.107449:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789402575.107454:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402575.107458:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402575.107459:0:14445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789402575.107462:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402575.107467:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402575.107468:0:14445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789402575.107472:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789402575.107480:0:14445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93c6d8b199c0) 00000020:00000080:3.0:1789402575.107491:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789402575.107495:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789402575.107497:0:14445:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789402575.107500:0:14445:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789402575.107506:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789402575.110406:0:14445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6ffaae000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789402575.110437:0:14445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93c6d8b1b380) 00000020:00000080:3.0:1789402575.110455:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789402575.110506:0:14445:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789402575.110513:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f8bcb 00000020:00000080:3.0:1789402575.110673:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789402575.110680:0:14445:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789402575.110684:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9403f4af875f8bd2 00080000:01000000:3.0:1789402575.110689:0:14445:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789402575.110693:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f8bd9 00010000:00010000:2.0:1789402575.227604:0:14445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789402575.228284:0:14445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1789402575.228681:0:14445:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789402575.231577:0:14445:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93c6e3340000) 00000020:00000080:2.0:1789402575.231599:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789402575.231723:0:14445:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789402575.231731:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f8be7 00000020:00000080:3.0:1789402575.248394:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789402575.253796:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9403f4af875f8bee 00000020:00000080:0.0:1789402575.254281:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789402575.254292:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402575.254298:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402575.254300:0:14445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789402575.254303:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402575.254309:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402575.254311:0:14445:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789402575.254315:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789402575.254367:0:14445:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789402575.254379:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402575.254382:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402575.254467:0:14445:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789402575.254472:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789402575.254474:0:14445:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789402575.254476:0:14445:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789402575.254477:0:14445:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789402575.254479:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789402575.254482:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402575.254484:0:14445:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789402575.254486:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789402575.254496:0:14445:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789402575.254501:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402575.254502:0:14445:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789402575.254506:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789402575.254511:0:14445:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.108@tcp to nid 0x20000c0a8cb6c (192.168.203.108@tcp) 00000020:01000000:0.0:1789402575.254534:0:14445:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789402575.254537:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789402575.254551:0:14445:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93c6c99019c0) 00000020:00000080:0.0:1789402575.254563:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789402575.254567:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789402575.254625:0:14445:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789402575.254630:0:14445:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789402575.254636:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f8bfc 00010000:00080000:0.0:1789402575.254667:0:14445:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c6e3301800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.108@tcp at head 00010000:00010000:0.0:1789402575.254944:0:14445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1789402575.255774:0:14445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789402575.255831:0:14445:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789402575.262872:0:14445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789402575.262943:0:14445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789402575.263032:0:14445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789402575.268376:0:14449:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789402575.268383:0:14449:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789402575.269593:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789402575.269607:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789402575.269653:0:14445:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789402575.269671:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f8c03 00000100:00080000:2.0:1789402575.269682:0:14445:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789402575.269694:0:14445:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c6e3301800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:2.0:1789402575.269730:0:14445:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6da91ea00 x1876324224425728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789402575.269758:0:14445:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789402575.269823:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402575.269827:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402575.269828:0:14445:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789402575.269831:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789402575.269833:0:14445:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1789402575.269835:0:14445:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789402575.269837:0:14445:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789402575.269838:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789402575.269841:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402575.269842:0:14445:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789402575.269855:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789402575.269859:0:14445:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789402575.269863:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402575.269864:0:14445:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789402575.269867:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789402575.269872:0:14445:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.108@tcp to nid 0x20000c0a8cb6c (192.168.203.108@tcp) 00000020:01000000:2.0:1789402575.269891:0:14445:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789402575.269894:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789402575.269906:0:14445:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93c6e33419c0) 00000020:00000080:2.0:1789402575.269916:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789402575.269920:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789402575.269984:0:14445:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789402575.269991:0:14445:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789402575.269997:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9403f4af875f8c11 00010000:00080000:2.0:1789402575.270038:0:14445:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c6c99ad800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.108@tcp at head 00010000:00010000:2.0:1789402575.270251:0:14445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789402575.270459:0:14445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789402575.270482:0:14445:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789402575.270960:0:14445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789402575.271032:0:14445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789402575.271093:0:14445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1789402575.271490:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224425728:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789402575.271539:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876324224425728 offset 0 length 520: 4 00000040:00080000:0.0:1789402575.274173:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789402575.274182:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789402575.275525:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789402575.275539:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789402575.275574:0:14445:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789402575.275600:0:14445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f8c18 00000100:00080000:1.0:1789402575.275611:0:14445:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789402575.275635:0:14445:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c6c99ad800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:1.0:1789402575.275672:0:14445:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6fb1fbb80 x1876324224425856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789402575.275691:0:14445:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789402575.275748:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789402575.275752:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402575.275754:0:14445:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789402575.275757:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789402575.275761:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402575.275762:0:14445:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789402575.275765:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789402575.275767:0:14445:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789402575.275769:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789402575.275771:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402575.275773:0:14445:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789402575.275775:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789402575.275777:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402575.275778:0:14445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789402575.275781:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789402575.275811:0:14445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14445:1876324224425984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402575.275887:0:14445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402575.275926:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224425984 00000100:00100000:1.0:1789402575.275945:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224425984 00000100:00100000:1.0:1789402575.275981:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789402575.275989:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+9:14445:x1876324224425984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402575.276610:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+9:14445:x1876324224425984:12345-0@lo:502:llog_process_th.0 Request processed in 619us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402575.276629:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789402575.276685:0:14445:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789402575.276706:0:14445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14445:1876324224425984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789402575.276734:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789402575.276738:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789402575.276739:0:14445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789402575.276743:0:14445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:0.0:1789402575.276888:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224425856:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789402575.276918:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876324224425856 offset 0 length 520: 4 00000020:01000000:3.0:1789402575.279314:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789402575.279376:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789402575.279408:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82600/0x9403f4af875f8ba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8ba8 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.279422:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82600/0x9403f4af875f8ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8ba8 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402575.279455:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6ffaae000 from 1 10000000:01000000:3.0:1789402575.279458:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789402575.279503:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.279511:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.279524:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402575.279550:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789402575.279625:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.279664:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c89480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402575.279944:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224426112 00000100:00100000:0.0:1789402575.279953:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224426112 00000100:00100000:0.0:1789402575.280000:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789402575.280009:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+9:14409:x1876324224426112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789402575.280021:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402575.280042:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8c1f expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.280065:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8c1f expref: 10 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.280076:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c1f expref: 10 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.280084:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83200, rc 0) 00000100:00100000:0.0:1789402575.280132:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+10:14409:x1876324224426112:12345-0@lo:101:mount.lustre.0 Request processed in 124us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402575.280394:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789402575.280412:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.280421:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402575.280979:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426240:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789402575.281024:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.281053:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c89480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402575.281307:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789402575.281362:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224426240 00000100:00100000:0.0:1789402575.281368:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224426240 00000100:00100000:0.0:1789402575.281532:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789402575.281541:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+10:14409:x1876324224426240:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789402575.281558:0:14421:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789402575.281565:0:14421:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789402575.281648:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+10:14409:x1876324224426240:12345-0@lo:256:mount.lustre.0 Request processed in 108us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402575.281655:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789402575.281725:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426240:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789402575.282297:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789402575.282323:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.282334:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402575.282356:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6ffaae000 from 1 10000000:01000000:3.0:1789402575.282359:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789402575.282399:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.282407:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.282416:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402575.282432:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789402575.282463:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.286858:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c89480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402575.291059:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224426368 00000100:00100000:2.0:1789402575.291075:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224426368 00000100:00100000:1.0:1789402575.291151:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789402575.291164:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+10:14409:x1876324224426368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789402575.291181:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402575.291201:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8c2d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.291425:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8c2d expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.291439:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c2d expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.291447:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6223600, rc 0) 00000100:00100000:1.0:1789402575.291535:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14409:x1876324224426368:12345-0@lo:101:mount.lustre.0 Request processed in 374us (9071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402575.291542:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789402575.291584:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789402575.291605:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402575.291629:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402575.291714:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402575.291748:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.291806:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c89480c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402575.291920:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224426496 00000100:00100000:1.0:1789402575.291925:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224426496 00000100:00100000:1.0:1789402575.292026:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789402575.292033:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14409:x1876324224426496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402575.292665:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14409:x1876324224426496:12345-0@lo:501:mount.lustre.0 Request processed in 630us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402575.292683:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789402575.298016:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789402575.298088:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789402575.298185:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402575.298588:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c70007a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789402575.301227:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224426624 00000100:00100000:3.0:1789402575.301243:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224426624 00000100:00100000:3.0:1789402575.301310:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789402575.301324:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14409:x1876324224426624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402575.301689:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14409:x1876324224426624:12345-0@lo:503:mount.lustre.0 Request processed in 369us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402575.301698:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789402575.301745:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224426624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402575.302781:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14453:1876324224426752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402575.302843:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.302912:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789402575.303026:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224426752 00000100:00100000:1.0:1789402575.303033:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224426752 00000100:00100000:1.0:1789402575.303074:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789402575.303082:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14453:x1876324224426752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789402575.303543:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14453:x1876324224426752:12345-0@lo:502:llog_process_th.0 Request processed in 460us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402575.303551:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789402575.303763:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14453:1876324224426752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789402575.303794:0:14453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402575.303803:0:14453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402575.303805:0:14453:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789402575.303812:0:14453:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6ffaae000 00000020:00000080:3.0:1789402575.303814:0:14453:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789402575.303822:0:14453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402575.303824:0:14453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402575.303825:0:14453:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789402575.303828:0:14453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402575.303830:0:14453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402575.303831:0:14453:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789402575.303835:0:14453:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6ffaae000 00000020:00000080:3.0:1789402575.303837:0:14453:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789402575.303891:0:14453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402575.303894:0:14453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402575.303895:0:14453:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789402575.303898:0:14453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789402575.303900:0:14453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402575.303908:0:14453:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789402575.303912:0:14453:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c6ffaae000 00000020:00000080:3.0:1789402575.303914:0:14453:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789402575.303967:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14453:1876324224426880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402575.304004:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.304035:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789402575.304114:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224426880 00000100:00100000:0.0:1789402575.304120:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224426880 00000100:00100000:0.0:1789402575.304174:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789402575.304182:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14453:x1876324224426880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402575.304383:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14453:x1876324224426880:12345-0@lo:502:llog_process_th.0 Request processed in 202us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402575.304391:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789402575.306439:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14453:1876324224426880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789402575.306794:0:14453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789402575.306806:0:14453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789402575.306808:0:14453:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789402575.306813:0:14453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789402575.307437:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789402575.307465:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789402575.307488:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.307501:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402575.307561:0:14409:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789402575.307565:0:14409:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c6ffaae000 10000000:01000000:2.0:1789402575.307567:0:14409:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c6ffaae000 10000000:01000000:2.0:1789402575.307571:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789402575.307578:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6ffaae000 from 1 10000000:01000000:2.0:1789402575.307581:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789402575.307631:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f8c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.307640:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f8c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.307651:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f8c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402575.307675:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224427008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789402575.307736:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402575.307770:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c54593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402575.307846:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224427008 00000100:00100000:0.0:1789402575.307853:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224427008 00000100:00100000:0.0:1789402575.307903:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789402575.307912:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14409:x1876324224427008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789402575.308220:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402575.308238:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a82800/0x9403f4af875f8c42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8c3b expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.308264:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a82800/0x9403f4af875f8c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8c3b expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.308275:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a82800/0x9403f4af875f8c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c3b expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.308284:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82800, rc 0) 00000100:00100000:0.0:1789402575.308333:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14409:x1876324224427008:12345-0@lo:101:mount.lustre.0 Request processed in 422us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402575.308340:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789402575.308463:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224427008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789402575.308480:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f8c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c42 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.308490:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f8c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8c42 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402575.308545:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224427136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789402575.308572:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402575.308630:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c54593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402575.311280:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224427136 00000100:00100000:0.0:1789402575.311295:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224427136 00000100:00100000:0.0:1789402575.311383:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789402575.311395:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14409:x1876324224427136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789402575.311754:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14409:x1876324224427136:12345-0@lo:501:mount.lustre.0 Request processed in 361us (3179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402575.311768:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789402575.311872:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224427136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402575.311936:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224427264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402575.311982:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.312016:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789402575.312129:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224427264 00000100:00100000:0.0:1789402575.312134:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224427264 00000100:00100000:0.0:1789402575.312244:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789402575.312252:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14409:x1876324224427264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789402575.312422:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14409:x1876324224427264:12345-0@lo:503:mount.lustre.0 Request processed in 170us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402575.312428:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789402575.312515:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224427264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402575.320573:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14455:1876324224427392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402575.320668:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.320711:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402575.320825:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224427392 00000100:00100000:0.0:1789402575.320834:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224427392 00000100:00100000:0.0:1789402575.320889:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789402575.320899:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14455:x1876324224427392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789402575.321179:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14455:x1876324224427392:12345-0@lo:502:llog_process_th.0 Request processed in 281us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402575.321186:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789402575.322443:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14455:1876324224427392:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789402575.322511:0:14455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789402575.322535:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93c7019c0000) 00000020:00000080:2.0:1789402575.322557:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789402575.322647:0:14455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6ffaae000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789402575.322651:0:14455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6ffaae000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789402575.322653:0:14455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6ffaae000 4 00010000:00080000:2.0:1789402575.322686:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c6eec1c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.108@tcp at head 00010000:00010000:2.0:1789402575.327231:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789402575.327461:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789402575.327497:0:14455:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789402575.327510:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9403f4af875f8c50 00000100:00080000:2.0:1789402575.327520:0:14455:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789402575.327530:0:14455:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93c6eec1c000 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:2.0:1789402575.327581:0:14455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6da91f800 x1876324224427520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789402575.327636:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224427520:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789402575.327703:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789402575.327761:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789402575.328868:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224427520 00000100:00100000:1.0:1789402575.328892:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224427520 00000100:00100000:1.0:1789402575.328929:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402575.328936:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876324224427520:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789402575.329012:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876324224427520:12345-0@lo:38:llog_process_th.0 Request processed in 75us (1308us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789402575.329020:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402575.329070:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789402575.329078:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6eec1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789402575.329083:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789402575.329087:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224427520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789402575.333531:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14455:1876324224427648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402575.333613:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402575.333662:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224427648 00000100:00100000:3.0:1789402575.333670:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224427648 00000100:00100000:3.0:1789402575.333713:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789402575.333721:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14455:x1876324224427648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789402575.336126:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14455:x1876324224427648:12345-0@lo:502:llog_process_th.0 Request processed in 2397us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402575.336140:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789402575.336217:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e026b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789402575.336239:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14455:1876324224427648:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789402575.336271:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789402575.337040:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789402575.337065:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789402575.337090:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f8c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c42 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.337102:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df000/0x9403f4af875f8c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c42 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789402575.337235:0:14409:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789402575.337237:0:14409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789402575.337239:0:14409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789402575.337240:0:14409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789402575.337242:0:14409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789402575.337244:0:14409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789402575.337245:0:14409:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789402575.337247:0:14409:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789402575.337248:0:14409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789402575.337250:0:14409:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789402575.337253:0:14409:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789402575.337256:0:14409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789402575.337257:0:14409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789402575.337259:0:14409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789402575.337260:0:14409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789402575.337261:0:14409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789402575.337263:0:14409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789402575.337264:0:14409:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789402575.337265:0:14409:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789402575.337266:0:14409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789402575.337267:0:14409:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789402575.337290:0:14409:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789402575.337306:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224427776:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789402575.337376:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402575.337400:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c54596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402575.338062:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224427776 00000100:00100000:0.0:1789402575.338072:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224427776 00000100:00100000:0.0:1789402575.338125:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789402575.338136:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14409:x1876324224427776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789402575.338176:0:14420:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789402575.338192:0:14420:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789402575.393624:0:14420:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789402575.393648:0:14420:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789402575.393710:0:14443:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789402575.393722:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789402575.393742:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.393767:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c1f expref: 12 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.393788:0:14443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.393824:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f8c1f expref: 12 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402575.393838:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f8c1f expref: 12 pid: 14421 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402575.393852:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14443:1876324224427904:0@lo:104: 00000100:00100000:0.0:1789402575.393924:0:14443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402575.393971:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789402575.394122:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224427904 00000100:00100000:1.0:1789402575.394130:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224427904 00000100:00100000:1.0:1789402575.394174:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402575.394184:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:14443:x1876324224427904:12345-0@lo:104: 00010000:00010000:1.0:1789402575.394197:0:14410:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402575.394280:0:14410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789402575.394288:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:14443:x1876324224427904:12345-0@lo:104: Request processed in 106us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402575.394296:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402575.394312:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14443:1876324224427904:0@lo:104: 00010000:00010000:0.0:1789402575.394332:0:14443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394421:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402575.394428:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394437:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c000 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402575.394441:0:14416:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394461:0:14416:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402575.394469:0:14416:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402575.394475:0:14416:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402575.394511:0:14416:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394519:0:14416:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402575.394545:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394553:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c000/0x9403f4af875f8c1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c26 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394569:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402575.394571:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402575.394572:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402575.394620:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3314:1876324224428032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402575.394649:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402575.394801:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224428032 00000100:00100000:2.0:1789402575.394806:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224428032 00010000:00010000:2.0:1789402575.394825:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8c1f expref: 13 pid: 14421 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402575.394844:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789402575.394851:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+13:3314:x1876324224428032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402575.394863:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402575.394867:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8c1f expref: 13 pid: 14421 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394895:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f8c1f expref: 13 pid: 14421 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394909:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83200/0x9403f4af875f8c26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f8c1f expref: 13 pid: 14421 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394923:0:14412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394932:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789402575.394944:0:14412:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001229925s 00010000:00010000:2.0:1789402575.394948:0:14412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394956:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394963:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394969:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394974:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402575.394978:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.394986:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.395006:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402575.395015:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789402575.395042:0:14443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402575.395050:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:3314:x1876324224428032:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (398us total) trans 0 rc 0/0 00010000:00010000:0.0:1789402575.395058:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402575.395061:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789402575.395070:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c57 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402575.395102:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3314:1876324224428032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789402575.410326:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14409:x1876324224427776:12345-0@lo:253:mount.lustre.0 Request processed in 72184us (72941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402575.410370:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789402575.410514:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14409:1876324224427776:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789402575.410531:0:14409:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789402575.410535:0:14409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789402575.410537:0:14409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789402575.410538:0:14409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789402575.410539:0:14409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789402575.410540:0:14409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789402575.410541:0:14409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789402575.410543:0:14409:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789402575.410544:0:14409:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789402575.410546:0:14409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789402575.410547:0:14409:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789402575.410562:0:14409:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789402575.420008:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789402575.420334:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789402575.420687:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789402575.420851:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789402575.421447:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789402575.421694:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789402575.427125:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789402575.427487:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789402575.427783:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789402575.428241:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789402575.428712:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789402575.428877:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789402575.490318:0:14409:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789402575.490748:0:14409:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789402575.491298:0:14467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789402575.491396:0:14467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789402575.494043:0:14467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789402575.494122:0:14467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789402575.494126:0:14467:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:1.0:1789402575.495648:0:14466:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789402575.495655:0:14466:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789402575.497707:0:14409:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789402575.497842:0:14409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789402575.498905:0:14409:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789402575.498918:0:14409:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789402575.499258:0:14409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789402575.500817:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789402575.501655:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789402575.501695:0:14409:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789402575.503707:0:14409:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1789402575.509694:0:14409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789402575.552320:0:14409:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789402575.552390:0:14409:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f6201e2b988 00100000:10000000:3.0:1789402575.552398:0:14409:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789402575.553415:0:14409:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789402575.553437:0:14409:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.108@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789402575.553453:0:14409:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789402575.553473:0:14409:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789402575.906758:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789402576.361825:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789402576.419261:0:14424:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789402576.419268:0:14424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6ffaae000 from 6 10000000:01000000:2.0:1789402576.419272:0:14424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789402576.419327:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402576.419338:0:14424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402576.419369:0:14424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402576.419401:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224428160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789402576.419470:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402576.419516:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459300 going to sleep for 11 seconds 00000100:00100000:0.0:1789402576.419557:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224428160 00000100:00100000:0.0:1789402576.419565:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224428160 00000100:00100000:0.0:1789402576.419626:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789402576.419716:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14424:x1876324224428160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402576.419730:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402576.419745:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8c5e expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402576.419768:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8c5e expref: 12 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402576.419778:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c5e expref: 12 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402576.419787:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83400, rc 0) 00000100:00100000:0.0:1789402576.419836:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14424:x1876324224428160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402576.419842:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789402576.420594:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224428160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402576.420623:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402576.420633:0:14424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402576.420690:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224428288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789402576.420728:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402576.420767:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459300 going to sleep for 11 seconds 00000100:00100000:1.0:1789402576.420814:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224428288 00000100:00100000:1.0:1789402576.420821:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224428288 00000100:00100000:1.0:1789402576.420894:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789402576.420904:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14424:x1876324224428288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789402576.420920:0:14420:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789402576.420936:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789402576.420940:0:14420:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789402576.421031:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14424:x1876324224428288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402576.421040:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789402576.427549:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224428288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789402576.427625:0:14424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789402576.427646:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402576.427659:0:14424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402576.932130:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789402577.379364:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789402577.957015:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402578.978448:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402580.009830:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789402580.194216:0:14710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1789402580.706987:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789402580.706994:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789402580.706997:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789402580.706999:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789402580.707002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789402580.707005:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789402580.707009:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c6eec1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789402580.707027:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93c6eec1c000 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402580.707059:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6e622c000 x1876324224428544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789402580.707141:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789402580.707155:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224428416:0@lo:400:kworker.0 00000100:00100000:3.0:1789402580.707219:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402580.707379:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224428416 00000100:00100000:0.0:1789402580.707400:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224428416 00000100:00100000:0.0:1789402580.707451:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789402580.707460:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:3316:x1876324224428416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402580.707511:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:3316:x1876324224428416:12345-0@lo:400:kworker.0 Request processed in 53us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402580.707517:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789402580.707559:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224428416:0@lo:400:kworker.0 00000100:00100000:1.0:1789402580.708500:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224428544:0@lo:38:kworker.0 00000100:00100000:1.0:1789402580.708546:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402580.708661:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224428544 00000100:00100000:2.0:1789402580.708667:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224428544 00000100:00100000:2.0:1789402580.708697:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789402580.708703:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876324224428544:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789402580.708771:0:14429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1789402580.708807:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9403f4af875f8c6c 00000004:00100000:2.0:1789402580.708819:0:14429:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789402580.708954:0:14429:0:(import.c:65:import_set_state_nolock()) ffff93c6d2e24000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789402580.709002:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876324224428544:12345-0@lo:38:kworker.0 Request processed in 297us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402580.709021:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789402580.709082:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c6e622c000 x1876324224428544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789402590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789402580.709096:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789402580.709104:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789402580.709108:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789402580.709111:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6eec1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789402580.709115:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876324224428544:0@lo:38:kworker.0 00010000:00010000:2.0:1789402581.026485:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402582.055280:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402583.085854:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789402583.382219:0:14860:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef8a3faa0 20000000:00000080:0.0:1789402583.382237:0:14860:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c70056ac00 uarg=0000000000000000 20000000:01000000:0.0:1789402583.382271:0:14860:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789402583.382277:0:14860:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789402583.382282:0:14860:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789402583.383530:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789402583.383749:0:14860:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789402583.389841:0:14860:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789402583.389872:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402583.389890:0:14860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c2d expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402583.389898:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402583.389952:0:14860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f8c2d expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402583.389968:0:14860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f8c2d expref: 11 pid: 14420 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402583.389982:0:14860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14860:1876324224428672:0@lo:104: 00000100:00100000:1.0:1789402583.390044:0:14860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402583.390213:0:14860:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402583.390265:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224428672 00000100:00100000:2.0:1789402583.390273:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224428672 00000100:00100000:2.0:1789402583.390400:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789402583.390412:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:14860:x1876324224428672:12345-0@lo:104: 00010000:00010000:2.0:1789402583.390429:0:14410:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402583.390502:0:14410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789402583.390508:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:14860:x1876324224428672:12345-0@lo:104: Request processed in 100us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402583.390516:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789402583.390595:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402583.390603:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390611:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90de00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:3.0:1789402583.390616:0:14415:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390626:0:14415:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789402583.390634:0:14415:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402583.390641:0:14415:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789402583.390676:0:14415:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390682:0:14415:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789402583.390704:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390711:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6fb90de00/0x9403f4af875f8c2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c34 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390737:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402583.390739:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402583.390741:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402583.390761:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224428800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789402583.390792:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402583.390848:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224428800 00000100:00100000:3.0:1789402583.390852:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224428800 00010000:00010000:3.0:1789402583.390869:0:14413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8c2d expref: 12 pid: 14420 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402583.390889:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789402583.390895:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:3316:x1876324224428800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789402583.390904:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402583.390909:0:14413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8c2d expref: 12 pid: 14420 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390920:0:14413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f8c2d expref: 12 pid: 14420 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390934:0:14413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390943:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390957:0:14413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390964:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390976:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390983:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390988:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222800 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402583.390991:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.390999:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.391008:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402583.391017:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402583.391047:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:3316:x1876324224428800:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402583.391053:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789402583.391108:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224428800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789402583.391289:0:14860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6e6223600/0x9403f4af875f8c34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f8c2d expref: 11 pid: 14420 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402583.391303:0:14860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14860:1876324224428672:0@lo:104: 00010000:00010000:1.0:1789402583.391317:0:14860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402583.391325:0:14860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402583.391331:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402583.391336:0:14860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6e6222800/0x9403f4af875f8c73 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402584.101701:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402585.127911:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789402585.253665:0:14424:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789402585.253676:0:14424:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6ffaae000 from 10 10000000:01000000:1.0:1789402585.253684:0:14424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789402585.253751:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402585.253887:0:14424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402585.253904:0:14424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402585.253938:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224428928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789402585.254028:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402585.254135:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c9998000 going to sleep for 11 seconds 00000100:00100000:2.0:1789402585.255335:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224428928 00000100:00100000:2.0:1789402585.255368:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224428928 00000100:00100000:2.0:1789402585.255438:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789402585.255451:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+11:14424:x1876324224428928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402585.255473:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402585.255510:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8c7a expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402585.255555:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8c7a expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402585.255568:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c7a expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402585.255579:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dec00, rc 0) 00000100:00100000:2.0:1789402585.255665:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14424:x1876324224428928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402585.255672:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789402585.255825:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224428928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789402585.255849:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402585.255860:0:14424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402585.255947:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224429056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402585.255985:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402585.256017:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c9998000 going to sleep for 11 seconds 00000100:00100000:0.0:1789402585.256140:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224429056 00000100:00100000:0.0:1789402585.256146:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224429056 00000100:00100000:0.0:1789402585.256193:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789402585.256202:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14424:x1876324224429056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402585.256570:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14424:x1876324224429056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402585.256578:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789402585.258638:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224429056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402585.258726:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224429184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402585.258819:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402585.258859:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c9998000 going to sleep for 11 seconds 00000100:00100000:2.0:1789402585.258933:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224429184 00000100:00100000:2.0:1789402585.258943:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224429184 00000100:00100000:2.0:1789402585.259002:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789402585.259013:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14424:x1876324224429184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789402585.259339:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:14424:x1876324224429184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 327us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402585.259390:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789402585.261427:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224429184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789402585.268949:0:14932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789402585.269315:0:14424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789402585.269382:0:14424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789402585.269398:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402585.269413:0:14424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789402585.826468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789402585.826481:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789402585.826485:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789402585.826489:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789402585.826659:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224429312:0@lo:400:kworker.0 00000100:00100000:2.0:1789402585.826750:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402585.826954:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224429312 00000100:00100000:0.0:1789402585.826965:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224429312 00000100:00100000:0.0:1789402585.827022:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789402585.827033:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224429312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402585.827111:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224429312:12345-0@lo:400:kworker.0 Request processed in 80us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402585.827119:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789402585.827200:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c6e622d180 x1876324224429312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402585.827221:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224429312:0@lo:400:kworker.0 00000100:00100000:3.0:1789402585.830618:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789402575/real 1789402575] req@ffff93c6fb1fbb80 x1876324224425856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789402585 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402585.830665:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c6fb1fbb80 x1876324224425856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789402585 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402585.830787:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789402575/real 1789402575] req@ffff93c6da91ea00 x1876324224425728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789402585 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402585.830818:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c6da91ea00 x1876324224425728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789402585 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789402585.830837:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6c99ad800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789402585.830850:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789402585.830854:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224425856:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789402585.830860:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6e3301800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789402585.830864:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789402585.830866:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224425728:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789402585.831149:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789402585.831156:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789402585.831160:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c6e3301800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789402585.831167:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:0.0:1789402585.831175:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789402585.831191:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c6e3301800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402585.831246:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6e622f480 x1876324224429440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789402585.831276:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789402585.831279:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789402585.831281:0:8:0:(import.c:65:import_set_state_nolock()) ffff93c6c99ad800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789402585.831285:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:0.0:1789402585.831288:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789402585.831293:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c6c99ad800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402585.831305:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6e622f100 x1876324224429568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789402585.831478:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224429440:0@lo:8:kworker.0 00000400:00000100:2.0:1789402585.831565:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876324224429440 offset 0 length 520: 4 00000100:00100000:2.0:1789402585.831622:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224429568:0@lo:8:kworker.0 00000400:00000100:2.0:1789402585.831667:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876324224429568 offset 0 length 520: 4 00010000:00010000:0.0:1789402586.147767:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402587.170733:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789402587.620973:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789402588.195133:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789402588.517313:0:15109:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789402588.517317:0:15109:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789402588.518144:0:15109:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c6fa960800 00000020:01000004:2.0:1789402588.518161:0:15109:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789402588.518174:0:15109:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789402588.518187:0:15109:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93c7019c19c0) 00000020:00000080:2.0:1789402588.518208:0:15109:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789402588.544240:0:15109:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789402588.548243:0:15109:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789402588.549037:0:15109:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789402588.549263:0:15109:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789402588.549504:0:15109:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789402588.549856:0:15109:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1789402588.549942:0:15109:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1789402588.550034:0:15109:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1789402588.550686:0:15109:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 187: rc = 0 00100000:10000000:3.0:1789402588.550934:0:15109:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 187: rc = 0 00100000:10000000:3.0:1789402588.551183:0:15109:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 187: rc = 0 00100000:10000000:3.0:1789402588.551476:0:15109:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 187: rc = 0 00100000:10000000:3.0:1789402588.553449:0:15109:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 187: rc = 0 00100000:10000000:3.0:1789402588.553862:0:15109:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 187: rc = 0 00000020:00000080:3.0:1789402588.558767:0:15109:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789402588.558782:0:15109:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789402588.558794:0:15109:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9403f4af875f8c8f 00000020:01000004:3.0:1789402588.558802:0:15109:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789402588.558826:0:15109:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.108@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789402588.558829:0:15109:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789402588.558835:0:15109:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789402588.558839:0:15109:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789402588.558851:0:15109:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93c6d8b1cd40) 00000020:00000080:3.0:1789402588.558861:0:15109:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789402588.570503:0:15109:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789402588.570701:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789402588.570709:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789402588.585043:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789402588.585062:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789402588.585737:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789402588.585746:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789402588.587068:0:15109:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789402588.587276:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789402588.587283:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789402588.595123:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789402588.595138:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789402588.628656:0:15109:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789402588.628895:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789402588.628901:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789402588.631459:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789402588.631474:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789402588.639527:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789402588.639633:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789402588.645718:0:15109:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789402588.645978:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789402588.645992:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789402588.646723:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789402588.646731:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789402588.690031:0:15109:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789402588.690230:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789402588.690235:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789402588.705333:0:15109:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789402588.705414:0:15109:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789402588.705903:0:15109:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789402588.705928:0:15109:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789402588.705935:0:15109:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.108@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789402588.721100:0:15109:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.108@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789402588.721143:0:15109:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.108@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789402588.721147:0:15109:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789402588.721149:0:15109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789402588.721150:0:15109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402588.721152:0:15109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402588.721153:0:15109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402588.721154:0:15109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402588.721155:0:15109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789402588.721157:0:15109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402588.721158:0:15109:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789402588.721161:0:15109:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789402588.721163:0:15109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789402588.721164:0:15109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789402588.721166:0:15109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402588.721167:0:15109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402588.721168:0:15109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402588.721169:0:15109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402588.721170:0:15109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789402588.721171:0:15109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402588.721172:0:15109:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789402588.721196:0:15109:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789402588.721215:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224429696:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789402588.721276:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.721417:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c94b66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402588.721865:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224429696 00000100:00100000:2.0:1789402588.721874:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224429696 00000100:00100000:2.0:1789402588.722152:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789402588.722163:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:15109:x1876324224429696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789402588.722193:0:14421:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789402588.722197:0:14421:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789402588.722201:0:14421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789402588.733715:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:15109:x1876324224429696:12345-0@lo:253:mount.lustre.0 Request processed in 11545us (12429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402588.733729:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789402588.733821:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224429696:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789402588.733838:0:15109:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789402588.733841:0:15109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789402588.733843:0:15109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789402588.733845:0:15109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402588.733846:0:15109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402588.733847:0:15109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402588.733863:0:15109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402588.733864:0:15109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789402588.733866:0:15109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402588.733867:0:15109:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789402588.733884:0:15109:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c6fa960800 from lustre-OST0000 10000000:01000000:0.0:1789402588.733923:0:15109:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789402588.733926:0:15109:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789402588.733932:0:15109:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c6fb338000 local copy 00010000:00010000:0.0:1789402588.733942:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402588.734555:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224429824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789402588.734594:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.734637:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c94b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402588.734741:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224429824 00000100:00100000:1.0:1789402588.734749:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224429824 00000100:00100000:1.0:1789402588.734835:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789402588.734845:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:15109:x1876324224429824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402588.735004:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:15109:x1876324224429824:12345-0@lo:501:mount.lustre.0 Request processed in 161us (409us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789402588.735011:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789402588.735076:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224429824:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789402588.735091:0:15109:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789402588.735234:0:15109:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789402588.735241:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.735252:0:15109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402588.735274:0:15109:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c6fa960800 10000000:01000000:0.0:1789402588.735279:0:15109:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789402588.735283:0:15109:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93c6fb338000 10000000:01000000:0.0:1789402588.735285:0:15109:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789402588.735289:0:15109:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93c6fb338000 from 1 10000000:01000000:0.0:1789402588.735291:0:15109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789402588.735315:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82e00/0x9403f4af875f8c9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.735328:0:15109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82e00/0x9403f4af875f8c9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.735338:0:15109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82e00/0x9403f4af875f8c9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402588.735373:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224429952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789402588.735397:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.744586:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c94b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402588.744850:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224429952 00000100:00100000:2.0:1789402588.744860:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224429952 00000100:00100000:2.0:1789402588.745095:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789402588.745107:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+12:15109:x1876324224429952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789402588.745208:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402588.745231:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f8ca4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8c9d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.745262:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f8ca4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8c9d expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.745275:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3df600/0x9403f4af875f8ca4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c9d expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.745303:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df600, rc 0) 00000100:00100000:2.0:1789402588.745534:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+13:15109:x1876324224429952:12345-0@lo:101:mount.lustre.0 Request processed in 429us (10134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402588.745541:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789402588.745630:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224429952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789402588.745649:0:15109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82e00/0x9403f4af875f8c9d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8ca4 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.745659:0:15109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82e00/0x9403f4af875f8c9d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8ca4 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402588.745679:0:15109:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789402588.745701:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82e00/0x9403f4af875f8c9d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8ca4 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.745708:0:15109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a82e00/0x9403f4af875f8c9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8ca4 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402588.745716:0:15109:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789402588.745720:0:15109:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789402588.745726:0:15109:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789402588.745728:0:15109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789402588.745760:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f8cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.745768:0:15109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f8cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.745776:0:15109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f8cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402588.745795:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789402588.745830:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.745863:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c94b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402588.746148:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224430080 00000100:00100000:1.0:1789402588.746154:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224430080 00000100:00100000:1.0:1789402588.746195:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789402588.746203:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+13:15109:x1876324224430080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789402588.746212:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402588.746222:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6e6223800/0x9403f4af875f8cb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8cab expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.746239:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6e6223800/0x9403f4af875f8cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8cab expref: 14 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.746249:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6e6223800/0x9403f4af875f8cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8cab expref: 14 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.746257:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6223800, rc 0) 00000100:00100000:1.0:1789402588.746301:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430080:12345-0@lo:101:mount.lustre.0 Request processed in 99us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402588.746307:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789402588.747601:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789402588.747626:0:15109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f8cab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8cb2 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.747636:0:15109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f8cab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8cb2 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789402588.748839:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789402588.749675:0:15109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789402588.749869:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789402588.749906:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789402588.749933:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789402588.749971:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789402588.750002:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789402588.750027:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789402588.750080:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789402588.750087:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789402588.750430:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789402588.750543:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.750581:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c94b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789402588.750806:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224430208 00000100:00100000:1.0:1789402588.750814:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224430208 00000100:00100000:1.0:1789402588.750872:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789402588.750882:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402588.751219:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430208:12345-0@lo:501:mount.lustre.0 Request processed in 337us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402588.751227:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789402588.751320:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789402588.751387:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789402588.751424:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.751454:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c94b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789402588.751537:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224430336 00000100:00100000:1.0:1789402588.751542:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224430336 00000100:00100000:1.0:1789402588.751570:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789402588.751576:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430336:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789402588.751837:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430336:12345-0@lo:503:mount.lustre.0 Request processed in 260us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402588.751844:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789402588.752199:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430336:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789402588.752746:0:15109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789402588.752815:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402588.752856:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.752879:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c94b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789402588.753127:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224430464 00000100:00100000:1.0:1789402588.753133:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224430464 00000100:00100000:1.0:1789402588.753173:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789402588.753182:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789402588.753408:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430464:12345-0@lo:502:mount.lustre.0 Request processed in 227us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402588.753416:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789402588.753585:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402588.753819:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789402588.753868:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789402588.753917:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789402588.753966:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789402588.754002:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789402588.754034:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789402588.754080:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789402588.754116:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789402588.754150:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789402588.754211:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789402588.754250:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789402588.754298:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789402588.754331:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402588.754404:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.754439:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c94b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789402588.754506:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224430592 00000100:00100000:1.0:1789402588.754520:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224430592 00000100:00100000:1.0:1789402588.754605:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789402588.754623:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789402588.754783:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430592:12345-0@lo:502:mount.lustre.0 Request processed in 162us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402588.754791:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789402588.754862:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402588.754926:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789402588.754937:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1789402588.756191:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789402588.756202:0:15123:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789402588.756209:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.756211:0:15123:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789402588.756216:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789402588.756232:0:15123:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93c6c9904d40) 00000020:00000080:0.0:1789402588.756256:0:15123:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789402588.756262:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789402588.756331:0:15123:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6fa960800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789402588.756338:0:15123:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789402588.756383:0:15123:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9403f4af875f8cc0 00010000:00010000:0.0:1789402588.759494:0:15123:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1789402588.760588:0:15123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1789402588.762218:0:15123:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789402588.763568:0:15123:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789402588.763578:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402588.763583:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.763586:0:15123:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789402588.763589:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789402588.763591:0:15123:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789402588.763593:0:15123:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789402588.763594:0:15123:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789402588.763595:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789402588.763598:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.763599:0:15123:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789402588.763601:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402588.763604:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.763605:0:15123:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789402588.763616:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789402588.763618:0:15123:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789402588.763621:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402588.763623:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.763624:0:15123:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789402588.763626:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402588.763628:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.763629:0:15123:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789402588.763633:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789402588.763682:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402588.763686:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.763688:0:15123:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789402588.763691:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789402588.764366:0:15109:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789402588.764393:0:15109:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789402588.764412:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f8cab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8cb2 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.764424:0:15109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83200/0x9403f4af875f8cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8cb2 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402588.764432:0:15109:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6fa960800 from 1 10000000:01000000:1.0:1789402588.764435:0:15109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789402588.764472:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.764480:0:15109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.764491:0:15109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402588.764525:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789402588.764589:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402588.764622:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c53a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402588.766270:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224430720 00000100:00100000:3.0:1789402588.766284:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224430720 00000100:00100000:3.0:1789402588.766335:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789402588.766364:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+14:15109:x1876324224430720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789402588.766381:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402588.766399:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8cc7 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402588.766424:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8cc7 expref: 15 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402588.766435:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8cc7 expref: 15 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402588.766443:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c000, rc 0) 00000100:00100000:3.0:1789402588.766524:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224430720:12345-0@lo:101:mount.lustre.0 Request processed in 168us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402588.766539:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789402588.766700:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789402588.766719:0:15109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.766747:0:15109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789402588.767264:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789402588.767663:0:15109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789402588.767895:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789402588.767940:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789402588.768016:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789402588.768025:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789402588.768094:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402588.768150:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402588.768194:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c53a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402588.770266:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224430848 00000100:00100000:3.0:1789402588.770278:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224430848 00000100:00100000:3.0:1789402588.770337:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789402588.770494:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224430848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402588.770852:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224430848:12345-0@lo:501:mount.lustre.0 Request processed in 362us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402588.770861:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789402588.774625:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789402588.774685:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789402588.774777:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.774823:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c998f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789402588.775403:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224430976 00000100:00100000:1.0:1789402588.775411:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224430976 00000100:00100000:1.0:1789402588.775461:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789402588.775472:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224430976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789402588.775672:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224430976:12345-0@lo:503:mount.lustre.0 Request processed in 201us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402588.775680:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789402588.776520:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224430976:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789402588.777305:0:15109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789402588.777475:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402588.777562:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.777962:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c998f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789402588.780450:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224431104 00000100:00100000:2.0:1789402588.780463:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224431104 00000100:00100000:3.0:1789402588.780601:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789402588.780611:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224431104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789402588.780859:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224431104:12345-0@lo:502:mount.lustre.0 Request processed in 248us (3296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402588.780867:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789402588.780994:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789402588.781999:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789402588.782153:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789402588.782215:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789402588.782250:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789402588.782279:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789402588.782323:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789402588.783194:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789402588.783249:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789402588.783302:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789402588.783590:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402588.783632:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ff9e23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402588.783683:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224431232 00000100:00100000:2.0:1789402588.783690:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224431232 00000100:00100000:2.0:1789402588.783762:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789402588.783771:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224431232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789402588.783947:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224431232:12345-0@lo:502:mount.lustre.0 Request processed in 177us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402588.783955:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789402588.784026:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402588.784141:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789402588.784154:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789402588.786014:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402588.786028:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.786031:0:15127:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789402588.786037:0:15127:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6fa960800 00000020:00000080:0.0:1789402588.786057:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789402588.786064:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402588.786067:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.786068:0:15127:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789402588.786070:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402588.786073:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.786074:0:15127:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789402588.786078:0:15127:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6fa960800 00000020:00000080:0.0:1789402588.786080:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789402588.786135:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402588.786138:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.786140:0:15127:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789402588.786142:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789402588.786144:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.786145:0:15127:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789402588.786148:0:15127:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c6fa960800 00000020:00000080:0.0:1789402588.786150:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789402588.786187:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789402588.786191:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789402588.786192:0:15127:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789402588.786195:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789402588.802749:0:15109:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789402588.802803:0:15109:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789402588.802824:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.802837:0:15109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402588.802893:0:15109:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789402588.802896:0:15109:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c6fa960800 10000000:01000000:1.0:1789402588.802899:0:15109:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c6fa960800 10000000:01000000:1.0:1789402588.802903:0:15109:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789402588.802909:0:15109:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6fa960800 from 1 10000000:01000000:1.0:1789402588.802911:0:15109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789402588.802946:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6222000/0x9403f4af875f8cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.802955:0:15109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6e6222000/0x9403f4af875f8cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.802965:0:15109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6e6222000/0x9403f4af875f8cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402588.802989:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789402588.803130:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402588.803175:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fc63cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789402588.803386:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224431360 00000100:00100000:2.0:1789402588.803394:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224431360 00000100:00100000:2.0:1789402588.803440:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789402588.803459:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224431360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789402588.803472:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402588.803485:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3dfe00/0x9403f4af875f8cdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8cd5 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.803507:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3dfe00/0x9403f4af875f8cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8cd5 expref: 16 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.803529:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3dfe00/0x9403f4af875f8cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8cd5 expref: 16 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.803539:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dfe00, rc 0) 00000100:00100000:2.0:1789402588.803580:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224431360:12345-0@lo:101:mount.lustre.0 Request processed in 125us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402588.803587:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789402588.808213:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789402588.808247:0:15109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6e6222000/0x9403f4af875f8cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8cdc expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.808259:0:15109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6e6222000/0x9403f4af875f8cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8cdc expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789402588.808867:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789402588.809241:0:15109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789402588.809542:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789402588.809592:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789402588.809627:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789402588.809676:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789402588.809712:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789402588.809759:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789402588.809804:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789402588.809836:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789402588.809882:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789402588.809914:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789402588.809941:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789402588.809983:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789402588.811578:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789402588.811631:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789402588.811714:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789402588.811756:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789402588.811790:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789402588.811840:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789402588.811877:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789402588.811908:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789402588.811953:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789402588.811989:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789402588.814153:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789402588.814293:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789402588.814336:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789402588.814699:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789402588.814754:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789402588.814789:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789402588.814869:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789402588.814877:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789402588.814990:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402588.817179:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402588.817238:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fc63cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789402588.817425:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224431488 00000100:00100000:3.0:1789402588.817434:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224431488 00000100:00100000:3.0:1789402588.817486:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789402588.817497:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224431488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402588.817764:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224431488:12345-0@lo:501:mount.lustre.0 Request processed in 269us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402588.817772:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789402588.817870:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402588.817916:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789402588.817953:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402588.817975:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fc63cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789402588.819178:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224431616 00000100:00100000:3.0:1789402588.819191:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224431616 00000100:00100000:3.0:1789402588.819241:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789402588.819250:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224431616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402588.819477:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224431616:12345-0@lo:503:mount.lustre.0 Request processed in 227us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402588.819485:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789402588.819613:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789402588.820264:0:15109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789402588.820375:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789402588.820430:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402588.820465:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224431744 00000100:00100000:1.0:1789402588.820471:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224431744 00000100:00100000:1.0:1789402588.820502:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789402588.820520:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224431744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789402588.820700:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224431744:12345-0@lo:502:mount.lustre.0 Request processed in 190us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402588.820707:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789402588.820749:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fc63cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789402588.820766:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789402588.821007:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789402588.822214:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789402588.822290:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789402588.822544:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789402588.822589:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789402588.822657:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789402588.822715:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789402588.822752:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789402588.822796:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789402588.822830:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789402588.822875:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789402588.822924:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789402588.822960:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789402588.822994:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789402588.824171:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789402588.824265:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789402588.824298:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789402588.826296:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789402588.826417:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789402588.826458:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789402588.826530:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789402588.826569:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789402588.826617:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789402588.826663:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789402588.826696:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789402588.826725:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789402588.826768:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789402588.826802:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789402588.826832:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789402588.826872:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789402588.826899:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789402588.826924:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789402588.826949:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789402588.826986:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789402588.827014:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789402588.830205:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789402588.830314:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789402588.831293:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789402588.831429:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789402588.831469:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789402588.831530:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789402588.831609:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402588.831654:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fc63cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789402588.832002:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224431872 00000100:00100000:2.0:1789402588.832010:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224431872 00000100:00100000:2.0:1789402588.832187:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789402588.832197:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224431872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789402588.832432:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224431872:12345-0@lo:502:mount.lustre.0 Request processed in 236us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402588.832440:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789402588.832570:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224431872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402588.832656:0:15109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789402588.832669:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789402588.833546:0:15132:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789402588.833561:0:15132:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93c6c9900000) 00000020:00000080:0.0:1789402588.833586:0:15132:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789402588.833667:0:15132:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6fa960800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789402588.833671:0:15132:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6fa960800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789402588.833674:0:15132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6fa960800 3 00010000:00080000:0.0:1789402588.833705:0:15132:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c6e0ae2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.108@tcp at head 00010000:00010000:0.0:1789402588.835546:0:15132:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789402588.835733:0:15132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789402588.835767:0:15132:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789402588.835778:0:15132:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9403f4af875f8cea 00000100:00080000:0.0:1789402588.835788:0:15132:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789402588.835798:0:15132:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93c6e0ae2800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402588.835834:0:15132:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6e622df80 x1876324224432000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789402588.835928:0:15132:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789402588.835963:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789402588.835968:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789402588.835970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789402588.835973:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789402588.836125:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876324224432000:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789402588.836185:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789402588.836235:0:15132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1789402588.836236:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224432000 00000100:00100000:1.0:1789402588.836243:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224432000 00000100:00100000:1.0:1789402588.836270:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1789402588.836272:0:15109:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:1.0:1789402588.836276:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876324224432000:12345-0@lo:38:llog_process_th.0 10000000:01000000:0.0:1789402588.836293:0:15109:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:1.0:1789402588.836296:0:14427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00010000:00010000:0.0:1789402588.836305:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6222000/0x9403f4af875f8cd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8cdc expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.836315:0:15109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6e6222000/0x9403f4af875f8cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8cdc expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789402588.836324:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9403f4af875f8cf1 00000004:00100000:1.0:1789402588.836337:0:14427:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000004:0.0:1789402588.836375:0:15109:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789402588.836377:0:15109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789402588.836379:0:15109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402588.836380:0:15109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402588.836381:0:15109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402588.836382:0:15109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402588.836384:0:15109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00080000:1.0:1789402588.836385:0:14427:0:(import.c:65:import_set_state_nolock()) ffff93c6ea346000 : changing import state from RECOVER to FULL 00000020:01000004:0.0:1789402588.836386:0:15109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402588.836387:0:15109:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789402588.836390:0:15109:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789402588.836392:0:15109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789402588.836393:0:15109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789402588.836394:0:15109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402588.836395:0:15109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402588.836396:0:15109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402588.836397:0:15109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402588.836402:0:15109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789402588.836403:0:15109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402588.836404:0:15109:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789402588.836415:0:15109:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789402588.836425:0:15109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224432256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789402588.836429:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876324224432000:12345-0@lo:38:llog_process_th.0 Request processed in 152us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402588.836436:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789402588.836458:0:15109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.836478:0:15109:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c998fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402588.837166:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224432128:0@lo:400:kworker.0 00000100:00100000:3.0:1789402588.837208:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402588.837265:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224432128 00000100:00100000:3.0:1789402588.837270:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224432128 00000100:00100000:3.0:1789402588.837304:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789402588.837311:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224432128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402588.837366:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224432128:12345-0@lo:400:kworker.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402588.837373:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789402588.837392:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224432256 00000100:00100000:3.0:1789402588.837396:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224432256 00000100:00100000:3.0:1789402588.837425:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789402588.837432:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15109:x1876324224432256:12345-0@lo:253:mount.lustre.0 00010000:00080000:1.0:1789402588.837659:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c6e622df80 x1876324224432000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789402598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402588.837669:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789402588.837677:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789402588.837685:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789402588.837690:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789402588.837693:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6e0ae2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789402588.837699:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876324224432000:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1789402588.837756:0:14420:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789402588.837770:0:14420:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789402588.838919:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c6e31bdc00 x1876324224432128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402588.838933:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224432128:0@lo:400:kworker.0 20000000:01000000:3.0:1789402588.861315:0:14420:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789402588.861336:0:14420:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789402588.862326:0:14443:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789402588.862333:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789402588.862379:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.862399:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c5e expref: 16 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.862408:0:14443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.862460:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f8c5e expref: 16 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.862473:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f8c5e expref: 16 pid: 14421 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402588.862487:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14443:1876324224432384:0@lo:104: 00000100:00100000:0.0:1789402588.862560:0:14443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402588.862645:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c998f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789402588.863293:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224432384 00000100:00100000:1.0:1789402588.863303:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224432384 00000100:00100000:1.0:1789402588.863381:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789402588.863390:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:14443:x1876324224432384:12345-0@lo:104: 00010000:00010000:1.0:1789402588.863417:0:14411:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402588.863497:0:14411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789402588.863503:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:14443:x1876324224432384:12345-0@lo:104: Request processed in 115us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402588.863520:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789402588.863690:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402588.863698:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.863705:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de000 already unused, calling callback (ffffffffc1d64c20) 00000100:00100000:0.0:1789402588.863705:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14443:1876324224432384:0@lo:104: 10000000:00010000:2.0:1789402588.863710:0:14415:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.863725:0:14415:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402588.863733:0:14415:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402588.863737:0:14443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402588.863739:0:14415:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402588.863778:0:14415:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.863784:0:14415:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402588.863811:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.863817:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de000/0x9403f4af875f8c5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c65 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.863834:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402588.863836:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402588.863838:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402588.863876:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789402588.863889:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224432512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789402588.863925:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402588.864051:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224432512 00000100:00100000:2.0:1789402588.864056:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224432512 00010000:00010000:2.0:1789402588.864085:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8c5e expref: 17 pid: 14421 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402588.864114:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789402588.864121:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:3316:x1876324224432512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402588.864132:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402588.864138:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8c5e expref: 17 pid: 14421 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864155:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f8c5e expref: 17 pid: 14421 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864167:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83400/0x9403f4af875f8c65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f8c5e expref: 17 pid: 14421 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864179:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864186:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789402588.864199:0:14414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001866383s 00010000:00010000:2.0:1789402588.864205:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864213:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864220:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864226:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864231:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402588.864235:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864241:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864268:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402588.864278:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402588.864309:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:3316:x1876324224432512:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402588.864315:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789402588.864413:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224432512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789402588.864433:0:14443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402588.864451:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402588.864459:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a83000/0x9403f4af875f8cf8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402588.877474:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:15109:x1876324224432256:12345-0@lo:253:mount.lustre.0 Request processed in 40033us (41006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402588.877489:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789402588.878423:0:15109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15109:1876324224432256:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789402588.878458:0:15109:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789402588.878461:0:15109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789402588.878463:0:15109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789402588.878464:0:15109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789402588.878466:0:15109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789402588.878467:0:15109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789402588.878468:0:15109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789402588.878470:0:15109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789402588.878471:0:15109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789402588.878473:0:15109:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789402588.878487:0:15109:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789402588.887203:0:15109:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789402588.888016:0:15109:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789402588.889292:0:15109:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789402588.889480:0:15109:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789402588.889874:0:15109:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789402588.890018:0:15109:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789402588.892225:0:15109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789402588.993975:0:15109:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789402588.993983:0:15109:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789402588.994013:0:15109:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789402588.994081:0:15109:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.108@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789402588.994094:0:15109:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789402588.994121:0:15109:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789402589.221806:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402590.242517:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789402590.371787:0:14424:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789402590.371798:0:14424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6ffaae000 from 7 10000000:01000000:3.0:1789402590.371804:0:14424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789402590.374313:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402590.374332:0:14424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402590.374362:0:14424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402590.374411:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224432640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789402590.374529:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402590.383246:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e10a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789402590.388044:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224432640 00000100:00100000:2.0:1789402590.388064:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224432640 00000100:00100000:2.0:1789402590.388144:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789402590.388156:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+15:14424:x1876324224432640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402590.388178:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402590.388205:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8cff expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402590.388239:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8cff expref: 16 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402590.388252:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8cff expref: 16 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402590.388263:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dea00, rc 0) 00000100:00100000:2.0:1789402590.388380:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:14424:x1876324224432640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (13851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402590.388387:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789402590.388469:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224432640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402590.388520:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402590.388530:0:14424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402590.388612:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224432768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789402590.388660:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402590.388696:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c5459d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789402590.402532:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224432768 00000100:00100000:3.0:1789402590.402549:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224432768 00000100:00100000:3.0:1789402590.402622:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789402590.402636:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:14424:x1876324224432768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789402590.402668:0:14420:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789402590.402691:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789402590.402695:0:14420:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789402590.402864:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:14424:x1876324224432768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 231us (14203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402590.402875:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789402590.408794:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224432768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789402590.409190:0:14424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789402590.409204:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402590.409218:0:14424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402591.267510:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402592.291448:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402593.318060:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789402594.019656:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789402594.019663:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789402594.019666:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789402594.019813:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789402594.019904:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224432896:0@lo:400:kworker.0 00000100:00100000:3.0:1789402594.019971:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402594.020098:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224433024:0@lo:400:kworker.0 00000100:00100000:3.0:1789402594.020129:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402594.020150:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789402594.020156:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224433152:0@lo:400:kworker.0 00000100:00100000:3.0:1789402594.020197:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402594.020288:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224432896 00000100:00100000:3.0:1789402594.020296:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224432896 00000100:00100000:3.0:1789402594.020335:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789402594.020362:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:3316:x1876324224432896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402594.020408:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:3316:x1876324224432896:12345-0@lo:400:kworker.0 Request processed in 65us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402594.020415:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789402594.020444:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224433024 00000100:00100000:3.0:1789402594.020447:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224433024 00000100:00100000:3.0:1789402594.020466:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224433152 00000100:00100000:3.0:1789402594.020469:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224433152 00000100:00100000:3.0:1789402594.020501:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789402594.020507:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224433024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402594.020538:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224433024:12345-0@lo:400:kworker.0 Request processed in 31us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402594.020543:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789402594.020553:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789402594.020558:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224433152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402594.020580:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224433152:12345-0@lo:400:kworker.0 Request processed in 22us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402594.020586:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789402594.020613:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789402594.021415:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6e31bfb80 x1876324224433152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402594.021429:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224433152:0@lo:400:kworker.0 00010000:00080000:3.0:1789402594.021455:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6e31bf800 x1876324224433024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402594.021464:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224433024:0@lo:400:kworker.0 00000100:00100000:3.0:1789402594.022234:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224432896:0@lo:400:kworker.0 00010000:00010000:3.0:1789402594.344459:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402595.364495:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789402596.225114:0:15478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789402596.387707:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402597.410651:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789402597.858996:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789402598.434514:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789402599.148748:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789402599.148755:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789402599.148757:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1789402599.150007:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3315:1876324224433280:0@lo:400:kworker.0 00000100:00080000:1.0:1789402599.150170:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789402599.150509:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402599.150586:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402599.150594:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224433408:0@lo:400:kworker.0 00000100:00100000:3.0:1789402599.150630:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402599.150678:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224433536:0@lo:400:kworker.0 00000100:00100000:3.0:1789402599.150706:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402599.150742:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224433408 00000100:00100000:3.0:1789402599.150748:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224433408 00000100:00100000:1.0:1789402599.150875:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224433280 00000100:00100000:1.0:1789402599.150880:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224433280 00000100:00100000:1.0:1789402599.150916:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789402599.150925:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:3315:x1876324224433280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402599.150987:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:3315:x1876324224433280:12345-0@lo:400:kworker.0 Request processed in 61us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402599.150995:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789402599.151910:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224433536 00000100:00100000:3.0:1789402599.151918:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224433536 00000100:00100000:3.0:1789402599.151946:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789402599.151954:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224433408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402599.152017:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224433408:12345-0@lo:400:kworker.0 Request processed in 64us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402599.152023:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789402599.152037:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789402599.152043:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224433536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402599.153546:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224433536:12345-0@lo:400:kworker.0 Request processed in 1495us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402599.153571:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789402599.153628:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6fb1f8e00 x1876324224433408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402599.153643:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224433408:0@lo:400:kworker.0 00000100:00100000:3.0:1789402599.153666:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3315:1876324224433280:0@lo:400:kworker.0 00000100:00080000:3.0:1789402599.153694:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789402599.153713:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6fb1faa00 x1876324224433536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402599.153721:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224433536:0@lo:400:kworker.0 00010000:00010000:1.0:1789402599.467449:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402600.099826:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789402585/real 1789402585] req@ffff93c6e622f480 x1876324224429440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789402600 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402600.099861:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c6e622f480 x1876324224429440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789402600 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402600.099871:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789402585/real 1789402585] req@ffff93c6e622f100 x1876324224429568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789402600 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402600.099881:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c6e622f100 x1876324224429568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789402600 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789402600.099899:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6e3301800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789402600.099925:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789402600.099930:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224429440:0@lo:8:kworker.0 00000100:00080000:3.0:1789402600.099935:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6c99ad800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789402600.099941:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789402600.099959:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224429568:0@lo:8:kworker.0 00000100:00080000:0.0:1789402600.105667:0:12573:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789402600.105673:0:12573:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789402600.105677:0:12573:0:(import.c:65:import_set_state_nolock()) ffff93c6e3301800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789402600.105684:0:12573:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:0.0:1789402600.105690:0:12573:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789402600.105701:0:12573:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c6e3301800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402600.105720:0:12573:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6e622ed80 x1876324224433792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789402600.105735:0:12573:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789402600.105748:0:12573:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789402600.105750:0:12573:0:(import.c:65:import_set_state_nolock()) ffff93c6c99ad800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789402600.105754:0:12573:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:0.0:1789402600.105756:0:12573:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789402600.105760:0:12573:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c6c99ad800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402600.105770:0:12573:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6e622ce00 x1876324224433920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789402600.106072:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3314:1876324224433664:0@lo:400:kworker.0 00000100:00100000:1.0:1789402600.106138:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402600.106436:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224433664 00000100:00100000:0.0:1789402600.106444:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224433664 00000100:00100000:3.0:1789402600.106747:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224434048:0@lo:400:kworker.0 00000100:00100000:3.0:1789402600.106786:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402600.106813:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402600.106819:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224434176:0@lo:400:kworker.0 00000100:00100000:3.0:1789402600.106837:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402600.106864:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224434048 00000100:00100000:3.0:1789402600.106868:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224434048 00000100:00100000:3.0:1789402600.106893:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224434176 00000100:00100000:3.0:1789402600.106895:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224434176 00000100:00100000:3.0:1789402600.106911:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789402600.106918:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224434048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402600.106969:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224434048:12345-0@lo:400:kworker.0 Request processed in 50us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402600.106975:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789402600.106991:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789402600.106997:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402600.107021:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224434176:12345-0@lo:400:kworker.0 Request processed in 24us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402600.107026:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789402600.107062:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6e622d500 x1876324224434176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402600.107075:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224434176:0@lo:400:kworker.0 00010000:00080000:3.0:1789402600.107084:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6e622e680 x1876324224434048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402600.107110:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224434048:0@lo:400:kworker.0 00000100:00100000:3.0:1789402600.107132:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224433792:0@lo:8:kworker.0 00000100:00100000:3.0:1789402600.107163:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402600.107188:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224433920:0@lo:8:kworker.0 00000100:00100000:3.0:1789402600.107226:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402600.107260:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224433792 00000100:00100000:3.0:1789402600.107264:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224433792 00000100:00100000:3.0:1789402600.107279:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224433920 00000100:00100000:3.0:1789402600.107281:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224433920 00000100:00100000:3.0:1789402600.107290:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789402600.107294:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1876324224433792:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789402600.107317:0:15111:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1789402600.107369:0:15111:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f8d0d 00002000:00100000:3.0:1789402600.107381:0:15111:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93c6ddd7c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789402600.107385:0:15111:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789402600.107387:0:15111:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789402600.109673:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789402600.109694:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:3314:x1876324224433664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402600.109789:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:3314:x1876324224433664:12345-0@lo:400:kworker.0 Request processed in 104us (3651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402600.109797:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00002000:00080000:3.0:1789402600.111949:0:15111:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789402600.111985:0:15111:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd7d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789402600.112064:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876324224433792:12345-0@lo:8:kworker.0 Request processed in 4766us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402600.112074:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789402600.112102:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789402600.112107:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1876324224433920:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789402600.112124:0:15111:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789402600.112171:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1876324224433920:12345-0@lo:8:kworker.0 Request processed in 62us (4943us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789402600.112177:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789402600.114375:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6e622ed80 x1876324224433792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789402620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789402600.114390:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789402600.114398:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789402600.114409:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789402600.114433:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789402600.114438:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6e3301800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789402600.114466:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789402600.114472:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224433792:0@lo:8:kworker.0 00000100:00080000:2.0:1789402600.114498:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6c99ad800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789402600.114502:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789402600.114506:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224433920:0@lo:8:kworker.0 00000004:00080000:1.0:1789402600.117819:0:14449:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789402600.118120:0:14449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 505266774934ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789402600.118188:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3314:1876324224433664:0@lo:400:kworker.0 00000004:00080000:3.0:1789402600.120982:0:14450:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789402600.121012:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14450:1876324224434432:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789402600.121076:0:14450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402600.121103:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c8e5b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789402600.121318:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402600.121331:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224434304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402600.121383:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402600.121413:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224434432 00000100:00100000:3.0:1789402600.121420:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224434432 00000100:00100000:3.0:1789402600.121487:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789402600.121496:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14450:x1876324224434432:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789402600.122480:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224434304 00000100:00100000:1.0:1789402600.122489:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224434304 00000100:00100000:1.0:1789402600.122529:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402600.122538:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224434304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789402600.122566:0:15114:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402600.122630:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224434304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402600.122636:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789402600.122679:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6e31bd500 x1876324224434304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402600.122698:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224434304:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1789402600.127845:0:15111:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789402600.127855:0:15111:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789402600.127860:0:15111:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:0.0:1789402600.132515:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789402600.157780:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.157797:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.157818:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.157824:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.157832:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.157861:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.157886:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.157895:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.157921:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789402600.159016:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.159028:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.159042:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.159046:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.159051:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.159065:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.159075:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.159082:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.159318:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789402600.161250:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789402600.161268:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161284:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90de00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402600.161291:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161304:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161378:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161387:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5aa1442/0x9403f4af875f8d14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161420:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402600.161434:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161442:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402600.161445:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161453:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161464:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161473:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf1df15a/0x9403f4af875f8d1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.161487:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402600.161489:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402600.161496:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.163396:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789402600.166807:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.166845:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.166868:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.166873:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.166881:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.166899:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.166912:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.166920:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.166946:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789402600.166962:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402600.166968:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.166977:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402600.166992:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.167004:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.167026:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.167034:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.167067:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.167070:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.167073:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789402600.171482:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.171497:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.171519:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.171529:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.171536:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.171553:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.171565:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.171582:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.171611:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402600.171679:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.171694:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.171709:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.171714:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.171727:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.171754:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.171764:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.171797:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.171811:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.171814:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789402600.172307:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.172316:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.172327:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.172332:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.172337:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.172386:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.172395:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.172403:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.175366:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789402600.180058:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.180075:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.180728:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402600.180742:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.180755:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402600.180762:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.180775:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.180807:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.180816:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd97ce7/0x9403f4af875f8d30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.180875:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402600.180879:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402600.180881:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.183401:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.183418:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.183438:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.183465:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.183480:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.183488:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.183521:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402600.185099:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.185114:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.185130:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ca00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.185135:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.185147:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.185169:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.185177:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f8d37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.185204:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.185206:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.185207:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789402600.185253:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789402600.191628:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.191661:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191684:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.191700:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.191709:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191730:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191758:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191768:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191814:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789402600.191837:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402600.191848:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191860:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402600.191865:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191877:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191903:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191913:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b5f016f/0x9403f4af875f8d3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.191956:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.191968:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.191972:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789402600.198331:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.198369:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.198396:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.198402:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.198409:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.198439:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.200965:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.200992:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.201032:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789402600.201062:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402600.201069:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.201078:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90dc00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402600.201083:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.201109:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.201137:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.201146:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095185bf1/0x9403f4af875f8d45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.201175:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.201177:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.201179:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789402600.206435:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.206456:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.206480:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.206486:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.206495:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.206515:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.206527:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.206543:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.206577:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402600.206615:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.206690:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.206706:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d800 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.206728:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.206741:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.206764:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.206772:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d135c0/0x9403f4af875f8d4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.206800:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.206801:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.206803:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789402600.210718:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.210734:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.210756:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.210763:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.210772:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.210793:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.210805:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.210814:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.210844:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402600.210884:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.210901:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.210917:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.210922:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.210934:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789402600.211535:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789402600.211543:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.211562:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1789402600.211565:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.211570:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.211582:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.211593:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.211601:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.211630:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789402600.212071:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789402600.212072:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.212080:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.212109:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1789402600.212116:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dde250d/0x9403f4af875f8d53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.212117:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402600.212130:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.212153:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.212176:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.212184:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.212194:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789402600.213168:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789402600.213182:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213194:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402600.213199:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213227:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213250:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213258:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae7f8948/0x9403f4af875f8d5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213827:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402600.213833:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213841:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402600.213844:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213852:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213864:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213871:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4b7c33/0x9403f4af875f8d61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.213904:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402600.213906:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402600.213909:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402600.213922:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402600.225696:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.225711:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.225730:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.225735:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.225742:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.225758:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.225785:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.225793:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.225828:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789402600.227455:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402600.227466:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.227478:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402600.227483:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.227493:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.227513:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.227521:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8d68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.227541:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.227549:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.227551:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402600.229196:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.229210:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.229226:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.229230:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.229236:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.229251:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.229261:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.229268:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.229838:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789402600.233728:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.233741:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.233758:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.233763:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.233769:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.233784:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.233793:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.233801:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239479:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789402600.239493:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239508:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223c00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.239513:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239523:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239543:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239550:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf4d2a42/0x9403f4af875f8d6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239572:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.239576:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239582:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.239597:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239605:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239616:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.239624:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.239625:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.239627:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402600.246907:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789402600.246922:0:15111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0f012cc/0x9403f4af875f8d76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402600.247648:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.247656:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.247677:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.247682:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.247689:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.247704:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.247713:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.247720:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.250359:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402600.250375:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.250392:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402600.250396:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.250408:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.250441:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.250454:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.250456:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.250458:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402600.251970:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789402600.251983:0:15111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6343ae3/0x9403f4af875f8d7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.253719:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402600.255495:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.255508:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.255706:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.255712:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.255719:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.255898:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.255910:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.255918:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.256046:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789402600.256870:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.256878:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.256889:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.256893:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.256898:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.256910:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.256919:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.256937:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257187:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789402600.257196:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257205:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.257209:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257218:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257235:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257243:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9a1d712/0x9403f4af875f8d84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257272:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.257275:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257282:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222e00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.257286:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257293:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257303:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.257311:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.257312:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.257314:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402600.257506:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789402600.257519:0:15111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d9be94f/0x9403f4af875f8d8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402600.258335:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.258435:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.258447:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.258451:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.258456:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.258467:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.258476:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.258483:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.258652:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.258659:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.258667:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.258671:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.258692:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.258706:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.258716:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.258718:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.258720:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402600.258884:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789402600.258889:0:15111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa459a24/0x9403f4af875f8d92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402600.259374:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.259381:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.259390:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.259393:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.259398:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.259409:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.259418:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.259436:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.259884:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.259891:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.259899:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222a00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.259903:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.259912:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.259924:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.259978:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.259981:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.259983:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402600.260156:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789402600.260162:0:15111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8d99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402600.260986:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.260994:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.261006:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.261011:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.261015:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.261026:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.261035:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.261043:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.261241:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.261248:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.261263:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222800 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.261267:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.261276:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.261289:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.261297:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.261299:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.261301:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402600.261464:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789402600.261469:0:15111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fd4ae9/0x9403f4af875f8da0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402600.262126:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.262133:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.262152:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.262155:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.262160:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.262182:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.262190:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.262197:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.262643:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402600.262651:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.262660:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402600.262664:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.262680:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.262694:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.262702:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.262704:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.262706:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402600.262909:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789402600.262915:0:15111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416c7886/0x9403f4af875f8da7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.264019:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402600.266506:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402600.266704:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.266722:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789402600.266735:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402600.266741:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.266840:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.266850:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.266858:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402600.266879:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789402600.267160:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402600.267914:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.267928:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402600.267933:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.267943:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.268034:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.268042:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040700d4d/0x9403f4af875f8dae lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.268076:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.268078:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.268081:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402600.275626:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402600.275641:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.275657:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1789402600.275662:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402600.275669:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.275833:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.275846:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.275855:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.275880:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402600.276061:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.276068:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.276077:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.276082:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.276091:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.276107:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.276122:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088de64ad/0x9403f4af875f8db5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.276138:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.276140:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.276142:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402600.276415:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402600.276421:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.276450:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1789402600.276453:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402600.276458:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.276468:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.276476:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.276482:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.276505:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789402600.276655:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402600.276662:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.276671:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82c00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402600.276674:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.276683:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.276695:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.276702:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f1269f3/0x9403f4af875f8dbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.276715:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.276717:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.276719:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402600.277080:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402600.277087:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277096:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1789402600.277099:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402600.277103:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277113:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277132:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277140:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277160:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402600.277254:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.277260:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.277269:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.277272:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.277281:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.277292:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.277300:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a44fd408/0x9403f4af875f8dc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.277313:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.277315:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.277316:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402600.277836:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402600.277843:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277853:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1789402600.277856:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402600.277860:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277870:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277879:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277887:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.277917:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789402600.278047:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402600.278052:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.278071:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402600.278075:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.278083:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.278095:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.278102:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002db9425f/0x9403f4af875f8dca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402600.278117:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.278119:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402600.278120:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402600.278305:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402600.278311:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.278320:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1789402600.278323:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402600.278327:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.278337:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.278376:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.278384:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402600.278400:0:15111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402600.278443:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402600.278449:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.278457:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402600.278461:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.278469:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.278480:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.278488:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052fed5c0/0x9403f4af875f8dd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402600.278500:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.278501:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402600.278503:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789402600.278578:0:15111:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789402600.278673:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14450:x1876324224434432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 157175us (157594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402600.278697:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14450:1876324224434432:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789402600.278698:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:3.0:1789402600.278712:0:14450:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789402600.278838:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14450:1876324224434560:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789402600.278873:0:14450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402600.278975:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c9998840 going to sleep for 11 seconds 00000100:00100000:1.0:1789402600.282907:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224434560 00000100:00100000:1.0:1789402600.282924:0:15113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224434560 00000100:00100000:1.0:1789402600.283302:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789402600.283314:0:15113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14450:x1876324224434560:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789402600.283408:0:15113:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1789402600.292157:0:15113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14450:x1876324224434560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8840us (13277us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789402600.292177:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789402600.292293:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14450:1876324224434560:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789402600.292310:0:14450:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789402600.490226:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402601.507565:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402602.534843:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789402603.265322:0:15828:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789402603.265326:0:15828:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789402603.265463:0:15828:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c6ea347800 00000020:01000004:1.0:1789402603.265478:0:15828:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789402603.265491:0:15828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789402603.265504:0:15828:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93c6fb33cd40) 00000020:00000080:1.0:1789402603.265519:0:15828:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789402603.292653:0:15828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789402603.292919:0:15828:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789402603.296755:0:15828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789402603.298227:0:15828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789402603.298497:0:15828:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789402603.301628:0:15828:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 513: rc = 0 00100000:10000000:3.0:1789402603.301731:0:15828:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 513: rc = 0 00100000:10000000:3.0:1789402603.301829:0:15828:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:3.0:1789402603.302926:0:15828:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 479: rc = 0 00100000:10000000:3.0:1789402603.303257:0:15828:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 479: rc = 0 00100000:10000000:3.0:1789402603.305539:0:15828:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 479: rc = 0 00100000:10000000:3.0:1789402603.305818:0:15828:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 479: rc = 0 00100000:10000000:3.0:1789402603.306559:0:15828:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 479: rc = 0 00100000:10000000:3.0:1789402603.306866:0:15828:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 479: rc = 0 00000020:00000080:3.0:1789402603.307825:0:15828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789402603.307837:0:15828:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789402603.307847:0:15828:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9403f4af875f8ddf 00000020:01000004:3.0:1789402603.307855:0:15828:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789402603.307876:0:15828:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.108@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789402603.307879:0:15828:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789402603.307885:0:15828:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789402603.307903:0:15828:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789402603.307907:0:15828:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.108@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789402603.324192:0:15828:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789402603.324234:0:15828:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.108@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789402603.324239:0:15828:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789402603.324241:0:15828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402603.324242:0:15828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402603.324243:0:15828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402603.324245:0:15828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402603.324246:0:15828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402603.324247:0:15828:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402603.324249:0:15828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402603.324250:0:15828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789402603.324254:0:15828:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789402603.324263:0:15828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789402603.324264:0:15828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402603.324265:0:15828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402603.324266:0:15828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402603.324267:0:15828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402603.324268:0:15828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402603.324269:0:15828:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402603.324269:0:15828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402603.324270:0:15828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789402603.324311:0:15828:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789402603.324333:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224434688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789402603.324442:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402603.324566:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d13b1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789402603.325304:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224434688 00000100:00100000:2.0:1789402603.325325:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224434688 00000100:00100000:2.0:1789402603.328821:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789402603.328840:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15828:x1876324224434688:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789402603.328875:0:14421:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789402603.328879:0:14421:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789402603.328882:0:14421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789402603.341979:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15828:x1876324224434688:12345-0@lo:253:mount.lustre.0 Request processed in 13137us (17527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402603.341992:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789402603.342208:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224434688:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789402603.342223:0:15828:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789402603.342226:0:15828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789402603.342228:0:15828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402603.342229:0:15828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402603.342231:0:15828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402603.342233:0:15828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402603.342234:0:15828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402603.342235:0:15828:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402603.342237:0:15828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402603.342238:0:15828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789402603.342258:0:15828:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c6ea347800 from lustre-OST0001 10000000:01000000:3.0:1789402603.342285:0:15828:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789402603.342288:0:15828:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789402603.342296:0:15828:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c6fb338000 local copy 00010000:00010000:3.0:1789402603.342306:0:15828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402603.342595:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224434816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402603.342632:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402603.342663:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e32aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402603.342811:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224434816 00000100:00100000:1.0:1789402603.342818:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224434816 00000100:00100000:1.0:1789402603.342861:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789402603.342871:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15828:x1876324224434816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402603.343046:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15828:x1876324224434816:12345-0@lo:501:mount.lustre.0 Request processed in 176us (412us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789402603.343060:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789402603.344090:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224434816:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789402603.344112:0:15828:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789402603.344305:0:15828:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789402603.344314:0:15828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402603.344324:0:15828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6e6223a00/0x9403f4af875f8b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8b8c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402603.344360:0:15828:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c6ea347800 10000000:01000000:3.0:1789402603.344365:0:15828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789402603.344370:0:15828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789402603.344372:0:15828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789402603.344376:0:15828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789402603.344378:0:15828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789402603.344419:0:15828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c600/0x9403f4af875f8de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402603.344427:0:15828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c600/0x9403f4af875f8de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402603.344436:0:15828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c600/0x9403f4af875f8de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402603.344453:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224434944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789402603.344493:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402603.344522:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e32aa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402603.344589:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224434944 00000100:00100000:2.0:1789402603.344596:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224434944 00000100:00100000:2.0:1789402603.344640:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789402603.344649:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:15828:x1876324224434944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789402603.344661:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402603.344673:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f8ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8de6 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.344694:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f8ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8de6 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.344705:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3de800/0x9403f4af875f8ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8de6 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.344713:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de800, rc 0) 00000100:00100000:2.0:1789402603.344758:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224434944:12345-0@lo:101:mount.lustre.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402603.344764:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789402603.346544:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224434944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789402603.346567:0:15828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c600/0x9403f4af875f8de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8ded expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402603.346592:0:15828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c600/0x9403f4af875f8de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8ded expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789402603.347268:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789402603.348056:0:15828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789402603.348304:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789402603.348374:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789402603.348441:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789402603.348483:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789402603.348517:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789402603.348547:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789402603.348610:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789402603.348618:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789402603.348691:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402603.348751:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402603.348786:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e32aacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402603.349290:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224435072 00000100:00100000:1.0:1789402603.349298:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224435072 00000100:00100000:1.0:1789402603.349367:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789402603.349377:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224435072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402603.349720:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224435072:12345-0@lo:501:mount.lustre.0 Request processed in 344us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402603.349727:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789402603.351365:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402603.351558:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402603.351622:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402603.351691:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e32aacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402603.351724:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224435200 00000100:00100000:1.0:1789402603.353022:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224435200 00000100:00100000:1.0:1789402603.356358:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789402603.356374:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224435200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789402603.356815:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224435200:12345-0@lo:503:mount.lustre.0 Request processed in 445us (5192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402603.356823:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789402603.357212:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435200:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789402603.357792:0:15828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789402603.357875:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402603.357924:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402603.358172:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9950c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789402603.358467:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224435328 00000100:00100000:2.0:1789402603.358475:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224435328 00000100:00100000:2.0:1789402603.358527:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789402603.358536:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224435328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789402603.358739:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224435328:12345-0@lo:502:mount.lustre.0 Request processed in 204us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402603.358747:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789402603.359335:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402603.359622:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789402603.359676:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789402603.359710:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789402603.359766:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789402603.359805:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789402603.359841:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789402603.359920:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789402603.360159:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789402603.360207:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789402603.360244:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402603.360302:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402603.360337:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd9950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402603.360472:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224435456 00000100:00100000:3.0:1789402603.360479:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224435456 00000100:00100000:3.0:1789402603.360525:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789402603.360533:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6dd990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224435456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789402603.360713:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6dd990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224435456:12345-0@lo:502:mount.lustre.0 Request processed in 180us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402603.360729:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789402603.360858:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402603.361146:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789402603.361161:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789402603.367745:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789402603.367757:0:15829:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789402603.367763:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.367765:0:15829:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789402603.367773:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789402603.367788:0:15829:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93c7019c4d40) 00000020:00000080:2.0:1789402603.367864:0:15829:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789402603.367871:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789402603.367940:0:15829:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6ea347800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789402603.367949:0:15829:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789402603.367956:0:15829:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9403f4af875f8dfb 00010000:00010000:2.0:1789402603.373805:0:15829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789402603.379683:0:15829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789402603.386661:0:15829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789402603.388119:0:15829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789402603.388130:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402603.388136:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.388138:0:15829:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789402603.388141:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789402603.388144:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.388146:0:15829:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789402603.388149:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789402603.388150:0:15829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789402603.388153:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402603.388155:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.388156:0:15829:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789402603.388165:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789402603.388168:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.388170:0:15829:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789402603.388174:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789402603.388226:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402603.388229:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.388231:0:15829:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789402603.388234:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789402603.388642:0:15828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789402603.388667:0:15828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789402603.388688:0:15828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c600/0x9403f4af875f8de6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8ded expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.388709:0:15828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6fb90c600/0x9403f4af875f8de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8ded expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789402603.388717:0:15828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6ea347800 from 1 10000000:01000000:0.0:1789402603.388720:0:15828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789402603.388754:0:15828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.388762:0:15828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.388772:0:15828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402603.388796:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789402603.388862:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402603.388903:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995300 going to sleep for 11 seconds 00000100:00100000:1.0:1789402603.389027:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224435584 00000100:00100000:1.0:1789402603.389034:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224435584 00000100:00100000:1.0:1789402603.389087:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789402603.389097:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6dd990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:15828:x1876324224435584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789402603.389111:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402603.389122:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8e02 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402603.389145:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8e02 expref: 18 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402603.389156:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8e02 expref: 18 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402603.389172:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6e6223400, rc 0) 00000100:00100000:1.0:1789402603.389213:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6dd990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224435584:12345-0@lo:101:mount.lustre.0 Request processed in 118us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402603.389220:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789402603.390193:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789402603.390214:0:15828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.390225:0:15828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789402603.390767:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789402603.391060:0:15828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789402603.391299:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789402603.391364:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789402603.391453:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789402603.391461:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789402603.391525:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789402603.391581:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402603.391623:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995300 going to sleep for 11 seconds 00000100:00100000:3.0:1789402603.391895:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224435712 00000100:00100000:3.0:1789402603.391903:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224435712 00000100:00100000:3.0:1789402603.391955:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789402603.391966:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6dd991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224435712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789402603.392177:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6dd991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224435712:12345-0@lo:501:mount.lustre.0 Request processed in 213us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402603.392185:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789402603.392507:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789402603.392541:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789402603.392578:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402603.392604:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995300 going to sleep for 11 seconds 00000100:00100000:3.0:1789402603.392663:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224435840 00000100:00100000:3.0:1789402603.392668:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224435840 00000100:00100000:3.0:1789402603.392700:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789402603.392707:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6dd991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224435840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402603.392848:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6dd991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224435840:12345-0@lo:503:mount.lustre.0 Request processed in 141us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402603.392855:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789402603.392961:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435840:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789402603.393427:0:15828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789402603.393480:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402603.393513:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402603.393534:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995300 going to sleep for 11 seconds 00000100:00100000:2.0:1789402603.393607:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224435968 00000100:00100000:2.0:1789402603.393612:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224435968 00000100:00100000:2.0:1789402603.393638:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789402603.393644:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6dd992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224435968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789402603.393779:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6dd992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224435968:12345-0@lo:502:mount.lustre.0 Request processed in 134us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402603.393786:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789402603.393976:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224435968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402603.394191:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789402603.394237:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789402603.394286:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789402603.394321:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789402603.394498:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789402603.394549:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789402603.394584:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789402603.394617:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789402603.394643:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402603.394691:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402603.394760:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995300 going to sleep for 11 seconds 00000100:00100000:2.0:1789402603.398977:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224436096 00000100:00100000:2.0:1789402603.398991:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224436096 00000100:00100000:2.0:1789402603.399045:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789402603.399056:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224436096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789402603.399307:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224436096:12345-0@lo:502:mount.lustre.0 Request processed in 252us (4614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402603.399315:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789402603.399869:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402603.400033:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789402603.400049:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789402603.407287:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789402603.407300:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.407302:0:15833:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789402603.407309:0:15833:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6ea347800 00000020:00000080:2.0:1789402603.407311:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789402603.407317:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402603.407320:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.407321:0:15833:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789402603.407332:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789402603.407335:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.407336:0:15833:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789402603.407339:0:15833:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6ea347800 00000020:00000080:2.0:1789402603.407362:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789402603.407417:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402603.407420:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.407421:0:15833:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789402603.407424:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789402603.407426:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.407427:0:15833:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789402603.407431:0:15833:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c6ea347800 00000020:00000080:2.0:1789402603.407432:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789402603.407464:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789402603.407467:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789402603.407468:0:15833:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789402603.407471:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789402603.407911:0:15828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789402603.407944:0:15828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789402603.407961:0:15828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402603.407973:0:15828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789402603.408011:0:15828:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789402603.408013:0:15828:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c6ea347800 10000000:01000000:1.0:1789402603.408016:0:15828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c6ea347800 10000000:01000000:1.0:1789402603.408019:0:15828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789402603.408024:0:15828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6ea347800 from 1 10000000:01000000:1.0:1789402603.408026:0:15828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789402603.408069:0:15828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223c00/0x9403f4af875f8e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402603.408077:0:15828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6e6223c00/0x9403f4af875f8e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402603.408088:0:15828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6e6223c00/0x9403f4af875f8e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402603.408110:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789402603.408176:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402603.408216:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6d81a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1789402603.413550:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224436224 00000100:00100000:0.0:1789402603.413563:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224436224 00000100:00100000:0.0:1789402603.413615:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789402603.413626:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224436224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789402603.413642:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402603.413660:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a82400/0x9403f4af875f8e17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8e10 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.413688:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a82400/0x9403f4af875f8e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8e10 expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.413699:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a82400/0x9403f4af875f8e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8e10 expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.413708:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82400, rc 0) 00000100:00100000:0.0:1789402603.413775:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224436224:12345-0@lo:101:mount.lustre.0 Request processed in 152us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402603.413782:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789402603.421155:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789402603.421186:0:15828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6e6223c00/0x9403f4af875f8e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8e17 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402603.421199:0:15828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6e6223c00/0x9403f4af875f8e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8e17 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789402603.433798:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789402603.439133:0:15828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789402603.439558:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789402603.439605:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789402603.439638:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789402603.439677:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789402603.439706:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789402603.439745:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789402603.439778:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789402603.439808:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789402603.439856:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789402603.439893:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789402603.439939:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789402603.439989:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789402603.440027:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789402603.443456:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789402603.443539:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789402603.443568:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789402603.443593:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789402603.443628:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789402603.443654:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789402603.443680:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789402603.443731:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789402603.443758:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789402603.443785:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789402603.443824:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789402603.443851:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789402603.443877:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789402603.443932:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789402603.443959:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789402603.443985:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789402603.444019:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789402603.444046:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789402603.444071:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789402603.444096:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789402603.444130:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789402603.444157:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789402603.444212:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789402603.444243:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789402603.444322:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789402603.444329:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789402603.446461:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402603.446528:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402603.446602:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c2378300 going to sleep for 11 seconds 00000100:00100000:0.0:1789402603.450872:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224436352 00000100:00100000:0.0:1789402603.450886:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224436352 00000100:00100000:0.0:1789402603.451011:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789402603.451022:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224436352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789402603.451413:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224436352:12345-0@lo:501:mount.lustre.0 Request processed in 381us (4872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402603.451421:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789402603.451836:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789402603.451886:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789402603.451930:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402603.451965:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c2378300 going to sleep for 11 seconds 00000100:00100000:3.0:1789402603.452011:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224436480 00000100:00100000:3.0:1789402603.452017:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224436480 00000100:00100000:3.0:1789402603.452060:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789402603.452069:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224436480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789402603.452223:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224436480:12345-0@lo:503:mount.lustre.0 Request processed in 154us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402603.452231:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789402603.452337:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436480:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789402603.453620:0:15828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789402603.453694:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789402603.453752:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402603.453775:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c2378300 going to sleep for 11 seconds 00000100:00100000:0.0:1789402603.453847:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224436608 00000100:00100000:0.0:1789402603.453853:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224436608 00000100:00100000:0.0:1789402603.453890:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789402603.453898:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224436608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402603.454103:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224436608:12345-0@lo:502:mount.lustre.0 Request processed in 205us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402603.454112:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789402603.454181:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402603.454438:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789402603.454486:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789402603.454520:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789402603.454567:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789402603.454605:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789402603.454650:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789402603.454685:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789402603.454718:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789402603.454761:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789402603.454799:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789402603.454833:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789402603.454898:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789402603.454934:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789402603.454967:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789402603.455013:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789402603.455047:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789402603.455084:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789402603.455148:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789402603.455187:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789402603.455220:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789402603.455269:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789402603.455306:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789402603.455381:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789402603.455448:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789402603.455486:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789402603.455519:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789402603.455565:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789402603.455615:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789402603.455649:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789402603.455694:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789402603.455730:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789402603.455761:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789402603.455795:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789402603.455842:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789402603.455878:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789402603.455923:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789402603.455958:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789402603.455993:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789402603.456040:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789402603.456078:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789402603.456119:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402603.456178:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402603.456222:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224436736 00000100:00100000:0.0:1789402603.456228:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224436736 00000100:00100000:0.0:1789402603.456257:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789402603.456265:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224436736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789402603.456489:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224436736:12345-0@lo:502:mount.lustre.0 Request processed in 224us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402603.456498:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789402603.456536:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995300 going to sleep for 11 seconds 00000100:00100000:0.0:1789402603.456554:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224436736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789402603.456614:0:15828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789402603.456629:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789402603.461302:0:15838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789402603.461321:0:15838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93c7019c3380) 00000020:00000080:2.0:1789402603.461436:0:15838:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789402603.461538:0:15838:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6ea347800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789402603.461542:0:15838:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6ea347800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789402603.461544:0:15838:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6ea347800 3 00010000:00080000:2.0:1789402603.461571:0:15838:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c5c2003800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.108@tcp at head 00010000:00010000:2.0:1789402603.466859:0:15838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789402603.467137:0:15838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789402603.467179:0:15838:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789402603.467193:0:15838:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9403f4af875f8e25 00000100:00080000:2.0:1789402603.467205:0:15838:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789402603.467217:0:15838:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93c5c2003800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:2.0:1789402603.467254:0:15838:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6da91c380 x1876324224436864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789402603.467327:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876324224436864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789402603.467437:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789402603.467613:0:15838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789402603.467712:0:12573:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789402603.467717:0:12573:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789402603.467720:0:12573:0:(import.c:65:import_set_state_nolock()) ffff93c6c99ad800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789402603.467724:0:12573:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:1.0:1789402603.467728:0:12573:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789402603.467734:0:12573:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c6c99ad800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:1.0:1789402603.467750:0:12573:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6fb1f8000 x1876324224437120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789402603.469205:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224437120:0@lo:8:kworker.0 00000100:00100000:3.0:1789402603.469272:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402603.469330:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224436864 00000100:00100000:3.0:1789402603.469338:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224436864 00000100:00100000:3.0:1789402603.469389:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789402603.469397:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876324224436864:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789402603.469436:0:14427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:3.0:1789402603.469470:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9403f4af875f8e2c 00000004:00100000:3.0:1789402603.469485:0:14427:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789402603.469516:0:14427:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd66000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789402603.469565:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876324224436864:12345-0@lo:38:llog_process_th.0 Request processed in 167us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402603.469573:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789402603.469618:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6da91c380 x1876324224436864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789402613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789402603.469628:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789402603.469635:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789402603.469643:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789402603.469647:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789402603.469650:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c5c2003800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789402603.469656:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876324224436864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789402603.470183:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402603.470196:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224436992:0@lo:400:kworker.0 00000100:00100000:1.0:1789402603.470231:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402603.470262:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224437248:0@lo:400:kworker.0 00000100:00100000:1.0:1789402603.470285:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402603.470303:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789402603.470309:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224437376:0@lo:400:kworker.0 00000100:00100000:1.0:1789402603.470329:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402603.470385:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224437120 00000100:00100000:1.0:1789402603.470391:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224437120 00000100:00100000:1.0:1789402603.470423:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224436992 00000100:00100000:1.0:1789402603.470426:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224436992 00000100:00100000:1.0:1789402603.470455:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402603.470462:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224436992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402603.470514:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1876324224436992:12345-0@lo:400:kworker.0 Request processed in 52us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402603.470529:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789402603.470546:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789402603.470550:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1876324224437120:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789402603.470585:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1876324224437120:12345-0@lo:8:kworker.0 Request processed in 33us (1313us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789402603.470590:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789402603.470607:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224437248 00000100:00100000:1.0:1789402603.470610:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224437248 00000100:00100000:1.0:1789402603.470631:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224437376 00000100:00100000:1.0:1789402603.470634:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224437376 00000100:00100000:1.0:1789402603.470646:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789402603.470651:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224437248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402603.470680:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224437248:12345-0@lo:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402603.470685:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789402603.470695:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789402603.470700:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224437376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402603.470723:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224437376:12345-0@lo:400:kworker.0 Request processed in 22us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402603.470728:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789402603.470842:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224436992:0@lo:400:kworker.0 00010000:00080000:1.0:1789402603.470865:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6fb1f8700 x1876324224437376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402603.470874:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224437376:0@lo:400:kworker.0 00010000:00080000:1.0:1789402603.470882:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c6fb1f9c00 x1876324224437248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402603.470896:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224437248:0@lo:400:kworker.0 00000100:00080000:0.0:1789402603.471010:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789402603.471015:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789402603.471173:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789402603.471179:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6c99ad800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789402603.471184:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789402603.471187:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224437120:0@lo:8:kworker.0 00000040:00080000:0.0:1789402603.475913:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789402603.476161:0:15828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789402603.476206:0:15828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789402603.476229:0:15828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6e6223c00/0x9403f4af875f8e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8e17 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402603.476242:0:15828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6e6223c00/0x9403f4af875f8e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8e17 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789402603.476290:0:15828:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789402603.476292:0:15828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402603.476294:0:15828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402603.476295:0:15828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402603.476297:0:15828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402603.476298:0:15828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402603.476299:0:15828:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402603.476301:0:15828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402603.476302:0:15828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789402603.476306:0:15828:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789402603.476308:0:15828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789402603.476309:0:15828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789402603.476310:0:15828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789402603.476311:0:15828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789402603.476313:0:15828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789402603.476314:0:15828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789402603.476315:0:15828:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789402603.476316:0:15828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789402603.476317:0:15828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789402603.476371:0:15828:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789402603.476390:0:15828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224437504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789402603.476469:0:15828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402603.476503:0:15828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e32aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402603.476570:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224437504 00000100:00100000:1.0:1789402603.476577:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224437504 00000100:00100000:1.0:1789402603.476626:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789402603.476637:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:15828:x1876324224437504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789402603.476675:0:14421:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789402603.476688:0:14421:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789402603.508639:0:14421:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789402603.508654:0:14421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789402603.508728:0:14443:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789402603.508733:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789402603.508755:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.508773:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8cff expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.508781:0:14443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.508824:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f8cff expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402603.508838:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f8cff expref: 19 pid: 14422 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402603.508851:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14443:1876324224437632:0@lo:104: 00000100:00100000:0.0:1789402603.508911:0:14443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402603.508953:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6dd995300 going to sleep for 11 seconds 00000100:00100000:3.0:1789402603.509110:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224437632 00000100:00100000:3.0:1789402603.509117:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224437632 00000100:00100000:3.0:1789402603.509166:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789402603.509186:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:14443:x1876324224437632:12345-0@lo:104: 00010000:00010000:3.0:1789402603.509200:0:14411:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402603.509262:0:14411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789402603.509268:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:14443:x1876324224437632:12345-0@lo:104: Request processed in 83us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402603.509274:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789402603.509332:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402603.509339:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509374:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90cc00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:2.0:1789402603.509379:0:14416:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509387:0:14416:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789402603.509395:0:14416:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402603.509412:0:14416:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789402603.509444:0:14416:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509450:0:14416:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789402603.509469:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509476:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6fb90cc00/0x9403f4af875f8cff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8d06 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509492:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402603.509494:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402603.509495:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402603.509514:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3313:1876324224437760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789402603.509543:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402603.509582:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224437760 00000100:00100000:2.0:1789402603.509586:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224437760 00010000:00010000:2.0:1789402603.509604:0:14413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8cff expref: 20 pid: 14422 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402603.509623:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789402603.509629:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+20:3313:x1876324224437760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402603.509639:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402603.509643:0:14413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8cff expref: 20 pid: 14422 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509652:0:14413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f8cff expref: 20 pid: 14422 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509667:0:14413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509674:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789402603.509687:0:14413:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001866383s 00010000:00010000:2.0:1789402603.509691:0:14413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509697:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509703:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509718:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509723:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82c00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402603.509728:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509735:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509743:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509752:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402603.509779:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+20:3313:x1876324224437760:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402603.509785:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789402603.509817:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3313:1876324224437760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402603.509842:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6ef3dea00/0x9403f4af875f8d06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f8cff expref: 19 pid: 14422 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402603.509851:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14443:1876324224437632:0@lo:104: 00010000:00010000:2.0:1789402603.509863:0:14443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509871:0:14443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509886:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402603.509892:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402603.528564:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:15828:x1876324224437504:12345-0@lo:253:mount.lustre.0 Request processed in 51922us (52087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402603.528580:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789402603.528683:0:15828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:15828:1876324224437504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789402603.528698:0:15828:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789402603.528701:0:15828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789402603.528703:0:15828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789402603.528704:0:15828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789402603.528706:0:15828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789402603.528707:0:15828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789402603.528709:0:15828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789402603.528710:0:15828:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789402603.528712:0:15828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789402603.528713:0:15828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789402603.528725:0:15828:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789402603.535448:0:15828:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789402603.535628:0:15828:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789402603.536187:0:15828:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402603.536535:0:15828:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789402603.536740:0:15828:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789402603.537220:0:15828:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789402603.538252:0:15828:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1789402603.555584:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789402603.595165:0:15828:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789402603.595173:0:15828:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789402603.595207:0:15828:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789402603.595264:0:15828:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.108@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789402603.595276:0:15828:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789402603.595301:0:15828:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:3.0:1789402604.395706:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789402604.395788:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789402604.580592:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789402605.091424:0:14424:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789402605.091434:0:14424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6ffaae000 from 8 10000000:01000000:3.0:1789402605.091441:0:14424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789402605.091517:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90dc00/0x9403f4af875f8e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402605.091530:0:14424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6fb90dc00/0x9403f4af875f8e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402605.091542:0:14424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6fb90dc00/0x9403f4af875f8e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402605.091572:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224437888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789402605.091669:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402605.091737:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c2403540 going to sleep for 11 seconds 00000100:00100000:0.0:1789402605.092337:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224437888 00000100:00100000:0.0:1789402605.092509:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224437888 00000100:00100000:0.0:1789402605.092609:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789402605.092629:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:14424:x1876324224437888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402605.092648:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402605.092669:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8e3a expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402605.092701:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8e3a expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402605.092713:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a82c00/0x9403f4af875f8e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8e3a expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402605.092723:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82c00, rc 0) 00000100:00100000:0.0:1789402605.092782:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:14424:x1876324224437888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402605.092789:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789402605.093044:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224437888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402605.093065:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6fb90dc00/0x9403f4af875f8e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8e41 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402605.093077:0:14424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6fb90dc00/0x9403f4af875f8e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8e41 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402605.093227:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224438016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789402605.093275:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402605.099454:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224438016 00000100:00100000:1.0:1789402605.099476:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224438016 00000100:00100000:1.0:1789402605.099552:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789402605.099563:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:14424:x1876324224438016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789402605.099597:0:14420:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789402605.099622:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789402605.099626:0:14420:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789402605.099807:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:14424:x1876324224438016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 244us (6530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402605.099816:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789402605.103292:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb81c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789402605.103379:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224438016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789402605.103507:0:14424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789402605.103520:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6fb90dc00/0x9403f4af875f8e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8e41 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402605.103549:0:14424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6fb90dc00/0x9403f4af875f8e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8e41 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402605.284633:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224438144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789402605.284747:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402605.284998:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224438144 00000100:00100000:1.0:1789402605.285018:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224438144 00000100:00100000:1.0:1789402605.285106:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402605.285118:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224438144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789402605.285165:0:15114:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402605.285227:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224438144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402605.285234:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402605.285282:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789402605.285311:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224438144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789402605.289780:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789402605.606237:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402606.637413:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789402607.077053:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789402607.651641:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402608.674527:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789402608.870322:0:12573:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789402608.870418:0:12573:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789402608.870423:0:12573:0:(import.c:65:import_set_state_nolock()) ffff93c6c99ad800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789402608.870440:0:12573:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c6c99ad800 using connection 192.168.203.108@tcp/0@lo 00000100:00100000:0.0:1789402608.870466:0:12573:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c6e622e680 x1876324224438528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789402608.870539:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224438528:0@lo:8:kworker.0 00000100:00100000:0.0:1789402608.870602:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402608.870672:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224438656:0@lo:400:kworker.0 00000100:00100000:0.0:1789402608.870724:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402608.870752:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402608.870760:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224438784:0@lo:400:kworker.0 00000100:00100000:0.0:1789402608.870792:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402608.873146:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3315:1876324224438272:0@lo:400:kworker.0 00000100:00100000:1.0:1789402608.873203:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402608.873238:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224438912:0@lo:400:kworker.0 00000100:00100000:1.0:1789402608.873266:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402608.873288:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789402608.873294:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224438400:0@lo:400:kworker.0 00000100:00100000:1.0:1789402608.873314:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402608.873385:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224438528 00000100:00100000:1.0:1789402608.873393:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224438528 00000100:00100000:1.0:1789402608.873428:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224438400 00000100:00100000:1.0:1789402608.873430:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224438400 00000100:00100000:1.0:1789402608.873464:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402608.873474:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224438400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402608.873524:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224438400:12345-0@lo:400:kworker.0 Request processed in 51us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402608.873538:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402608.873555:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789402608.873559:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1876324224438528:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789402608.873584:0:15112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1789402608.873613:0:15112:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9403f4af875f8e48 00002000:00100000:1.0:1789402608.873626:0:15112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93c5c22ca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789402608.873630:0:15112:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789402608.873633:0:15112:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789402608.875141:0:15112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789402608.875173:0:15112:0:(import.c:65:import_set_state_nolock()) ffff93c5c22cf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402608.875236:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876324224438528:12345-0@lo:8:kworker.0 Request processed in 1673us (4633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402608.875245:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789402608.875277:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224438656 00000100:00100000:1.0:1789402608.875282:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224438656 00000100:00100000:1.0:1789402608.875304:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224438784 00000100:00100000:1.0:1789402608.875306:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224438784 00000100:00100000:1.0:1789402608.875319:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224438912 00000100:00100000:1.0:1789402608.875322:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224438912 00000100:00100000:1.0:1789402608.875335:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789402608.875354:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224438656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402608.875404:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224438656:12345-0@lo:400:kworker.0 Request processed in 62us (4680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402608.875410:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789402608.875421:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789402608.875427:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224438784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402608.875464:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224438784:12345-0@lo:400:kworker.0 Request processed in 38us (4673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402608.875469:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789402608.875479:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789402608.875484:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224438912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402608.875506:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224438912:12345-0@lo:400:kworker.0 Request processed in 22us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402608.875511:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789402608.875573:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224438272 00000100:00100000:1.0:1789402608.875577:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224438272 00000100:00100000:1.0:1789402608.875601:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789402608.875607:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3315:x1876324224438272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402608.875634:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3315:x1876324224438272:12345-0@lo:400:kworker.0 Request processed in 28us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402608.875640:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789402608.875669:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789402608.875673:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402608.875701:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224438400:0@lo:400:kworker.0 00000100:00100000:1.0:1789402608.875711:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3315:1876324224438272:0@lo:400:kworker.0 00010000:00080000:1.0:1789402608.875723:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e622f480 x1876324224438912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402608.875733:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224438912:0@lo:400:kworker.0 00010000:00080000:1.0:1789402608.875766:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e622e680 x1876324224438528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789402633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789402608.875789:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789402608.875796:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789402608.875801:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789402608.875804:0:3312:0:(import.c:65:import_set_state_nolock()) ffff93c6c99ad800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789402608.878044:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789402608.878061:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876324224438528:0@lo:8:kworker.0 00010000:00080000:1.0:1789402608.878130:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e622f100 x1876324224438784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402608.878143:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224438784:0@lo:400:kworker.0 00010000:00080000:1.0:1789402608.878157:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6e622d500 x1876324224438656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789402624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402608.878165:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224438656:0@lo:400:kworker.0 00000004:00080000:1.0:1789402608.878231:0:14452:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789402608.878254:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14452:1876324224439168:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789402608.878308:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402608.878333:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c998fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789402608.878372:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789402608.878399:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402608.878433:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224439040 00000100:00100000:1.0:1789402608.878439:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224439040 00000100:00100000:1.0:1789402608.878496:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789402608.878504:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876324224439040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402608.878537:0:15114:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402608.878595:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876324224439040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402608.878602:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789402608.878621:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789402608.878648:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6fb1fbb80 x1876324224439040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789402624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789402608.878661:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789402608.880217:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224439168 00000100:00100000:1.0:1789402608.880226:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224439168 00000100:00100000:1.0:1789402608.880259:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789402608.880267:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14452:x1876324224439168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789402608.882642:0:15112:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789402608.882652:0:15112:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789402608.882657:0:15112:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000004:00080000:0.0:1789402608.888310:0:14451:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789402608.888820:0:14451:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 514037475178ns, next at 0ns, rc = 0 00002000:00010000:1.0:1789402608.898034:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.898045:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.898062:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.898066:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.898072:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.898090:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.898102:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.898116:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.898141:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789402608.898403:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402608.898411:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.898421:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402608.898426:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.898437:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.898456:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.898464:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.898483:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.898485:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.898487:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402608.902866:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402608.902884:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.902900:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=514s v=(0 0) 00010000:00010000:0.0:1789402608.902906:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402608.902912:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.902926:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.902936:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.902944:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.902962:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789402608.902976:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402608.902982:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.902989:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402608.902994:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.903003:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.903028:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.903036:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a523c456/0x9403f4af875f8e56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.903054:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.903057:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.903060:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402608.904409:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402608.904419:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904431:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=514s v=(0 0) 00010000:00010000:0.0:1789402608.904436:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402608.904442:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904455:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904465:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904472:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904498:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789402608.904508:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402608.904513:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904520:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83c00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402608.904524:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904532:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904545:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904552:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c74e588/0x9403f4af875f8e5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.904566:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.904567:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.904569:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402608.905043:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402608.905050:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905059:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=514s v=(0 0) 00010000:00010000:0.0:1789402608.905068:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402608.905073:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905082:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905090:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905096:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905110:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789402608.905120:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402608.905125:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905131:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82a00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402608.905134:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905141:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905152:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905172:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca966079/0x9403f4af875f8e64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.905185:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.905187:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.905189:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402608.906704:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402608.906714:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906725:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=514s v=(0 0) 00010000:00010000:0.0:1789402608.906730:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402608.906735:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906747:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906756:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906763:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906779:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789402608.906789:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402608.906800:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906808:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402608.906812:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906821:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906835:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906843:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a6273c0/0x9403f4af875f8e6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.906859:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.906861:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.906862:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789402608.911005:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789402608.911019:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911036:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=514s v=(0 0) 00010000:00010000:0.0:1789402608.911041:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402608.911047:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911076:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911087:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911094:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911112:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789402608.911126:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402608.911132:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911153:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83a00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402608.911158:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911166:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911184:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911191:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fffd8dba/0x9403f4af875f8e72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.911221:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.911224:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.911227:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.914660:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.914673:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.914690:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.914694:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.914701:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.914717:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.914727:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.914735:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.914754:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789402608.915265:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.915273:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.915280:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402608.915290:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.915291:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.915299:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.915309:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.915309:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222a00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402608.915318:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.915323:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.915335:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.915338:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.915381:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.926140:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789402608.926768:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.926778:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.926794:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.926799:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.926805:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.926819:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.926841:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.926849:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.926859:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789402608.927122:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927131:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddbdb2e4/0x9403f4af875f8e79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927151:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789402608.927156:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927164:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222800 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402608.927174:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927183:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927193:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927201:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035fd4ae9/0x9403f4af875f8e80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927212:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789402608.927215:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927221:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402608.927224:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927232:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927240:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927247:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416c7886/0x9403f4af875f8e87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402608.927266:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.927268:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.927270:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402608.927279:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.930184:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.930196:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930213:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.930217:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.930223:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930237:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930247:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930255:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930284:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.930296:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.930301:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930309:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.930313:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930322:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930338:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930374:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040700d4d/0x9403f4af875f8e8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930391:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.930393:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.930395:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.930800:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.930806:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930814:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.930822:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.930827:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930837:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930844:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930852:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.930866:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.930875:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.931789:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.931802:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.931806:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.931814:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.931828:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.931848:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa459a24/0x9403f4af875f8e95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.931869:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.931870:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.931872:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.935704:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.935715:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935732:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.935736:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.935742:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935755:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935765:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935773:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935792:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.935803:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.935816:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935823:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222e00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.935827:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935836:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935851:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935859:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d9be94f/0x9403f4af875f8e9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.935877:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.935878:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.936210:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.936633:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.936640:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936649:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.936652:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.936656:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936677:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936686:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936692:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936707:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.936715:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.936719:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936725:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223200 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.936728:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936735:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936746:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936753:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6343ae3/0x9403f4af875f8ea3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.936779:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.936781:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.936783:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.937266:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.937273:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937282:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.937285:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.937289:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937299:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937307:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937314:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937329:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.937337:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.937368:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937387:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.937391:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937399:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937410:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937418:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0f012cc/0x9403f4af875f8eaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937431:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.937432:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.937434:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.937825:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.937831:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937840:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.937843:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.937847:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937857:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.937871:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938014:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938034:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.938043:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.938048:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938056:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c0030000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.938059:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938067:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938078:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938084:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c19279da/0x9403f4af875f8eb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938099:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.938106:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.938108:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.938738:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.938747:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938756:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.938760:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.938764:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938775:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938783:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938791:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938804:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.938811:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.938815:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938822:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c0030e00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.938825:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938844:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938856:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938863:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005783003/0x9403f4af875f8eb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.938876:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.938878:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.938994:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.939406:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.939412:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939420:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.939423:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.939428:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939437:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939444:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939456:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939470:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.939478:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.939482:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939489:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c0031800 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.939493:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939500:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939510:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939518:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009097d3db/0x9403f4af875f8ebf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.939532:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.939534:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.939535:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.943861:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.943881:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.943899:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.943903:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.943910:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.943926:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.943936:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.943944:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.943967:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789402608.944503:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.944509:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944518:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.944522:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.944526:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944536:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944549:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944555:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944571:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789402608.944583:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789402608.944588:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944596:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c0031400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.944600:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944610:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944625:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944633:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cb56780/0x9403f4af875f8ec6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944655:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.944664:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944671:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cc400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.944675:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944683:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944694:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944700:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ecd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.944712:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.944714:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.944716:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.945136:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.945142:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945150:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.945152:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.945156:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945175:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945182:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945189:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945203:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.945212:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.945216:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945222:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cd000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.945225:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945232:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945242:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945249:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ed4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.945267:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.945269:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.945270:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402608.947608:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789402608.964536:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789402608.965237:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.965248:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.965264:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.965269:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.965275:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.965289:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.965299:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.965308:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.967007:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789402608.967674:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.967683:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.967709:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.967713:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.967718:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.967733:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.967743:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.967752:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968629:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789402608.968639:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968649:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cd600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402608.968655:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968664:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968685:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968692:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000638f140b/0x9403f4af875f8edb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968707:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402608.968710:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968724:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cd000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402608.968727:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968735:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968746:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968754:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402608.968755:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402608.968757:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.968822:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789402608.968827:0:15112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001254aa73/0x9403f4af875f8ee2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.968990:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.969479:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.969485:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.969496:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.969500:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.969505:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.969528:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.969537:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.969545:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.969560:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402608.969977:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402608.969983:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.969992:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cc400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402608.969996:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.970004:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.970016:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.970030:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd40f51c/0x9403f4af875f8ee9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.970043:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402608.970045:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402608.970046:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.970204:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.970211:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.970219:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.970222:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.970227:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.970236:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.970244:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.970262:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.970280:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789402608.970412:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789402608.970418:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.970426:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cda00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402608.970430:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.970438:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.970449:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.970456:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014d05ef2/0x9403f4af875f8ef0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402608.970468:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402608.970470:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789402608.970471:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.974051:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.974063:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974079:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.974084:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.974089:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974104:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974115:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974123:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974141:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.974153:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.974159:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974173:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cca00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.974179:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974189:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974204:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974211:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8806161/0x9403f4af875f8ef7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974228:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.974230:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.974232:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.974688:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.974694:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974703:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.974706:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.974710:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974720:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974734:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974742:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974757:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.974766:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.974770:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974777:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cc800 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.974781:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974789:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974800:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974807:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f146f9d7/0x9403f4af875f8efe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.974820:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.974825:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.974827:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789402608.975178:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789402608.975184:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975193:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1789402608.975197:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402608.975202:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975211:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975219:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975227:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975240:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789402608.975247:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789402608.975250:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975257:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cdc00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:1.0:1789402608.975260:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975279:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975289:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975296:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c497eb5/0x9403f4af875f8f05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402608.975309:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.975310:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402608.975312:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789402608.975500:0:15112:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1789402608.975585:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14452:x1876324224439168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 95315us (97273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402608.975594:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789402608.975649:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14452:1876324224439168:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789402608.975664:0:14452:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789402608.975708:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14452:1876324224439296:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789402608.975740:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402608.975777:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6f1e0f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789402608.975792:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224439296 00000100:00100000:1.0:1789402608.975798:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224439296 00000100:00100000:1.0:1789402608.975833:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789402608.975841:0:15113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14452:x1876324224439296:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789402608.975883:0:15113:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1789402608.988817:0:15113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14452:x1876324224439296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12970us (13071us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789402608.988829:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789402608.989563:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14452:1876324224439296:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789402608.989580:0:14452:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1789402609.701728:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402610.405415:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224439424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402610.405475:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402610.405543:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224439424 00000100:00100000:3.0:1789402610.405551:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224439424 00000100:00100000:3.0:1789402610.405599:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789402610.405607:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224439424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402610.405638:0:15114:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402610.405674:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224439424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402610.405681:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789402610.405698:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789402610.405736:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224439424:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789402610.521337:0:16185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg308-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789402610.722516:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789402611.746570:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402612.643850:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.643994:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199276672 00000100:00100000:1.0:1789402612.644007:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199276672 00000100:00100000:1.0:1789402612.644073:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 74 00000100:00100000:1.0:1789402612.644083:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1876324199276672:12345-192.168.203.8@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789402612.644926:0:14421:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e458e935-6ed5-4b3c-9a8d-9ee3137a1a21@192.168.203.8@tcp t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:1.0:1789402612.644971:0:14421:0:(genops.c:1384:class_connect()) connect: client e458e935-6ed5-4b3c-9a8d-9ee3137a1a21, cookie 0x9403f4af875f8f0c 00000100:00080000:1.0:1789402612.645243:0:14421:0:(import.c:65:import_set_state_nolock()) ffff93c5c22c9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402612.645374:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+5:2350:x1876324199276672:12345-192.168.203.8@tcp:250:mount.lustre.0 Request processed in 1289us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.645385:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 74 00000100:00100000:3.0:1789402612.663032:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402612.663138:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199276800 00000100:00100000:3.0:1789402612.663150:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199276800 00000100:00100000:3.0:1789402612.663210:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 75 00000100:00100000:3.0:1789402612.663220:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+5:13745:x1876324199276800:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789402612.663241:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402612.663266:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6fb90c200/0x9403f4af875f8f13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47497 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402612.663302:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6fb90c200/0x9403f4af875f8f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47497 expref: 6 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402612.663361:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6fb90c200/0x9403f4af875f8f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47497 expref: 6 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402612.663373:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c200, rc 0) 00000100:00100000:3.0:1789402612.663444:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+6:13745:x1876324199276800:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 224us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402612.663451:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 75 00000100:00100000:1.0:1789402612.673114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402612.673389:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199276928 00000100:00100000:3.0:1789402612.673402:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199276928 00000100:00100000:3.0:1789402612.673466:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 76 00000100:00100000:3.0:1789402612.673478:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+6:13745:x1876324199276928:12345-192.168.203.8@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789402612.674414:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+6:13745:x1876324199276928:12345-192.168.203.8@tcp:501:mount.lustre.0 Request processed in 933us (1317us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789402612.674428:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 76 00000100:00100000:3.0:1789402612.677296:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402612.677877:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199277056 00000100:00100000:2.0:1789402612.677892:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199277056 00000100:00100000:2.0:1789402612.677963:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 77 00000100:00100000:2.0:1789402612.677975:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+6:13745:x1876324199277056:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789402612.677997:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402612.678023:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6ef3de200/0x9403f4af875f8f1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4749e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402612.678070:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6ef3de200/0x9403f4af875f8f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4749e expref: 7 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402612.678084:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6ef3de200/0x9403f4af875f8f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4749e expref: 7 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402612.678217:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de200, rc 0) 00000100:00100000:2.0:1789402612.678304:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+7:13745:x1876324199277056:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 331us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402612.678312:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 77 00000100:00100000:3.0:1789402612.682529:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.684528:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199277184 00000100:00100000:1.0:1789402612.684549:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199277184 00000100:00100000:1.0:1789402612.684644:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 78 00000100:00100000:1.0:1789402612.685031:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fa4ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+7:13745:x1876324199277184:12345-192.168.203.8@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789402612.685483:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fa4ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+8:13745:x1876324199277184:12345-192.168.203.8@tcp:501:mount.lustre.0 Request processed in 825us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.685507:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 78 00000100:00100000:3.0:1789402612.688858:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.689195:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199277312 00000100:00100000:1.0:1789402612.689210:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199277312 00000100:00100000:1.0:1789402612.689283:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 79 00000100:00100000:1.0:1789402612.689298:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+8:13745:x1876324199277312:12345-192.168.203.8@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789402612.691377:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+8:13745:x1876324199277312:12345-192.168.203.8@tcp:503:mount.lustre.0 Request processed in 2035us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.691393:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 79 00000100:00100000:2.0:1789402612.699310:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.699413:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199277440 00000100:00100000:1.0:1789402612.699427:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199277440 00000100:00100000:0.0:1789402612.699534:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 80 00000100:00100000:0.0:1789402612.699552:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+8:13764:x1876324199277440:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789402612.700544:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+8:13764:x1876324199277440:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 991us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402612.700557:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 80 00000100:00100000:3.0:1789402612.717286:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.717474:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199277568 00000100:00100000:1.0:1789402612.717488:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199277568 00000100:00100000:1.0:1789402612.717557:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 81 00000100:00100000:1.0:1789402612.717570:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+8:13764:x1876324199277568:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789402612.718171:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+8:13764:x1876324199277568:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 601us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.718183:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 81 00000100:00100000:2.0:1789402612.724148:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402612.724640:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199277696 00000100:00100000:0.0:1789402612.724655:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199277696 00000100:00100000:0.0:1789402612.724987:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 82 00000100:00100000:0.0:1789402612.725001:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+8:13745:x1876324199277696:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789402612.725024:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402612.725049:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f8f21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b474c8 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402612.725085:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f8f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474c8 expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402612.725100:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a83600/0x9403f4af875f8f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474c8 expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402612.725110:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83600, rc 0) 00000100:00100000:0.0:1789402612.725208:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+9:13745:x1876324199277696:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 210us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402612.725216:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 82 00000100:00100000:2.0:1789402612.727797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.727941:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199277824 00000100:00100000:1.0:1789402612.727954:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199277824 00000100:00100000:1.0:1789402612.728027:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 83 00000100:00100000:1.0:1789402612.728039:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+9:13745:x1876324199277824:12345-192.168.203.8@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789402612.728075:0:14421:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789402612.728107:0:14421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789402612.728112:0:14421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789402612.728115:0:14421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789402612.728118:0:14421:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789402612.730596:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+9:13745:x1876324199277824:12345-192.168.203.8@tcp:256:mount.lustre.0 Request processed in 2544us (2798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.730615:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 83 00000100:00100000:3.0:1789402612.739934:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402612.740168:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199277952 00000100:00100000:0.0:1789402612.740181:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199277952 00000100:00100000:0.0:1789402612.740253:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 84 00000100:00100000:0.0:1789402612.740265:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+9:13745:x1876324199277952:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789402612.740286:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402612.740312:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b474cf expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402612.740403:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474cf expref: 10 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402612.740417:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474cf expref: 10 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402612.740426:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82000, rc 0) 00000100:00100000:1.0:1789402612.745121:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13745:x1876324199277952:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 4841us (5183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.745138:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 84 00000100:00100000:2.0:1789402612.749900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.752146:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199278080 00000100:00100000:1.0:1789402612.752167:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199278080 00000100:00100000:1.0:1789402612.752454:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 85 00000100:00100000:1.0:1789402612.752473:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13745:x1876324199278080:12345-192.168.203.8@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789402612.753041:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13745:x1876324199278080:12345-192.168.203.8@tcp:501:mount.lustre.0 Request processed in 497us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.753052:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 85 00000100:00100000:3.0:1789402612.757618:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.758085:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199278208 00000100:00100000:1.0:1789402612.758099:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199278208 00000100:00100000:1.0:1789402612.758237:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 86 00000100:00100000:1.0:1789402612.758251:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13745:x1876324199278208:12345-192.168.203.8@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789402612.760408:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13745:x1876324199278208:12345-192.168.203.8@tcp:503:mount.lustre.0 Request processed in 2145us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.760426:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 86 00000100:00100000:3.0:1789402612.767938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402612.768072:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199278336 00000100:00100000:2.0:1789402612.768085:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199278336 00000100:00100000:2.0:1789402612.768567:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 87 00000100:00100000:2.0:1789402612.768581:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13769:x1876324199278336:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789402612.768981:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13769:x1876324199278336:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 401us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402612.768991:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 87 00000100:00100000:3.0:1789402612.771299:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.781616:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199278464 00000100:00100000:1.0:1789402612.781637:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199278464 00000100:00100000:1.0:1789402612.781723:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 88 00000100:00100000:1.0:1789402612.781736:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13769:x1876324199278464:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789402612.782287:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13769:x1876324199278464:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 550us (10995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.782305:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 88 00010000:00010000:3.0:1789402612.783906:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402612.798577:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.798999:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199278592 00000100:00100000:1.0:1789402612.799015:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199278592 00000100:00100000:1.0:1789402612.799080:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:1.0:1789402612.799089:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1876324199278592:12345-192.168.203.8@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789402612.799129:0:14429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fd0f85ca-e975-4487-8e2d-28d921391c29@192.168.203.8@tcp t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:1.0:1789402612.799209:0:14429:0:(genops.c:1384:class_connect()) connect: client fd0f85ca-e975-4487-8e2d-28d921391c29, cookie 0x9403f4af875f8f2f 00000004:00100000:1.0:1789402612.799248:0:14429:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789402612.799255:0:14429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789402612.848690:0:14429:0:(import.c:65:import_set_state_nolock()) ffff93c5c22cf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402612.850789:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+6:2350:x1876324199278592:12345-192.168.203.8@tcp:38:mount.lustre.0 Request processed in 51685us (52215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.850806:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:0.0:1789402612.862679:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.862824:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199278848 00000100:00100000:1.0:1789402612.862837:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199278848 00000100:00100000:1.0:1789402612.862928:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:1.0:1789402612.862940:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+6:13745:x1876324199278848:12345-192.168.203.8@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789402612.863190:0:14427:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789402612.865000:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+6:13745:x1876324199278848:12345-192.168.203.8@tcp:41:mount.lustre.0 Request processed in 2044us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.865018:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00080000:3.0:1789402612.866611:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402612.875052:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402612.875105:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402612.875214:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199278720 00000100:00100000:2.0:1789402612.875227:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199278720 00000100:00100000:2.0:1789402612.875296:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199278976 00000100:00100000:2.0:1789402612.875299:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199278976 00000100:00100000:2.0:1789402612.875317:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:2.0:1789402612.875340:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+7:0:x1876324199278720:12345-192.168.203.8@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789402612.875420:0:14428:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789402612.875508:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+7:0:x1876324199278720:12345-192.168.203.8@tcp:41:mount.lustre.0 Request processed in 181us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402612.875515:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:2.0:1789402612.875536:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:2.0:1789402612.875543:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+6:13745:x1876324199278976:12345-192.168.203.8@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789402612.875574:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+6:13745:x1876324199278976:12345-192.168.203.8@tcp:40:mount.lustre.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402612.875581:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:0.0:1789402612.879072:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402612.879180:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402612.879395:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199279104 00000100:00100000:1.0:1789402612.879408:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199279104 00000100:00100000:1.0:1789402612.879457:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:1.0:1789402612.879467:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1876324199279104:12345-192.168.203.8@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789402612.879527:0:15111:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fd0f85ca-e975-4487-8e2d-28d921391c29@192.168.203.8@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:1.0:1789402612.879572:0:15111:0:(genops.c:1384:class_connect()) connect: client fd0f85ca-e975-4487-8e2d-28d921391c29, cookie 0x9403f4af875f8f36 00002000:00100000:1.0:1789402612.879588:0:15111:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fd0f85ca-e975-4487-8e2d-28d921391c29/ffff93c5c22ce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789402612.879629:0:15111:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789402612.880037:0:15111:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789402612.880074:0:15111:0:(import.c:65:import_set_state_nolock()) ffff93c5c22cb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402612.880151:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+6:2350:x1876324199279104:12345-192.168.203.8@tcp:8:mount.lustre.0 Request processed in 684us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402612.880160:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:2.0:1789402612.880468:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199279360 00000100:00100000:2.0:1789402612.880474:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199279360 00000100:00100000:2.0:1789402612.880521:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:2.0:1789402612.880530:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+6:13745:x1876324199279360:12345-192.168.203.8@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789402612.881220:0:14430:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 606us 00000100:00100000:3.0:1789402612.883869:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402612.884040:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199279232 00000100:00100000:3.0:1789402612.884062:0:15113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199279232 00000100:00100000:3.0:1789402612.884160:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:3.0:1789402612.884171:0:15113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876324199279232:12345-192.168.203.8@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789402612.884213:0:15113:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fd0f85ca-e975-4487-8e2d-28d921391c29@192.168.203.8@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:3.0:1789402612.884252:0:15113:0:(genops.c:1384:class_connect()) connect: client fd0f85ca-e975-4487-8e2d-28d921391c29, cookie 0x9403f4af875f8f3d 00002000:00100000:3.0:1789402612.884268:0:15113:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fd0f85ca-e975-4487-8e2d-28d921391c29/ffff93c6ddd64000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789402612.884299:0:15113:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789402612.884788:0:15113:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789402612.884831:0:15113:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd63800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789402612.884916:0:15113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+6:2350:x1876324199279232:12345-192.168.203.8@tcp:8:mount.lustre.0 Request processed in 745us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402612.884924:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000004:00200000:2.0:1789402612.910496:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789402612.910665:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+6:13745:x1876324199279360:12345-192.168.203.8@tcp:33:mount.lustre.0 Request processed in 30129us (31600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402612.910679:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:0.0:1789402613.176292:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402613.176457:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199279488 00000100:00100000:2.0:1789402613.176471:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199279488 00000100:00100000:2.0:1789402613.176568:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:2.0:1789402613.176583:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+6:13790:x1876324199279488:12345-192.168.203.8@tcp:101:mkdir.0 00010000:00010000:2.0:1789402613.176610:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402613.176646:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8f44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b474f9 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402613.176732:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8f4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402613.176750:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8f4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402613.176767:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8f4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402613.176814:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789402613.176819:0:14428:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402613.176864:0:14428:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8f4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402613.176894:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f8f44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474f9 expref: 8 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402613.176918:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8f4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474f9 expref: 7 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402613.176946:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402613.176949:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789402613.176954:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de000, rc 0) 00000100:00100000:2.0:1789402613.177035:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+7:13790:x1876324199279488:12345-192.168.203.8@tcp:101:mkdir.0 Request processed in 455us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402613.177043:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 8 00010000:00010000:1.0:1789402613.794952:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402613.988003:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224439552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402613.988117:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402613.988530:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224439552 00000100:00100000:1.0:1789402613.988541:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224439552 00000100:00100000:1.0:1789402613.988643:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789402613.988660:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224439552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402613.988702:0:15114:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402613.988788:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876324224439552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402613.988797:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789402613.990960:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224439808:0@lo:400:kworker.0 00000100:00100000:1.0:1789402613.991054:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402613.991132:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789402613.991139:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224439680:0@lo:400:kworker.0 00000100:00100000:1.0:1789402613.991185:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402613.991211:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224440192:0@lo:400:kworker.0 00000100:00100000:1.0:1789402613.991238:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402613.991298:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224439680 00000100:00100000:1.0:1789402613.991308:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224439680 00000100:00100000:1.0:1789402613.991408:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789402613.991419:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3316:x1876324224439680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402613.991477:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3316:x1876324224439680:12345-0@lo:400:kworker.0 Request processed in 60us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402613.991486:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789402613.992429:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224439936:0@lo:400:kworker.0 00000100:00100000:0.0:1789402613.992483:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402613.992530:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789402613.992538:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224440064:0@lo:400:kworker.0 00000100:00100000:0.0:1789402613.992561:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402613.992624:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224440192 00000100:00100000:0.0:1789402613.992632:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224440192 00000100:00100000:0.0:1789402613.992673:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224439936 00000100:00100000:0.0:1789402613.992675:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224439936 00000100:00100000:0.0:1789402613.992688:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224440064 00000100:00100000:0.0:1789402613.992690:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224440064 00000100:00100000:0.0:1789402613.992706:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789402613.992714:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224440192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402613.992762:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876324224440192:12345-0@lo:400:kworker.0 Request processed in 48us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402613.992769:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789402613.992786:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789402613.992792:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224439936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402613.992823:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224439936:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402613.992829:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789402613.992840:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789402613.992846:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224440064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402613.992870:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224440064:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402613.992875:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789402613.992920:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224440064:0@lo:400:kworker.0 00000100:00100000:0.0:1789402613.992933:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224439936:0@lo:400:kworker.0 00000100:00100000:0.0:1789402613.993000:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3316:1876324224439680:0@lo:400:kworker.0 00000100:00100000:0.0:1789402613.993019:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876324224440192:0@lo:400:kworker.0 00000100:00100000:2.0:1789402613.993481:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224439808 00000100:00100000:2.0:1789402613.993488:0:15113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224439808 00000100:00100000:2.0:1789402613.993536:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789402613.993546:0:15113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224439808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402613.993609:0:15113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224439808:12345-0@lo:400:kworker.0 Request processed in 65us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402613.993616:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789402613.996886:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224439808:0@lo:400:kworker.0 00000100:00080000:3.0:1789402613.997066:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789402613.997074:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789402613.997077:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402613.999606:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224439552:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789402614.176166:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789402614.176259:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789402614.176422:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fd0f85ca-e975-4487-8e2d-28d921391c29 00000001:00100000:1.0:1789402614.655868:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd0f85ca-e975-4487-8e2d-28d921391c29 00010000:00010000:3.0:1789402614.819685:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402615.240226:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402615.240370:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199279616 00000100:00100000:0.0:1789402615.240383:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199279616 00000100:00100000:0.0:1789402615.240583:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:0.0:1789402615.240596:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+7:13843:x1876324199279616:12345-192.168.203.8@tcp:41:lfs.0 00000004:00000024:0.0:1789402615.240656:0:14429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789402615.240970:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+7:13843:x1876324199279616:12345-192.168.203.8@tcp:41:lfs.0 Request processed in 375us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402615.240979:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00080000:3.0:1789402615.245404:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402615.249475:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402615.250511:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199279744 00000100:00100000:1.0:1789402615.250533:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199279744 00000100:00100000:1.0:1789402615.250630:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:1.0:1789402615.250647:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fd0f85ca-e975-4487-8e2d-28d921391c29+5:13843:x1876324199279744:12345-192.168.203.8@tcp:13:lfs.0 00002000:00000024:1.0:1789402615.250697:0:15114:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402615.250812:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fd0f85ca-e975-4487-8e2d-28d921391c29+5:13843:x1876324199279744:12345-192.168.203.8@tcp:13:lfs.0 Request processed in 173us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.250820:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00080000:3.0:1789402615.252051:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402615.256006:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402615.256150:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199279872 00000100:00100000:2.0:1789402615.256163:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199279872 00000100:00100000:2.0:1789402615.256243:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:2.0:1789402615.256256:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fd0f85ca-e975-4487-8e2d-28d921391c29+5:13843:x1876324199279872:12345-192.168.203.8@tcp:13:lfs.0 00002000:00000024:2.0:1789402615.256306:0:15115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402615.256466:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fd0f85ca-e975-4487-8e2d-28d921391c29+5:13843:x1876324199279872:12345-192.168.203.8@tcp:13:lfs.0 Request processed in 212us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402615.256474:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00080000:3.0:1789402615.256605:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789402615.429156:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402615.434619:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199280000 00000100:00100000:1.0:1789402615.434643:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199280000 00000100:00100000:1.0:1789402615.435019:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 90 00000100:00100000:1.0:1789402615.435032:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+10:13873:x1876324199280000:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789402615.435053:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402615.435096:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c5c25cd800/0x9403f4af875f8f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47500 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402615.435135:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c5c25cd800/0x9403f4af875f8f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47500 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402615.435148:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c5c25cd800/0x9403f4af875f8f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47500 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402615.435158:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cd800, rc 0) 00000100:00100000:1.0:1789402615.435250:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13873:x1876324199280000:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 221us (6109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.435257:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 90 00000100:00100000:0.0:1789402615.441725:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402615.441810:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199280128 00000100:00100000:2.0:1789402615.441824:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199280128 00000100:00100000:2.0:1789402615.441905:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 91 00000100:00100000:2.0:1789402615.441917:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13873:x1876324199280128:12345-192.168.203.8@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789402615.442695:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13873:x1876324199280128:12345-192.168.203.8@tcp:501:mount.lustre.0 Request processed in 775us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402615.442707:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 91 00000100:00100000:0.0:1789402615.446421:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402615.446621:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199280256 00000100:00100000:1.0:1789402615.446645:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199280256 00000100:00100000:1.0:1789402615.446724:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 92 00000100:00100000:1.0:1789402615.446736:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13873:x1876324199280256:12345-192.168.203.8@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789402615.447109:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13873:x1876324199280256:12345-192.168.203.8@tcp:503:mount.lustre.0 Request processed in 373us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.447119:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 92 00000100:00100000:0.0:1789402615.452636:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402615.452760:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199280384 00000100:00100000:2.0:1789402615.452773:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199280384 00000100:00100000:2.0:1789402615.452842:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 93 00000100:00100000:2.0:1789402615.452864:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13880:x1876324199280384:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789402615.453244:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13880:x1876324199280384:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 378us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402615.453255:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 93 00000100:00100000:0.0:1789402615.473489:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402615.473610:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199280512 00000100:00100000:2.0:1789402615.473624:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199280512 00000100:00100000:2.0:1789402615.473709:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 94 00000100:00100000:2.0:1789402615.473722:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c700557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13880:x1876324199280512:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789402615.474099:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c700557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13880:x1876324199280512:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 378us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402615.474109:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 94 00000100:00100000:0.0:1789402615.481590:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402615.481716:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199280640 00000100:00100000:1.0:1789402615.481729:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199280640 00000100:00100000:1.0:1789402615.481799:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 95 00000100:00100000:1.0:1789402615.481812:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13873:x1876324199280640:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789402615.481835:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402615.481865:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c5c25cd400/0x9403f4af875f8f59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4752a expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402615.481926:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c5c25cd400/0x9403f4af875f8f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4752a expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402615.481940:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c5c25cd400/0x9403f4af875f8f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4752a expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402615.481950:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cd400, rc 0) 00000100:00100000:1.0:1789402615.482028:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13873:x1876324199280640:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 218us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.482036:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 95 00000100:00100000:1.0:1789402615.490019:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402615.490127:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199280768 00000100:00100000:0.0:1789402615.490141:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199280768 00000100:00100000:0.0:1789402615.490210:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 96 00000100:00100000:0.0:1789402615.490223:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13873:x1876324199280768:12345-192.168.203.8@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789402615.490259:0:14420:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789402615.490290:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789402615.490295:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789402615.490298:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789402615.490300:0:14420:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789402615.492115:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13873:x1876324199280768:12345-192.168.203.8@tcp:256:mount.lustre.0 Request processed in 1880us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402615.492132:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 96 00000100:00100000:2.0:1789402615.509546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402615.509733:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199280896 00000100:00100000:1.0:1789402615.509747:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199280896 00000100:00100000:1.0:1789402615.509853:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 97 00000100:00100000:1.0:1789402615.509864:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13873:x1876324199280896:12345-192.168.203.8@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789402615.509884:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402615.509908:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47531 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402615.509944:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47531 expref: 13 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402615.509957:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47531 expref: 13 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402615.509967:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cce00, rc 0) 00000100:00100000:1.0:1789402615.510039:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13873:x1876324199280896:12345-192.168.203.8@tcp:101:mount.lustre.0 Request processed in 177us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.510063:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 97 00000100:00100000:3.0:1789402615.511730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402615.519459:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199281024 00000100:00100000:0.0:1789402615.519481:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199281024 00000100:00100000:0.0:1789402615.519555:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 98 00000100:00100000:0.0:1789402615.519588:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13873:x1876324199281024:12345-192.168.203.8@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789402615.520027:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13873:x1876324199281024:12345-192.168.203.8@tcp:501:mount.lustre.0 Request processed in 442us (8307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402615.520046:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 98 00000100:00100000:3.0:1789402615.522614:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402615.522646:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224440320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789402615.522763:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402615.522874:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224440320 00000100:00100000:3.0:1789402615.522883:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224440320 00000100:00100000:3.0:1789402615.522960:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789402615.522971:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224440320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789402615.522998:0:15115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789402615.523181:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224440320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 211us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402615.523190:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789402615.523218:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789402615.523260:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224440320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789402615.532531:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402615.532593:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199281152 00000100:00100000:1.0:1789402615.532608:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199281152 00000100:00100000:1.0:1789402615.532693:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 99 00000100:00100000:1.0:1789402615.532706:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13873:x1876324199281152:12345-192.168.203.8@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789402615.533028:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13873:x1876324199281152:12345-192.168.203.8@tcp:503:mount.lustre.0 Request processed in 323us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.533038:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 99 00000100:00100000:3.0:1789402615.537378:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402615.537486:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199281280 00000100:00100000:2.0:1789402615.537499:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199281280 00000100:00100000:2.0:1789402615.537563:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 100 00000100:00100000:2.0:1789402615.537574:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13886:x1876324199281280:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789402615.537925:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13886:x1876324199281280:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 351us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402615.537935:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 100 00000100:00100000:3.0:1789402615.558687:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402615.558918:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199281408 00000100:00100000:2.0:1789402615.558932:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199281408 00000100:00100000:2.0:1789402615.559006:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 101 00000100:00100000:2.0:1789402615.559019:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13886:x1876324199281408:12345-192.168.203.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789402615.559397:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13886:x1876324199281408:12345-192.168.203.8@tcp:502:llog_process_th.0 Request processed in 381us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402615.559407:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 101 00000100:00100000:0.0:1789402615.571119:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402615.571261:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199281536 00000100:00100000:3.0:1789402615.571274:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199281536 00000100:00100000:3.0:1789402615.571341:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:3.0:1789402615.571389:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1876324199281536:12345-192.168.203.8@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789402615.571427:0:14427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 08a34b02-10c3-4e61-b7aa-639ea7f7cde7@192.168.203.8@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1789402615.571480:0:14427:0:(genops.c:1384:class_connect()) connect: client 08a34b02-10c3-4e61-b7aa-639ea7f7cde7, cookie 0x9403f4af875f8f67 00000004:00100000:3.0:1789402615.571521:0:14427:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789402615.571695:0:14427:0:(import.c:65:import_set_state_nolock()) ffff93c6ddd60800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789402615.571775:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:2350:x1876324199281536:12345-192.168.203.8@tcp:38:mount.lustre.0 Request processed in 387us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402615.571784:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:3.0:1789402615.584173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402615.584221:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402615.584414:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199281664 00000100:00100000:1.0:1789402615.584426:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199281664 00000100:00100000:1.0:1789402615.584502:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199281792 00000100:00100000:1.0:1789402615.584506:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199281792 00000100:00100000:1.0:1789402615.584527:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:1.0:1789402615.584538:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+7:0:x1876324199281664:12345-192.168.203.8@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789402615.584582:0:14427:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789402615.584684:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+7:0:x1876324199281664:12345-192.168.203.8@tcp:41:mount.lustre.0 Request processed in 148us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.584692:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:1.0:1789402615.584713:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:1.0:1789402615.584720:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:13873:x1876324199281792:12345-192.168.203.8@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789402615.584732:0:14427:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789402615.584755:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:13873:x1876324199281792:12345-192.168.203.8@tcp:41:mount.lustre.0 Request processed in 35us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.584761:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00080000:3.0:1789402615.585150:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789402615.588432:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402615.588685:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199281920 00000100:00100000:1.0:1789402615.588716:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199281920 00000100:00100000:1.0:1789402615.588788:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:1.0:1789402615.588801:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:13873:x1876324199281920:12345-192.168.203.8@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789402615.588929:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:13873:x1876324199281920:12345-192.168.203.8@tcp:40:mount.lustre.0 Request processed in 130us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.588938:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:1.0:1789402615.592287:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402615.593056:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199282304 00000100:00100000:2.0:1789402615.593073:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199282304 00000100:00100000:2.0:1789402615.593199:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00100000:2.0:1789402615.593212:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:13873:x1876324199282304:12345-192.168.203.8@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789402615.593322:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789402615.593510:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:13873:x1876324199282304:12345-192.168.203.8@tcp:33:mount.lustre.0 Request processed in 300us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402615.593518:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00100000:0.0:1789402615.595133:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402615.595292:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402615.607908:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199282048 00000100:00100000:1.0:1789402615.607932:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199282048 00000100:00100000:1.0:1789402615.607991:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199282176 00000100:00100000:1.0:1789402615.607996:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199282176 00000100:00100000:1.0:1789402615.608018:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:1.0:1789402615.608029:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1876324199282048:12345-192.168.203.8@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789402615.608074:0:15111:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 08a34b02-10c3-4e61-b7aa-639ea7f7cde7@192.168.203.8@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1789402615.608114:0:15111:0:(genops.c:1384:class_connect()) connect: client 08a34b02-10c3-4e61-b7aa-639ea7f7cde7, cookie 0x9403f4af875f8f6e 00002000:00100000:1.0:1789402615.608128:0:15111:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 08a34b02-10c3-4e61-b7aa-639ea7f7cde7/ffff93c5c22cc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789402615.608141:0:15111:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789402615.608501:0:15111:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789402615.608552:0:15111:0:(import.c:65:import_set_state_nolock()) ffff93c6e2541000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402615.608663:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:2350:x1876324199282048:12345-192.168.203.8@tcp:8:mount.lustre.0 Request processed in 633us (13538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.608672:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:1.0:1789402615.608698:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:1.0:1789402615.608704:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1876324199282176:12345-192.168.203.8@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789402615.608725:0:15111:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 08a34b02-10c3-4e61-b7aa-639ea7f7cde7@192.168.203.8@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1789402615.608763:0:15111:0:(genops.c:1384:class_connect()) connect: client 08a34b02-10c3-4e61-b7aa-639ea7f7cde7, cookie 0x9403f4af875f8f75 00002000:00100000:1.0:1789402615.608770:0:15111:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 08a34b02-10c3-4e61-b7aa-639ea7f7cde7/ffff93c6e2543000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789402615.608779:0:15111:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789402615.608931:0:15111:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789402615.608968:0:15111:0:(import.c:65:import_set_state_nolock()) ffff93c6ea370000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789402615.608996:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:2350:x1876324199282176:12345-192.168.203.8@tcp:8:mount.lustre.0 Request processed in 291us (13703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402615.609003:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:3.0:1789402615.763698:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402615.764205:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199282432 00000100:00100000:2.0:1789402615.764221:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199282432 00000100:00100000:2.0:1789402615.764303:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:2.0:1789402615.764562:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:13907:x1876324199282432:12345-192.168.203.8@tcp:101:mkdir.0 00010000:00010000:2.0:1789402615.764591:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402615.764619:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f8f7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4755b expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402615.766592:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402615.766623:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402615.766642:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402615.766698:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789402615.766703:0:14428:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402615.768043:0:14428:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402615.768176:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f8f7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4755b expref: 8 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402615.768205:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4755b expref: 7 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402615.768216:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402615.768219:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789402615.768224:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dfc00, rc 0) 00000100:00100000:2.0:1789402615.768339:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+7:13907:x1876324199282432:12345-192.168.203.8@tcp:101:mkdir.0 Request processed in 3781us (4654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402615.768387:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 14 00010000:00010000:1.0:1789402615.844833:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402616.871977:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789402617.321495:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789402617.894279:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789402618.170490:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fd0f85ca-e975-4487-8e2d-28d921391c29 00000001:00100000:1.0:1789402618.170519:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 08a34b02-10c3-4e61-b7aa-639ea7f7cde7 00000001:02000400:1.0:1789402618.803709:0:16389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789402618.916556:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402619.107703:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb1fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224440448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402619.107786:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402619.107939:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224440448 00000100:00100000:1.0:1789402619.107949:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224440448 00000100:00100000:1.0:1789402619.108022:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789402619.108032:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224440448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789402619.108070:0:15115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789402619.108120:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224440448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402619.108127:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789402619.108183:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789402619.108482:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224440704:0@lo:400:kworker.0 00000100:00100000:2.0:1789402619.108554:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402619.108616:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789402619.108623:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224440832:0@lo:400:kworker.0 00000100:00100000:2.0:1789402619.108651:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402619.111853:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224440960:0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.111938:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402619.111997:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789402619.112028:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb1fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224440448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789402619.112048:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789402619.112073:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3313:1876324224440576:0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.112104:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402619.112132:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224441088:0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.112154:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402619.112190:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224440704 00000100:00100000:1.0:1789402619.112197:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224440704 00000100:00100000:1.0:1789402619.112259:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789402619.112268:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224440704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.112327:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224440704:12345-0@lo:400:kworker.0 Request processed in 60us (3773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402619.112335:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789402619.112375:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224440832 00000100:00100000:1.0:1789402619.112379:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224440832 00000100:00100000:1.0:1789402619.112396:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224440960 00000100:00100000:1.0:1789402619.112399:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224440960 00000100:00100000:1.0:1789402619.112413:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224441088 00000100:00100000:1.0:1789402619.112414:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224441088 00000100:00100000:1.0:1789402619.112427:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789402619.112433:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224440832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.112480:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876324224440832:12345-0@lo:400:kworker.0 Request processed in 46us (3828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402619.112487:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789402619.112500:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789402619.112506:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224440960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.112538:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876324224440960:12345-0@lo:400:kworker.0 Request processed in 32us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402619.112544:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789402619.112564:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789402619.112571:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224441088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.112599:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876324224441088:12345-0@lo:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402619.112605:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789402619.112622:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224440576 00000100:00100000:1.0:1789402619.112625:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224440576 00000100:00100000:1.0:1789402619.112648:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789402619.112655:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3313:x1876324224440576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.112682:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3313:x1876324224440576:12345-0@lo:400:kworker.0 Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402619.112687:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789402619.112715:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789402619.112719:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402619.112738:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3313:1876324224440576:0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.112750:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876324224441088:0@lo:400:kworker.0 00000100:00100000:1.0:1789402619.112759:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876324224440960:0@lo:400:kworker.0 00000100:00100000:2.0:1789402619.132537:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876324224440832:0@lo:400:kworker.0 00000100:00100000:2.0:1789402619.132562:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224440704:0@lo:400:kworker.0 00000001:00100000:1.0:1789402619.155297:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08a34b02-10c3-4e61-b7aa-639ea7f7cde7 00000001:00100000:1.0:1789402619.719860:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08a34b02-10c3-4e61-b7aa-639ea7f7cde7 00010000:00010000:3.0:1789402619.941212:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402620.645396:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789402620.645420:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224441216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789402620.645487:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402620.645569:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224441216 00000100:00100000:0.0:1789402620.645576:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224441216 00000100:00100000:0.0:1789402620.645633:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789402620.645642:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224441216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789402620.645676:0:15115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789402620.645721:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224441216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402620.645727:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789402620.645769:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224441216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789402620.962575:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402620.962614:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402620.962639:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402620.962658:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402620.962690:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402620.962708:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402620.962732:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402620.962759:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199283072 00000100:00100000:0.0:1789402620.962770:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199283072 00000100:00100000:0.0:1789402620.962826:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199282688 00000100:00100000:0.0:1789402620.962829:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199282688 00000100:00100000:3.0:1789402620.962933:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199282560 00000100:00100000:3.0:1789402620.962938:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199282560 00000100:00100000:3.0:1789402620.962969:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 103 00000100:00100000:3.0:1789402620.962980:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:2353:x1876324199282560:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402620.963044:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:2353:x1876324199282560:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 66us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402620.963052:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 103 00000100:00100000:3.0:1789402620.963084:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:3.0:1789402620.963092:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:2353:x1876324199283072:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402620.963119:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:2353:x1876324199283072:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402620.963125:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:0.0:1789402620.963749:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:0.0:1789402620.963759:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+6:2353:x1876324199282688:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402620.963916:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+6:2353:x1876324199282688:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 158us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402620.963923:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:0.0:1789402620.963946:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199282816 00000100:00100000:0.0:1789402620.963952:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199282816 00000100:00100000:0.0:1789402620.963972:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199283328 00000100:00100000:0.0:1789402620.963975:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199283328 00000100:00100000:0.0:1789402620.963987:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199282944 00000100:00100000:0.0:1789402620.963989:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199282944 00000100:00100000:0.0:1789402620.964000:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199283200 00000100:00100000:0.0:1789402620.964002:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199283200 00000100:00100000:0.0:1789402620.964015:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:0.0:1789402620.964021:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2353:x1876324199282816:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402620.964045:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2353:x1876324199282816:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 25us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402620.964052:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:0.0:1789402620.964062:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:0.0:1789402620.964067:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2353:x1876324199283328:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402620.964088:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2353:x1876324199283328:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 21us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402620.964099:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:0.0:1789402620.964111:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:0.0:1789402620.964117:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2353:x1876324199282944:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402620.964490:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2353:x1876324199282944:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 372us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402620.964497:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:0.0:1789402620.964510:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:0.0:1789402620.964517:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2353:x1876324199283200:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402620.964542:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2353:x1876324199283200:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 26us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402620.964547:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00080000:0.0:1789402620.964574:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789402620.964578:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789402620.964580:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789402620.968569:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402621.986583:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789402622.576189:0:16537:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff30439f90 20000000:00000080:1.0:1789402622.576209:0:16537:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c5c1a78000 uarg=0000000000000000 20000000:01000000:1.0:1789402622.576246:0:16537:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789402622.576267:0:16537:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789402622.576271:0:16537:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789402622.577729:0:16538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789402622.578117:0:16537:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789402622.589043:0:16537:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789402622.591454:0:16537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.591493:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8c7a expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.591503:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8cc7 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.591510:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8e02 expref: 18 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.591520:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474cf expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.591528:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47531 expref: 12 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.591535:0:16537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.591579:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47531 expref: 12 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.591603:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47531 expref: 12 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402622.591618:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441344:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402622.591714:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474cf expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.592585:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474cf expref: 12 pid: 14422 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402622.592616:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441472:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402622.592684:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f8e02 expref: 18 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.592692:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f8e02 expref: 18 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402622.592702:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441600:0@lo:104: 00000100:00100000:1.0:1789402622.592915:0:16537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789402622.592953:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f8cc7 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.592963:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f8cc7 expref: 18 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402622.592972:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441728:0@lo:104: 00000100:00100000:1.0:1789402622.592994:0:16537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789402622.593027:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9403f4af875f8c7a expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.593036:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9403f4af875f8c7a expref: 18 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402622.593045:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441856:0@lo:104: 00000100:00100000:1.0:1789402622.593132:0:16537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402622.593145:0:16537:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e6139e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789402622.593309:0:14410:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789402622.593323:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224441600 00000100:00100000:0.0:1789402622.593329:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224441600 00000100:00100000:0.0:1789402622.593389:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224441728 00000100:00100000:0.0:1789402622.593393:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224441728 00000100:00100000:0.0:1789402622.593406:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224441856 00000100:00100000:0.0:1789402622.593408:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224441856 00000100:00100000:0.0:1789402622.593422:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789402622.593431:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+5:16537:x1876324224441600:12345-0@lo:104: 00010000:00010000:0.0:1789402622.593457:0:14410:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402622.593523:0:14410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789402622.593532:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+5:16537:x1876324224441600:12345-0@lo:104: Request processed in 102us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402622.593540:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789402622.593561:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789402622.593569:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+4:16537:x1876324224441728:12345-0@lo:104: 00010000:00010000:0.0:1789402622.593578:0:14410:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593589:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402622.593605:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593612:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc1d64c20) 00010000:00010000:0.0:1789402622.593616:0:14410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1789402622.593617:0:14416:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402622.593624:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+4:16537:x1876324224441728:12345-0@lo:104: Request processed in 56us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402622.593638:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789402622.593644:0:14416:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789402622.593653:0:14416:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402622.593654:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 10000000:01000000:3.0:1789402622.593663:0:14416:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789402622.593665:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddd50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:16537:x1876324224441856:12345-0@lo:104: 00010000:00010000:0.0:1789402622.593675:0:14410:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593695:0:14416:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593703:0:14416:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789402622.593704:0:14410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789402622.593711:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddd50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+3:16537:x1876324224441856:12345-0@lo:104: Request processed in 47us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402622.593718:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789402622.593741:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593750:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6c2a83400/0x9403f4af875f8e02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8e09 expref: -99 pid: 15828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593763:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789402622.593767:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593772:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6223e00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:3.0:1789402622.593775:0:14416:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593790:0:14416:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789402622.593797:0:14416:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402622.593809:0:14416:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789402622.593824:0:14416:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593831:0:14416:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789402622.593853:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593860:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6e6223e00/0x9403f4af875f8cc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8cce expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593875:0:14416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402622.593878:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593883:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6e6222c00 already unused, calling callback (ffffffffc1d64c20) 10000000:00010000:3.0:1789402622.593887:0:14416:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402622.593889:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789402622.593898:0:14416:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402622.593905:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3315:1876324224441984:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789402622.593906:0:14416:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789402622.593917:0:14416:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789402622.593938:0:14416:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593945:0:14416:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789402622.593948:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789402622.593962:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593970:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.108@tcp lock: ffff93c6e6222c00/0x9403f4af875f8c7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9403f4af875f8c81 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.593987:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402622.593990:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402622.593990:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224441984 00010000:00010000:3.0:1789402622.593994:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402622.593996:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224441984 00010000:00010000:3.0:1789402622.594003:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789402622.594020:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3314:1876324224442240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402622.594021:0:14413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8e02 expref: 19 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402622.594050:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789402622.594055:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402622.594060:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3315:x1876324224441984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402622.594072:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402622.594078:0:14413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8e02 expref: 19 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402622.594080:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789402622.594090:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3314:1876324224442112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402622.594092:0:14413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f8e02 expref: 19 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.594111:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402622.594119:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402622.594146:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789402622.594152:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3315:x1876324224441984:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402622.594157:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789402622.594162:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789402622.594176:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224442240 00000100:00100000:2.0:1789402622.594187:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224442240 00010000:00010000:2.0:1789402622.594201:0:14413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8c7a expref: 19 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402622.594213:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224442112 00000100:00100000:2.0:1789402622.594216:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224442112 00010000:00010000:2.0:1789402622.594228:0:14413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8cc7 expref: 20 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402622.594241:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789402622.594248:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+20:3314:x1876324224442240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789402622.594270:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402622.594275:0:14413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8c7a expref: 20 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.594283:0:14413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f8c7a expref: 20 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.594295:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402622.594309:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789402622.594319:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+20:3314:x1876324224442112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789402622.594330:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789402622.594330:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+20:3314:x1876324224442240:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (275us total) trans 0 rc 0/0 00010000:00010000:3.0:1789402622.594338:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9403f4af875f8cc7 expref: 20 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402622.594362:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789402622.594382:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9403f4af875f8cc7 expref: 19 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402622.594393:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402622.594404:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3314:1876324224442240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789402622.594422:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3314:x1876324224442112:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402622.594428:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3314:1876324224442112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789402622.594440:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789402622.594469:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3315:1876324224441984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789402622.596219:0:16537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6e6223400/0x9403f4af875f8e09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f8e02 expref: 18 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402622.596266:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441600:0@lo:104: 00010000:00010000:1.0:1789402622.596282:0:16537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6fb90c000/0x9403f4af875f8cce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f8cc7 expref: 17 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402622.596290:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441728:0@lo:104: 00010000:00010000:1.0:1789402622.596308:0:16537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6ef3dec00/0x9403f4af875f8c81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9403f4af875f8c7a expref: 16 pid: 14420 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402622.596316:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441856:0@lo:104: 00000100:00100000:1.0:1789402622.605754:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441344:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402622.607478:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1876324224441472:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402622.607517:0:16537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402622.611392:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402622.611435:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402622.611550:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199283456 00000100:00100000:2.0:1789402622.611561:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199283456 00010000:00010000:2.0:1789402622.611605:0:14413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47531 expref: 13 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402622.611671:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199283584 00000100:00100000:2.0:1789402622.611674:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199283584 00010000:00010000:2.0:1789402622.611689:0:14413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474cf expref: 14 pid: 14422 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402622.611723:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:2.0:1789402622.611733:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+14:2351:x1876324199283456:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402622.611751:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402622.611758:0:14413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47531 expref: 14 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611770:0:14413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47531 expref: 14 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611788:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c5c25cce00/0x9403f4af875f8f60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47531 expref: 14 pid: 14421 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611802:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402622.611852:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:2351:x1876324199283456:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 121us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402622.611858:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:2.0:1789402622.611876:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:2.0:1789402622.611882:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:2351:x1876324199283584:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402622.611892:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402622.611897:0:14413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474cf expref: 12 pid: 14422 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611917:0:14413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474cf expref: 12 pid: 14422 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611928:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c6c2a82000/0x9403f4af875f8f28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474cf expref: 12 pid: 14422 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611940:0:14413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611947:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611962:0:14413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611970:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611977:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611984:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.611989:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25ccc00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402622.611993:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.612001:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.612027:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402622.612037:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402622.612059:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:2351:x1876324199283584:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 176us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402622.612066:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 8 00010000:00010000:1.0:1789402622.612398:0:16537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.612407:0:16537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402622.612413:0:16537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c5c25ccc00/0x9403f4af875f8f8a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402623.011305:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402624.035152:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402624.095191:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402624.095277:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199283712 00000100:00100000:3.0:1789402624.095291:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199283712 00000100:00100000:3.0:1789402624.095378:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 104 00000100:00100000:3.0:1789402624.095390:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+11:13759:x1876324199283712:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402624.095417:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402624.095443:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6fb90de00/0x9403f4af875f8f91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47562 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.095555:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6fb90de00/0x9403f4af875f8f91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47562 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.095569:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6fb90de00/0x9403f4af875f8f91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47562 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.095581:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90de00, rc 0) 00000100:00100000:3.0:1789402624.095650:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13759:x1876324199283712:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 Request processed in 263us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.095658:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 104 00000100:00100000:0.0:1789402624.101197:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402624.101293:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199283840 00000100:00100000:3.0:1789402624.101307:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199283840 00000100:00100000:3.0:1789402624.101394:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 105 00000100:00100000:3.0:1789402624.101408:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13759:x1876324199283840:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402624.102080:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13759:x1876324199283840:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 Request processed in 668us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.102098:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 105 00000100:00100000:3.0:1789402624.104279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402624.104377:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199283968 00000100:00100000:0.0:1789402624.104406:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199283968 00000100:00100000:0.0:1789402624.104471:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 106 00000100:00100000:0.0:1789402624.104481:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13759:x1876324199283968:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402624.104848:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13759:x1876324199283968:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 Request processed in 367us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402624.104857:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 106 00000100:00100000:1.0:1789402624.109867:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402624.110003:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199284096 00000100:00100000:3.0:1789402624.110017:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199284096 00000100:00100000:3.0:1789402624.110124:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 107 00000100:00100000:3.0:1789402624.110138:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+12:13759:x1876324199284096:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402624.110161:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402624.110187:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6fb90cc00/0x9403f4af875f8f98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47569 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.110225:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6fb90cc00/0x9403f4af875f8f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47569 expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.110251:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6fb90cc00/0x9403f4af875f8f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47569 expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.110262:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90cc00, rc 0) 00000100:00100000:3.0:1789402624.110332:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13759:x1876324199284096:12345-192.168.203.8@tcp:101:ll_cfg_requeue.0 Request processed in 197us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.110339:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 107 00000100:00100000:2.0:1789402624.113204:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402624.113288:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199284224 00000100:00100000:3.0:1789402624.113301:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199284224 00000100:00100000:3.0:1789402624.113632:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 108 00000100:00100000:3.0:1789402624.113646:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13759:x1876324199284224:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402624.115056:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13759:x1876324199284224:12345-192.168.203.8@tcp:501:ll_cfg_requeue.0 Request processed in 1401us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.115093:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 108 00000100:00100000:3.0:1789402624.117620:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402624.117735:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199284352 00000100:00100000:1.0:1789402624.117748:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199284352 00000100:00100000:1.0:1789402624.117809:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 109 00000100:00100000:1.0:1789402624.117835:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13759:x1876324199284352:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402624.118208:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:13759:x1876324199284352:12345-192.168.203.8@tcp:503:ll_cfg_requeue.0 Request processed in 373us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402624.118218:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 109 10000000:01000000:2.0:1789402624.162503:0:14424:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789402624.162514:0:14424:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6ea347800 from 10 10000000:01000000:2.0:1789402624.162520:0:14424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789402624.162608:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de400/0x9403f4af875f8f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402624.162622:0:14424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de400/0x9403f4af875f8f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402624.162636:0:14424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de400/0x9403f4af875f8f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402624.162670:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789402624.162780:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402624.162933:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c2403e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789402624.163052:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224442368 00000100:00100000:3.0:1789402624.163063:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224442368 00000100:00100000:3.0:1789402624.163132:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789402624.163143:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+16:14424:x1876324224442368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402624.163171:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402624.163190:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6fb90d000/0x9403f4af875f8fa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8f9f expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.163221:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6fb90d000/0x9403f4af875f8fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8f9f expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.163235:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6fb90d000/0x9403f4af875f8fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8f9f expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.163257:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d000, rc 0) 00000100:00100000:3.0:1789402624.163323:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:14424:x1876324224442368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.163330:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789402624.163415:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789402624.163438:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de400/0x9403f4af875f8f9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8fa6 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402624.163449:0:14424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de400/0x9403f4af875f8f9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8fa6 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402624.163548:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402624.163581:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402624.163601:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e6214240 going to sleep for 11 seconds 00000100:00100000:1.0:1789402624.164228:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224442496 00000100:00100000:1.0:1789402624.164250:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224442496 00000100:00100000:1.0:1789402624.164305:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789402624.164314:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:14424:x1876324224442496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402624.165395:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:14424:x1876324224442496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1031us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402624.165409:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789402624.173257:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789402624.174785:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402624.174917:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402624.174980:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e6214240 going to sleep for 11 seconds 00000100:00100000:2.0:1789402624.175219:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224442624 00000100:00100000:2.0:1789402624.175230:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224442624 00000100:00100000:2.0:1789402624.175315:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789402624.175327:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:14424:x1876324224442624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789402624.175619:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:14424:x1876324224442624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 293us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402624.175829:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789402624.176441:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789402624.181901:0:16607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789402624.182235:0:14424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789402624.182273:0:14424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789402624.182288:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de400/0x9403f4af875f8f9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8fa6 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402624.182304:0:14424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6ef3de400/0x9403f4af875f8f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8fa6 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402624.182317:0:14424:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789402624.182320:0:14424:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6fa960800 from 10 10000000:01000000:2.0:1789402624.182324:0:14424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789402624.183290:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dee00/0x9403f4af875f8fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402624.183305:0:14424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dee00/0x9403f4af875f8fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402624.183319:0:14424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dee00/0x9403f4af875f8fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402624.183392:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789402624.183881:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402624.183980:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c2403840 going to sleep for 11 seconds 00000100:00100000:3.0:1789402624.184541:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224442752 00000100:00100000:3.0:1789402624.184554:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224442752 00000100:00100000:3.0:1789402624.184619:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789402624.184827:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+17:14424:x1876324224442752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402624.184849:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402624.184871:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c6fb90d800/0x9403f4af875f8fb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8fad expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.184929:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c6fb90d800/0x9403f4af875f8fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8fad expref: 18 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.184942:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c6fb90d800/0x9403f4af875f8fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8fad expref: 18 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.185183:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d800, rc 0) 00000100:00100000:3.0:1789402624.185333:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:14424:x1876324224442752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 702us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.185372:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789402624.185572:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789402624.185594:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dee00/0x9403f4af875f8fad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8fb4 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402624.185606:0:14424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dee00/0x9403f4af875f8fad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8fb4 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402624.185843:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402624.185887:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402624.185977:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c2403840 going to sleep for 11 seconds 00000100:00100000:3.0:1789402624.186263:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224442880 00000100:00100000:3.0:1789402624.186271:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224442880 00000100:00100000:3.0:1789402624.186412:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789402624.186431:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:14424:x1876324224442880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402624.186779:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:14424:x1876324224442880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.186789:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789402624.186876:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224442880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789402624.186923:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224443008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789402624.186989:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402624.187640:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c2403840 going to sleep for 11 seconds 00000100:00100000:0.0:1789402624.187756:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224443008 00000100:00100000:0.0:1789402624.187764:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224443008 00000100:00100000:0.0:1789402624.187806:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789402624.187827:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:14424:x1876324224443008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789402624.188289:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:14424:x1876324224443008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 463us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402624.188298:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789402624.188409:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224443008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789402624.189823:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789402624.190766:0:14424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789402624.190807:0:14424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789402624.190823:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dee00/0x9403f4af875f8fad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8fb4 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.190839:0:14424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6ef3dee00/0x9403f4af875f8fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8fb4 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789402624.191170:0:14424:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789402624.191175:0:14424:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6ffaae000 from 10 10000000:01000000:2.0:1789402624.191180:0:14424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789402624.191808:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df200/0x9403f4af875f8fbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402624.191820:0:14424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df200/0x9403f4af875f8fbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402624.191834:0:14424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df200/0x9403f4af875f8fbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402624.191868:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224443136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789402624.192189:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402624.192300:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c24039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789402624.192781:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224443136 00000100:00100000:0.0:1789402624.192792:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224443136 00000100:00100000:1.0:1789402624.193613:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789402624.193630:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+18:14424:x1876324224443136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789402624.195462:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402624.195497:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c5c25cc000/0x9403f4af875f8fc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9403f4af875f8fbb expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402624.195542:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c5c25cc000/0x9403f4af875f8fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9403f4af875f8fbb expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402624.195558:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c5c25cc000/0x9403f4af875f8fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9403f4af875f8fbb expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402624.195568:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cc000, rc 0) 00000100:00100000:1.0:1789402624.195708:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:14424:x1876324224443136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2082us (3518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402624.195719:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789402624.195796:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224443136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789402624.195832:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df200/0x9403f4af875f8fbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8fc2 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402624.195844:0:14424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df200/0x9403f4af875f8fbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9403f4af875f8fc2 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402624.195936:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224443264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402624.195989:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402624.196027:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224443264 00000100:00100000:1.0:1789402624.196037:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224443264 00000100:00100000:3.0:1789402624.196043:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789402624.196082:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789402624.196094:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:14424:x1876324224443264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789402624.196979:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:14424:x1876324224443264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 884us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402624.197118:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789402624.197389:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224443264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789402624.197453:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224443392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789402624.197519:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402624.197547:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789402624.198090:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224443392 00000100:00100000:1.0:1789402624.198098:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224443392 00000100:00100000:1.0:1789402624.198153:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789402624.198164:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:14424:x1876324224443392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789402624.198568:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:14424:x1876324224443392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 405us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402624.198847:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789402624.198923:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:14424:1876324224443392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789402624.201998:0:16609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789402624.202265:0:14424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789402624.202311:0:14424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789402624.202327:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df200/0x9403f4af875f8fbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8fc2 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402624.202441:0:14424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.108@tcp lock: ffff93c6ef3df200/0x9403f4af875f8fbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9403f4af875f8fc2 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402624.226903:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224443648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789402624.226999:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789402624.227008:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224443776:0@lo:400:kworker.0 00000100:00100000:0.0:1789402624.227043:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402624.227050:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789402624.227056:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224443520:0@lo:400:kworker.0 00000100:00100000:2.0:1789402624.227145:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402624.227201:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224443904:0@lo:400:kworker.0 00000100:00100000:1.0:1789402624.227237:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402624.227297:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224443648 00000100:00100000:2.0:1789402624.227308:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224443648 00000100:00100000:2.0:1789402624.227414:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789402624.227424:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224443648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789402624.227467:0:15115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402624.227519:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224443648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402624.227528:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789402624.227555:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224443776 00000100:00100000:2.0:1789402624.227560:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224443776 00000100:00100000:2.0:1789402624.227582:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224443520 00000100:00100000:2.0:1789402624.227585:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224443520 00000100:00100000:2.0:1789402624.227601:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789402624.227607:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224443776:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789402624.227773:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789402624.227778:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789402624.229332:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789402624.229371:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789402624.229538:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789402624.229556:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224443520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789402624.229653:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876324224443520:12345-0@lo:400:kworker.0 Request processed in 104us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402624.229661:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789402624.229968:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224444032:0@lo:400:kworker.0 00000100:00100000:3.0:1789402624.230025:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402624.230057:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789402624.230062:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224444160:0@lo:400:kworker.0 00000100:00100000:3.0:1789402624.230082:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402624.230108:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224443904 00000100:00100000:3.0:1789402624.230117:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224443904 00000100:00100000:3.0:1789402624.230148:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224444032 00000100:00100000:3.0:1789402624.230151:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224444032 00000100:00100000:3.0:1789402624.230174:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224444160 00000100:00100000:3.0:1789402624.230177:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224444160 00000100:00100000:3.0:1789402624.230191:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789402624.230197:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224443904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402624.230251:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876324224443904:12345-0@lo:400:kworker.0 Request processed in 42us (3001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.230268:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789402624.230286:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789402624.230291:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224444032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402624.230530:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224444032:12345-0@lo:400:kworker.0 Request processed in 49us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.230539:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789402624.230552:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789402624.230558:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224444160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402624.230599:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224444160:12345-0@lo:400:kworker.0 Request processed in 41us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402624.230605:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789402624.230633:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402624.230692:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876324224443904:0@lo:400:kworker.0 00000100:00100000:3.0:1789402624.230731:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224444160:0@lo:400:kworker.0 00000100:00100000:3.0:1789402624.230740:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224444032:0@lo:400:kworker.0 00000100:00100000:3.0:1789402624.232598:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224443520:0@lo:400:kworker.0 00000100:00100000:3.0:1789402624.232855:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876324224443648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789402624.232905:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224443776:12345-0@lo:400:kworker.0 Request processed in 5294us (5857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402624.232920:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789402624.235008:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224443776:0@lo:400:kworker.0 00010000:00010000:0.0:1789402625.061009:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402625.762754:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224444288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402625.762852:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402625.763170:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224444288 00000100:00100000:2.0:1789402625.763181:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224444288 00000100:00100000:2.0:1789402625.763253:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789402625.763266:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224444288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402625.763319:0:15115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402625.763414:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224444288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402625.763422:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789402625.763627:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224444288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402625.872591:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402625.872915:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199284480 00000100:00100000:3.0:1789402625.872930:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199284480 00000100:00100000:3.0:1789402625.873082:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:3.0:1789402625.873096:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+6:14417:x1876324199284480:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789402625.873135:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402625.873167:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8fc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47570 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.873675:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.873696:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.873714:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.873732:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.873740:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.873747:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874755:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8fde lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874774:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8fde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874784:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8fde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402625.874818:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789402625.874823:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789402625.874868:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8fde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874897:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874904:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874911:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874918:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402625.874923:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874931:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874946:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402625.874949:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402625.874956:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874963:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f8fd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874979:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874986:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.874992:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.875004:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90d400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402625.875007:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.875013:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.875020:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93c6d2ca6400) 00010000:00010000:3.0:1789402625.875023:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402625.875026:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.875033:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f8fd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.875082:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f8fc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47570 expref: 8 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.875099:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90c400/0x9403f4af875f8fde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47570 expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.875106:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c6d2ca6c00) 00010000:00010000:3.0:1789402625.875109:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789402625.875111:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90c400, rc 0) 00000100:00080000:1.0:1789402625.875378:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402625.877385:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+7:14417:x1876324199284480:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 4276us (4795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402625.877402:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:2.0:1789402625.906814:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402625.906997:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199284736 00000100:00100000:0.0:1789402625.907010:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199284736 00000100:00100000:0.0:1789402625.907080:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:0.0:1789402625.907093:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+7:14417:x1876324199284736:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402625.907121:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402625.907151:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f8fe5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47577 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.907258:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.907276:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.907304:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.907717:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.907740:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.907754:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.908219:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8ffa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.908290:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8ffa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.908300:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8ffa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789402625.908307:0:14427:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000004:00200000:0.0:1789402625.930129:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789402625.930832:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930844:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930852:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930877:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a83400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402625.930881:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930889:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930905:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c6d2ca6c00) 00010000:00010000:0.0:1789402625.930908:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402625.930912:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930919:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f8fec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930932:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930938:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930944:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930949:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402625.930952:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930958:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930976:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93c6c3a3eb00) 00010000:00010000:0.0:1789402625.930978:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402625.930982:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.930988:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f8ff3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.931554:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f8fe5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47577 expref: 10 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.931572:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83a00/0x9403f4af875f8ffa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47577 expref: 9 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.931580:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:0.0:1789402625.931582:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402625.931585:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83a00, rc 0) 00000100:00100000:0.0:1789402625.931656:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+9:14417:x1876324199284736:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 24565us (24856us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789402625.931665:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:0.0:1789402625.952790:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402625.953189:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199284864 00000100:00100000:3.0:1789402625.953213:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199284864 00000100:00100000:3.0:1789402625.953283:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:3.0:1789402625.953292:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+9:14417:x1876324199284864:12345-192.168.203.8@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789402625.953422:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+9:14417:x1876324199284864:12345-192.168.203.8@tcp:59:lhsmtool_posix.0 Request processed in 130us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402625.953428:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:0.0:1789402625.958014:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402625.958115:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199284992 00000100:00100000:2.0:1789402625.958125:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199284992 00000100:00100000:2.0:1789402625.958191:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:2.0:1789402625.958201:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+9:14423:x1876324199284992:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402625.958221:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402625.958250:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f9008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4757e expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958313:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958328:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958338:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958409:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958416:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958423:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958624:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958631:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958648:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958653:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402625.958657:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958666:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958677:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402625.958680:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402625.958685:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958691:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f900f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958702:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958708:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958713:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958718:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402625.958720:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958736:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958744:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c6c30f8a00) 00010000:00010000:2.0:1789402625.958747:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402625.958749:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958755:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9016 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958788:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f9008 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4757e expref: 10 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958798:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402625.958801:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402625.958805:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f9008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4757e expref: 10 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.958814:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dfa00, rc 0) 00000100:00100000:2.0:1789402625.959008:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+9:14423:x1876324199284992:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 807us (1002us total) trans 0 rc 301/301 00000100:00100000:2.0:1789402625.959015:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:0.0:1789402625.963188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402625.963556:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199285120 00000100:00100000:1.0:1789402625.963582:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199285120 00000100:00100000:1.0:1789402625.963654:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:1.0:1789402625.963666:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fd0f85ca-e975-4487-8e2d-28d921391c29+9:14423:x1876324199285120:12345-192.168.203.8@tcp:700:lfs.0 00000100:00100000:1.0:1789402625.963797:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fd0f85ca-e975-4487-8e2d-28d921391c29+9:14423:x1876324199285120:12345-192.168.203.8@tcp:700:lfs.0 Request processed in 132us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402625.963805:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:1.0:1789402625.974326:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402625.974594:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199285376 00000100:00100000:2.0:1789402625.974608:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199285376 00000100:00100000:2.0:1789402625.974686:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:2.0:1789402625.974698:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+9:14423:x1876324199285376:12345-192.168.203.8@tcp:36:lfs.0 00010000:00010000:2.0:1789402625.974800:0:14428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402625.974837:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f8f4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b474f9 expref: 9 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.974861:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:2.0:1789402625.974867:0:14428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789402625.975130:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.975153:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4755b expref: 5 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.975162:0:14428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.975205:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4755b expref: 5 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402625.975221:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4755b expref: 5 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402625.975251:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14428:1876324224444416:192.168.203.8@tcp:104: 00000100:00100000:2.0:1789402625.975437:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c5c2403c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789402625.978089:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402625.978382:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199285504 00000100:00100000:3.0:1789402625.978395:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199285504 00010000:00010000:3.0:1789402625.978465:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4755b expref: 6 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402625.978510:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:3.0:1789402625.978522:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:2352:x1876324199285504:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402625.978541:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402625.978549:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4755b expref: 6 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.978564:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4755b expref: 6 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.978594:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:3.0:1789402625.978602:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.978615:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.978623:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.978668:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402625.978735:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:2352:x1876324199285504:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 215us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402625.978744:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00080000:1.0:1789402625.979216:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789402625.979881:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f8f83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4755b expref: 5 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402625.979907:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14428:1876324224444416:192.168.203.8@tcp:104: 00010000:00010000:0.0:1789402625.979952:0:14428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.979963:0:14428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.979969:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.980002:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.980015:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.980025:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402625.983218:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789402625.983252:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.983262:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.983268:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.983272:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402625.983276:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.983283:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.983560:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c30f8000) 00010000:00010000:0.0:1789402625.983565:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402625.983571:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402625.983579:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f901d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789402625.983606:0:14428:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074fc10d1 reply state 0000000046f24f28 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402625.983661:0:14428:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789402625.983937:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+10:14423:x1876324199285376:12345-192.168.203.8@tcp:36:lfs.0 Request processed in 9172us (9558us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789402625.983948:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 19 00010000:00010000:3.0:1789402625.986143:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.986162:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.986169:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.986176:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402625.986180:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.986189:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.986212:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c6c3a3eb00) 00010000:00010000:3.0:1789402625.986215:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789402625.986221:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402625.986237:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9024 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402626.041527:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.041951:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199285632 00000100:00100000:0.0:1789402626.041965:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199285632 00000100:00100000:0.0:1789402626.042251:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:0.0:1789402626.042265:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+9:14431:x1876324199285632:12345-192.168.203.8@tcp:101:lctl.0 00010000:00010000:0.0:1789402626.042298:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402626.042329:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f902b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47585 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.042467:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f9032 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.042484:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.042522:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402626.042766:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789402626.042772:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402626.042821:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.042852:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f902b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47585 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.042874:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83c00/0x9403f4af875f9032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47585 expref: 10 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.042883:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402626.042886:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789402626.042890:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83c00, rc 0) 00000100:00100000:0.0:1789402626.042963:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+10:14431:x1876324199285632:12345-192.168.203.8@tcp:101:lctl.0 Request processed in 701us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402626.042971:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 20 00000100:00100000:2.0:1789402626.071549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.072086:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199285760 00000100:00100000:0.0:1789402626.072099:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199285760 00000100:00100000:0.0:1789402626.072220:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:0.0:1789402626.072243:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:14432:x1876324199285760:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402626.072271:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402626.072298:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4758c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.072442:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f9040 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.072459:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f9040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.072473:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f9040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402626.072517:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789402626.072522:0:14428:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402626.072546:0:14428:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f9040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.072575:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4758c expref: 7 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.072597:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83000/0x9403f4af875f9040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4758c expref: 6 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.072606:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402626.072609:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789402626.072613:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83000, rc 0) 00000100:00100000:0.0:1789402626.072691:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:14432:x1876324199285760:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 451us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402626.072698:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 21 00000100:00100000:1.0:1789402626.080759:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.080796:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.080812:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.080845:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.080877:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.080894:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.080951:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199286016 00000100:00100000:1.0:1789402626.080962:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199286016 00000100:00100000:3.0:1789402626.081017:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199286144 00000100:00100000:3.0:1789402626.081024:0:16610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199286144 00000100:00100000:3.0:1789402626.081077:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199286400 00000100:00100000:3.0:1789402626.081081:0:16610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199286400 00000100:00100000:3.0:1789402626.081096:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199286272 00000100:00100000:3.0:1789402626.081099:0:16610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199286272 00000100:00100000:3.0:1789402626.081112:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199286528 00000100:00100000:3.0:1789402626.081114:0:16610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199286528 00000100:00100000:3.0:1789402626.081130:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:3.0:1789402626.081140:0:16610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2351:x1876324199286144:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402626.081175:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 119 00000100:00100000:1.0:1789402626.081187:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:2351:x1876324199286016:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402626.081249:0:16610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2351:x1876324199286144:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 108us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402626.081255:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:2351:x1876324199286016:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 68us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402626.081264:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:1.0:1789402626.081269:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 119 00000100:00100000:3.0:1789402626.081293:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:0.0:1789402626.081299:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199285888 00000100:00100000:3.0:1789402626.081303:0:16610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2351:x1876324199286400:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:0.0:1789402626.081304:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199285888 00000100:00100000:3.0:1789402626.081330:0:16610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2351:x1876324199286400:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 29us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402626.081336:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:1.0:1789402626.081370:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 22 00000100:00100000:3.0:1789402626.081379:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:1.0:1789402626.081383:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:14432:x1876324199285888:12345-192.168.203.8@tcp:101:lfs.0 00000100:00100000:3.0:1789402626.081393:0:16610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2351:x1876324199286272:12345-192.168.203.8@tcp:400:kworker.0 00010000:00010000:1.0:1789402626.081402:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789402626.081422:0:16610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2351:x1876324199286272:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 33us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402626.081423:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:3.0:1789402626.081429:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:2.0:1789402626.081434:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2351:x1876324199286528:12345-192.168.203.8@tcp:400:kworker.0 00010000:00010000:1.0:1789402626.081435:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f9047 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47593 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789402626.081449:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789402626.081455:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789402626.081475:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2351:x1876324199286528:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 44us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402626.081482:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00010000:00010000:1.0:1789402626.081521:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.081540:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.081554:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.081571:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.081579:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.081586:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.081947:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f905c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.081971:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f905c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.081984:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f905c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402626.082028:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789402626.082032:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402626.082056:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f905c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082070:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082076:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082083:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082089:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402626.082093:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082101:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082113:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:1.0:1789402626.082128:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402626.082134:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082140:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f904e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082157:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082163:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082168:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082173:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cc800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402626.082176:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082181:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082189:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c6cbbac600) 00010000:00010000:1.0:1789402626.082192:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402626.082195:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.082200:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f9055 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.084463:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f9047 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47593 expref: 8 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.084523:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f905c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47593 expref: 7 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.084532:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:1.0:1789402626.084535:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789402626.084540:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cdc00, rc 0) 00000100:00100000:1.0:1789402626.084611:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+7:14432:x1876324199285888:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 3232us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402626.085964:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 22 00010000:00010000:0.0:1789402626.087632:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789402626.108901:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.113029:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199286784 00000100:00100000:0.0:1789402626.113043:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199286784 00000100:00100000:0.0:1789402626.113114:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:0.0:1789402626.113124:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+7:14432:x1876324199286784:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402626.113145:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402626.113164:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4759a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402626.113259:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789402626.113399:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9063 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4759a expref: 9 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.113416:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402626.113419:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789402626.113424:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4759a expref: 9 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.113439:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83400, rc 0) 00000100:00100000:0.0:1789402626.114863:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+8:14432:x1876324199286784:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 1729us (5960us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789402626.114874:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 23 00000100:00100000:0.0:1789402626.128475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.128571:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199287040 00000100:00100000:1.0:1789402626.128581:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199287040 00000100:00100000:3.0:1789402626.128779:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 24 00000100:00100000:3.0:1789402626.128791:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+8:14432:x1876324199287040:12345-192.168.203.8@tcp:36:lfs.0 00010000:00010000:3.0:1789402626.128856:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402626.128893:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f905c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47593 expref: 8 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.128912:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:3.0:1789402626.128923:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789402626.128949:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.128963:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.128974:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789402626.129183:0:14429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096f5f334 reply state 0000000026d7d78e transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402626.129193:0:14429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789402626.129202:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789402626.129979:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+9:14432:x1876324199287040:12345-192.168.203.8@tcp:36:lfs.0 Request processed in 1187us (1509us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789402626.129989:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 24 00000100:00100000:0.0:1789402626.143201:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.143380:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199287296 00000100:00100000:2.0:1789402626.143389:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199287296 00000100:00100000:2.0:1789402626.143442:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:2.0:1789402626.143453:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+9:14432:x1876324199287296:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:2.0:1789402626.143677:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+10:14432:x1876324199287296:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 226us (483us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789402626.143684:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 2 00010000:00010000:1.0:1789402626.143982:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.143994:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.144002:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.144008:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402626.144012:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.144020:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.144034:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c6d2ca6400) 00010000:00010000:1.0:1789402626.144048:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789402626.144054:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.144060:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ca00/0x9403f4af875f9071 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402626.148799:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.148907:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199287552 00000100:00100000:0.0:1789402626.148917:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199287552 00000100:00100000:0.0:1789402626.148974:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00100000:0.0:1789402626.148985:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+9:14432:x1876324199287552:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:0.0:1789402626.149022:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402626.149043:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9078 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475a1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149112:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149126:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149137:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149151:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149157:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149163:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789402626.149286:0:14428:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613255681 00000004:00200000:0.0:1789402626.149292:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789402626.149413:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149422:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149429:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149444:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402626.149449:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149457:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149468:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402626.149471:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402626.149476:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149482:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f907f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149494:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149500:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149505:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149510:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402626.149512:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149518:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149534:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c6c3a3e400) 00010000:00010000:0.0:1789402626.149536:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402626.149539:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149545:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9086 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149578:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9078 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a1 expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149587:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:0.0:1789402626.149590:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789402626.149593:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9078 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a1 expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.149601:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83400, rc 0) 00000100:00100000:0.0:1789402626.149662:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+10:14432:x1876324199287552:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 679us (872us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789402626.149669:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 25 00000100:00100000:3.0:1789402626.151863:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.152451:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199287680 00000100:00100000:1.0:1789402626.152460:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199287680 00000100:00100000:1.0:1789402626.152517:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 26 00000100:00100000:1.0:1789402626.152527:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+10:14432:x1876324199287680:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:1.0:1789402626.152549:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402626.152569:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f9094 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475a8 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.152657:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.152670:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.152685:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402626.152710:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789402626.152713:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402626.152728:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.152753:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f9094 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a8 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.152789:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a8 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.152797:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c6cbbac600) 00010000:00010000:1.0:1789402626.152800:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789402626.152803:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cda00, rc 0) 00000100:00100000:1.0:1789402626.152863:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+11:14432:x1876324199287680:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 337us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402626.152870:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 26 00000100:00100000:1.0:1789402626.156656:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.156715:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199287808 00000100:00100000:0.0:1789402626.156725:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199287808 00000100:00100000:0.0:1789402626.156768:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:0.0:1789402626.156778:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+11:14432:x1876324199287808:12345-192.168.203.8@tcp:37:lfs.0 00000100:00100000:0.0:1789402626.162784:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+11:14432:x1876324199287808:12345-192.168.203.8@tcp:37:lfs.0 Request processed in 5997us (6127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402626.162798:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:1.0:1789402626.177428:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.177522:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199288064 00000100:00100000:2.0:1789402626.177533:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199288064 00000100:00100000:2.0:1789402626.177594:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:2.0:1789402626.177604:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7004b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+11:14432:x1876324199288064:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:2.0:1789402626.178133:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7004b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+12:14432:x1876324199288064:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 528us (712us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789402626.178141:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:1.0:1789402626.285138:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.285479:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199288192 00000100:00100000:0.0:1789402626.285488:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199288192 00000100:00100000:2.0:1789402626.285841:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00100000:2.0:1789402626.285853:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+10:14438:x1876324199288192:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:2.0:1789402626.285874:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402626.285896:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475af expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.285960:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.285988:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.286000:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.286015:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.286023:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.286029:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288021:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f90b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288040:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f90b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288051:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f90b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402626.288094:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789402626.288099:0:14428:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402626.288148:0:14428:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f90b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288161:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288188:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288195:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288360:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402626.288370:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288379:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288393:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:2.0:1789402626.288396:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402626.288401:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288408:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288428:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288434:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288441:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288446:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402626.288455:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288461:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288469:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c6c30f8a00) 00010000:00010000:2.0:1789402626.288471:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402626.288474:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288480:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288520:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475af expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288536:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfc00/0x9403f4af875f90b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475af expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.288542:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c6cbbac600) 00010000:00010000:2.0:1789402626.288544:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789402626.288547:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dfc00, rc 0) 00000100:00100000:2.0:1789402626.288624:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+11:14438:x1876324199288192:12345-192.168.203.8@tcp:101:bash.0 Request processed in 2772us (3493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402626.288632:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00100000:3.0:1789402626.292339:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.292574:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199288448 00000100:00100000:1.0:1789402626.292584:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199288448 00000100:00100000:1.0:1789402626.292641:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:1.0:1789402626.292651:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+11:14438:x1876324199288448:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:1.0:1789402626.292672:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402626.292693:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd600/0x9403f4af875f90be lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475b6 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.292804:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.292818:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a8 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.292856:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.292888:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a8 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402626.292900:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a8 expref: 11 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402626.292913:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14427:1876324224444544:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402626.293006:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e6139f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789402626.299714:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.299852:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14427:1876324224444544:192.168.203.8@tcp:104: 00010000:00010000:2.0:1789402626.299879:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402626.300273:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199288576 00000100:00100000:3.0:1789402626.300283:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199288576 00010000:00010000:3.0:1789402626.300324:0:14413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a8 expref: 12 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402626.300393:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:3.0:1789402626.300403:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+12:2351:x1876324199288576:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402626.300425:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402626.300433:0:14413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a8 expref: 12 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.300445:0:14413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a8 expref: 12 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.300467:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cda00/0x9403f4af875f909b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475a8 expref: 12 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.300483:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c6cbbac600) 00010000:00010000:3.0:1789402626.300487:0:14413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.300497:0:14413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.300506:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.300533:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402626.300720:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+11:2351:x1876324199288576:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 317us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402626.300728:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00010000:00010000:2.0:1789402626.300958:0:14427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.300967:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.300991:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.301002:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.301009:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.303542:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.303571:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.303583:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789402626.303591:0:14427:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2749852811842 00000004:00200000:2.0:1789402626.303596:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:2.0:1789402626.303603:0:14427:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2749852811842 00010000:00010000:2.0:1789402626.313534:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.313560:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.313587:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.313593:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402626.313597:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.313605:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.313622:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c6cbbac600) 00010000:00010000:2.0:1789402626.313625:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402626.313629:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.313636:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cca00/0x9403f4af875f90c5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789402626.313653:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000319c9213 reply state 000000002d2a02e7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402626.313664:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789402626.313709:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd600/0x9403f4af875f90be lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475b6 expref: 14 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.313726:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475b6 expref: 13 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.313732:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402626.313734:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789402626.313743:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dfa00, rc 0) 00000100:00100000:2.0:1789402626.313993:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+14:14438:x1876324199288448:12345-192.168.203.8@tcp:101:bash.0 Request processed in 21342us (21790us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789402626.314002:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 28 00010000:00010000:0.0:1789402626.319082:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.319098:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.319105:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.319111:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402626.319116:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.319122:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.319139:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93c6c30f8a00) 00010000:00010000:0.0:1789402626.319142:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402626.319147:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.319152:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de600/0x9403f4af875f90cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402626.370335:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.370855:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199288704 00000100:00100000:2.0:1789402626.370864:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199288704 00000100:00100000:2.0:1789402626.370930:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 29 00000100:00100000:2.0:1789402626.370942:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+13:14438:x1876324199288704:12345-192.168.203.8@tcp:101:bash.0 00010000:00010000:2.0:1789402626.370967:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402626.370990:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475bd expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.371058:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.371082:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.371094:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402626.371134:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789402626.371138:0:14428:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789402626.371156:0:14428:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.371166:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.371189:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475bd expref: 15 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.371242:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475bd expref: 14 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.371251:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402626.371255:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402626.371258:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df400, rc 0) 00000100:00100000:2.0:1789402626.371318:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+14:14438:x1876324199288704:12345-192.168.203.8@tcp:101:bash.0 Request processed in 379us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402626.371325:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 29 00000100:00100000:1.0:1789402626.375104:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.375441:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199288960 00000100:00100000:2.0:1789402626.375451:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199288960 00000100:00100000:2.0:1789402626.375509:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:2.0:1789402626.375520:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+14:14438:x1876324199288960:12345-192.168.203.8@tcp:35:bash.0 00000100:00100000:2.0:1789402626.375842:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+15:14438:x1876324199288960:12345-192.168.203.8@tcp:35:bash.0 Request processed in 322us (747us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789402626.375850:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:0.0:1789402626.473091:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.473415:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199289216 00000100:00100000:2.0:1789402626.473429:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199289216 00000100:00100000:2.0:1789402626.473500:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 30 00000100:00100000:2.0:1789402626.473523:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+15:14448:x1876324199289216:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402626.473549:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402626.473571:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475c4 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402626.473655:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789402626.473769:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475c4 expref: 17 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.473783:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c6c3a3e600) 00010000:00010000:2.0:1789402626.473786:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789402626.473791:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475c4 expref: 17 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.473816:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3de000, rc 0) 00000100:00100000:2.0:1789402626.473877:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+16:14448:x1876324199289216:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 358us (800us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789402626.473884:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 30 00000100:00100000:3.0:1789402626.477089:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.477677:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199289472 00000100:00100000:2.0:1789402626.477692:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199289472 00000100:00100000:2.0:1789402626.477765:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:2.0:1789402626.477777:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+16:14448:x1876324199289472:12345-192.168.203.8@tcp:35:lfs.0 00000100:00100000:2.0:1789402626.478015:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+17:14448:x1876324199289472:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 240us (939us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789402626.478022:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:1.0:1789402626.511320:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.511449:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199289728 00000100:00100000:2.0:1789402626.511459:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199289728 00000100:00100000:2.0:1789402626.511524:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 31 00000100:00100000:2.0:1789402626.511536:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+17:14451:x1876324199289728:12345-192.168.203.8@tcp:101:lfs.0 00010000:00010000:2.0:1789402626.511561:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402626.511582:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475cb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.511701:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dea00/0x9403f4af875f9104 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.511714:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dea00/0x9403f4af875f9104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.511725:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dea00/0x9403f4af875f9104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402626.511735:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:2.0:1789402626.511743:0:14428:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133185 00010000:00010000:2.0:1789402626.511871:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f90fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475cb expref: 20 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.511889:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dea00/0x9403f4af875f9104 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475cb expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.511897:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402626.511899:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402626.511903:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3dea00, rc 0) 00000100:00100000:2.0:1789402626.511955:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+19:14451:x1876324199289728:12345-192.168.203.8@tcp:101:lfs.0 Request processed in 423us (645us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789402626.511962:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 31 00000100:00100000:0.0:1789402626.516948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.517065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402626.518339:0:16539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199289984 00000100:00100000:3.0:1789402626.518393:0:16539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199289984 00000100:00100000:3.0:1789402626.518499:0:16539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:3.0:1789402626.518511:0:16539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+19:2354:x1876324199289984:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402626.518604:0:16539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402626.518637:0:16539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dea00/0x9403f4af875f9104 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475cb expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.518661:0:16539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:3.0:1789402626.518667:0:16539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402626.518747:0:16539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+18:2354:x1876324199289984:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 238us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402626.518997:0:16539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:2.0:1789402626.519978:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199289856 00000100:00100000:2.0:1789402626.519991:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199289856 00000100:00100000:2.0:1789402626.520052:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 32 00000100:00100000:2.0:1789402626.520065:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+18:14451:x1876324199289856:12345-192.168.203.8@tcp:54:lfs.0 00010000:00010000:2.0:1789402626.520155:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.520189:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.520205:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.520250:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.520258:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.520266:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.520272:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402626.520277:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.520285:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.520297:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402626.520300:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789402626.520306:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.520313:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9112 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402626.520429:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+18:14451:x1876324199289856:12345-192.168.203.8@tcp:54:lfs.0 Request processed in 368us (3496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402626.520442:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 32 00000100:00100000:1.0:1789402626.526980:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.531921:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199290240 00000100:00100000:0.0:1789402626.531942:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199290240 00000100:00100000:0.0:1789402626.533121:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:0.0:1789402626.533137:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+18:14451:x1876324199290240:12345-192.168.203.8@tcp:35:lfs.0 00000040:00080000:1.0:1789402626.533291:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789402626.533551:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+19:14451:x1876324199290240:12345-192.168.203.8@tcp:35:lfs.0 Request processed in 417us (6583us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789402626.533560:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:1.0:1789402626.747998:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.748242:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199290496 00000100:00100000:2.0:1789402626.748255:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199290496 00000100:00100000:2.0:1789402626.748332:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:2.0:1789402626.748377:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+19:14482:x1876324199290496:12345-192.168.203.8@tcp:101:cat.0 00010000:00010000:2.0:1789402626.748411:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789402626.748442:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9119 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475d2 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.748700:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f9120 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.748717:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f9120 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.748731:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f9120 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789402626.748744:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:2.0:1789402626.748754:0:14428:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199065198593 00010000:00010000:2.0:1789402626.748928:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9119 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475d2 expref: 22 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.748952:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f9120 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475d2 expref: 21 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.748962:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402626.748965:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789402626.749152:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6ef3df800, rc 0) 00000100:00100000:2.0:1789402626.749292:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+21:14482:x1876324199290496:12345-192.168.203.8@tcp:101:cat.0 Request processed in 948us (1307us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789402626.749301:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 33 00000100:00100000:1.0:1789402626.752411:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402626.752580:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199290624 00000100:00100000:3.0:1789402626.752592:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199290624 00000100:00100000:3.0:1789402626.752676:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00100000:3.0:1789402626.752687:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+21:2352:x1876324199290624:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789402626.752705:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789402626.752733:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df800/0x9403f4af875f9120 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475d2 expref: 21 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.752755:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:3.0:1789402626.752769:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789402626.752826:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+20:2352:x1876324199290624:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 142us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402626.752834:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00100000:1.0:1789402626.759744:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402626.759833:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199290880 00000100:00100000:3.0:1789402626.759846:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199290880 00000100:00100000:3.0:1789402626.759951:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:3.0:1789402626.759965:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+20:14482:x1876324199290880:12345-192.168.203.8@tcp:35:cat.0 00000100:00100000:3.0:1789402626.760494:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+21:14482:x1876324199290880:12345-192.168.203.8@tcp:35:cat.0 Request processed in 531us (761us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789402626.760503:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 8 00000100:00100000:1.0:1789402626.814452:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402626.814619:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199291136 00000100:00100000:3.0:1789402626.814633:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199291136 00000100:00100000:3.0:1789402626.814709:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 34 00000100:00100000:3.0:1789402626.814722:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+21:14488:x1876324199291136:12345-192.168.203.8@tcp:101:dd.0 00010000:00010000:3.0:1789402626.814754:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402626.814780:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f912e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475d9 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.814917:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.814941:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475b6 expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.814951:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475bd expref: 22 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.814960:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.815004:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475bd expref: 22 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.815030:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475bd expref: 22 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402626.815073:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff632d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14429:1876324224444672:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402626.819574:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475b6 expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.819594:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475b6 expref: 22 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402626.819614:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6ff630380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14429:1876324224444800:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402626.819644:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6fb75fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402626.823385:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402626.823432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402626.823568:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff632d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14429:1876324224444672:192.168.203.8@tcp:104: 00000100:00100000:3.0:1789402626.823584:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6ff630380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14429:1876324224444800:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402626.823625:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402626.823714:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199291264 00000100:00100000:0.0:1789402626.823723:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199291264 00010000:00010000:0.0:1789402626.823769:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475bd expref: 23 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402626.823809:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199291392 00000100:00100000:0.0:1789402626.823812:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199291392 00010000:00010000:0.0:1789402626.823827:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475b6 expref: 24 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402626.823859:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:0.0:1789402626.823870:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6f7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+24:2351:x1876324199291264:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402626.823888:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402626.823896:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475bd expref: 24 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.823909:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475bd expref: 24 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.823931:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f90e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475bd expref: 24 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.823965:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:0.0:1789402626.823969:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.823978:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.823982:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402626.824042:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6f7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+23:2351:x1876324199291264:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 175us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402626.824047:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:0.0:1789402626.824195:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:0.0:1789402626.824200:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+22:2351:x1876324199291392:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402626.824207:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402626.824210:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475b6 expref: 22 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.824217:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475b6 expref: 22 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.825494:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3dfa00/0x9403f4af875f90d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475b6 expref: 22 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.825516:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:0.0:1789402626.825522:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.825554:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.825563:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.825601:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402626.825674:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+21:2351:x1876324199291392:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 1470us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402626.825684:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 12 00010000:00010000:3.0:1789402626.826326:0:14429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.826338:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789402626.826407:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:3.0:1789402626.826433:0:14429:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:3.0:1789402626.826643:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f912e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475d9 expref: 22 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.826666:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90ce00/0x9403f4af875f9135 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475d9 expref: 21 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.826687:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:3.0:1789402626.826690:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789402626.826694:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90ce00, rc 0) 00000100:00100000:3.0:1789402626.826802:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+21:14488:x1876324199291136:12345-192.168.203.8@tcp:101:dd.0 Request processed in 12083us (12362us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789402626.826811:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 34 00000100:00100000:1.0:1789402626.833430:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.833652:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199291648 00000100:00100000:2.0:1789402626.833666:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199291648 00000100:00100000:2.0:1789402626.833742:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 35 00000100:00100000:2.0:1789402626.833755:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+21:14488:x1876324199291648:12345-192.168.203.8@tcp:36:dd.0 00010000:00010000:2.0:1789402626.834126:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.834146:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.834160:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789402626.834219:0:14428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789402626.834272:0:14428:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000801858d5 reply state 0000000072e5d9d2 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402626.834281:0:14428:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789402626.834604:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14488:x1876324199291648:12345-192.168.203.8@tcp:36:dd.0 Request processed in 849us (1186us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789402626.834613:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 35 00000020:00080000:2.0:1789402626.834625:0:14428:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789402626.839768:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402626.839924:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199291776 00000100:00100000:3.0:1789402626.839938:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199291776 00010000:00010000:2.0:1789402626.840106:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.840121:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.840153:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.840160:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3de000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1789402626.840166:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.840176:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.840194:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402626.840198:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789402626.840205:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.840212:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3de000/0x9403f4af875f9143 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402626.840287:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 36 00000100:00100000:3.0:1789402626.840301:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+23:14488:x1876324199291776:12345-192.168.203.8@tcp:101:dd.0 00010000:00010000:3.0:1789402626.840332:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789402626.840400:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f914a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475e0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.840472:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f914a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e0 expref: 24 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.840487:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f914a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e0 expref: 24 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402626.840511:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:3.0:1789402626.840514:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402626.840516:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6fb90d400, rc 0) 00000100:00100000:3.0:1789402626.840584:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14488:x1876324199291776:12345-192.168.203.8@tcp:101:dd.0 Request processed in 286us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402626.840603:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 36 00000100:00100000:0.0:1789402626.860341:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402626.860599:0:16539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199292032 00000100:00100000:2.0:1789402626.860612:0:16539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199292032 00000100:00100000:2.0:1789402626.860703:0:16539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:2.0:1789402626.860716:0:16539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14488:x1876324199292032:12345-192.168.203.8@tcp:103:dd.0 00010000:00010000:2.0:1789402626.860738:0:16539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402626.860775:0:16539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6fb90d400/0x9403f4af875f914a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e0 expref: 24 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402626.860800:0:16539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:2.0:1789402626.860806:0:16539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402626.860881:0:16539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+23:14488:x1876324199292032:12345-192.168.203.8@tcp:103:dd.0 Request processed in 167us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402626.860906:0:16539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:2.0:1789402626.866608:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.866695:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199292160 00000100:00100000:0.0:1789402626.866708:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199292160 00000100:00100000:0.0:1789402626.866784:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 37 00000100:00100000:0.0:1789402626.866797:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+23:14488:x1876324199292160:12345-192.168.203.8@tcp:58:dd.0 00010000:00010000:0.0:1789402626.866971:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.866993:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.867007:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789402626.867946:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789402626.868117:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789402626.868200:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789402626.868404:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+23:14488:x1876324199292160:12345-192.168.203.8@tcp:58:dd.0 Request processed in 1605us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402626.868433:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 37 00000100:00100000:3.0:1789402626.871139:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402626.871440:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199292288 00000100:00100000:0.0:1789402626.871453:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199292288 00000100:00100000:0.0:1789402626.871529:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 38 00000100:00100000:0.0:1789402626.871541:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+23:14488:x1876324199292288:12345-192.168.203.8@tcp:101:dd.0 00010000:00010000:0.0:1789402626.871569:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402626.871598:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9158 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475e7 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.871675:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.871689:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9158 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e7 expref: 24 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.871714:0:14429:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.871730:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9158 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e7 expref: 24 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.871748:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:0.0:1789402626.871752:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789402626.871756:0:14429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9158 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e7 expref: 24 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402626.871765:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a83400, rc 0) 00000100:00100000:0.0:1789402626.871837:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14488:x1876324199292288:12345-192.168.203.8@tcp:101:dd.0 Request processed in 299us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402626.871862:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 38 00010000:00010000:0.0:1789402627.107122:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789402627.554752:0:14461:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789402627.554761:0:14461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789402627.555300:0:14461:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789402627.555309:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789402627.555557:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14461:1876324224444928:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789402627.555710:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e6139480 going to sleep for 11 seconds 00000100:00100000:1.0:1789402627.562929:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14461:1876324224444928:192.168.203.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789402627.569288:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.571966:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199292416 00000100:00100000:1.0:1789402627.571981:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199292416 00000100:00100000:1.0:1789402627.572049:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:1.0:1789402627.572073:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14489:x1876324199292416:12345-192.168.203.8@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789402627.572168:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14489:x1876324199292416:12345-192.168.203.8@tcp:900:lhsmtool_posix.0 Request processed in 110us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402627.572175:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00080000:3.0:1789402627.574204:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402627.576622:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402627.582460:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199292544 00000100:00100000:2.0:1789402627.582475:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199292544 00000100:00100000:2.0:1789402627.582614:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:2.0:1789402627.582625:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14489:x1876324199292544:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789402627.582654:0:14428:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789402627.585510:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14489:x1876324199292544:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 2876us (8883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402627.585526:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 39 00000100:00100000:3.0:1789402627.589443:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.589553:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199292672 00000100:00100000:1.0:1789402627.589565:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199292672 00000100:00100000:1.0:1789402627.589623:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 40 00000100:00100000:1.0:1789402627.589634:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14489:x1876324199292672:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789402627.589703:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589720:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589732:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589760:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589785:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589793:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589820:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589828:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589834:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789402627.589870:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789402627.589874:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789402627.589890:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589900:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589906:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589912:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589918:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cc600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402627.589921:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589933:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589944:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:1.0:1789402627.589947:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402627.589952:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589957:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f915f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589970:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589976:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589981:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589987:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cc200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402627.589990:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.589995:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.590002:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93c6cbbac000) 00010000:00010000:1.0:1789402627.590005:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402627.590008:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.590023:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9166 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.590037:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.590042:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.590047:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.590052:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cdc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402627.590055:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.590074:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.590081:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:1.0:1789402627.590084:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402627.590087:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.590092:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f916d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402627.590161:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14489:x1876324199292672:12345-192.168.203.8@tcp:34:lhsmtool_posix.0 Request processed in 528us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402627.590168:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 40 00000100:00100000:1.0:1789402627.594523:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.594650:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199292928 00000100:00100000:0.0:1789402627.594659:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199292928 00000100:00100000:0.0:1789402627.594712:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:0.0:1789402627.594723:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+24:14489:x1876324199292928:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402627.594759:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402627.594781:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9174 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475ee expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.594876:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.594891:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.594902:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402627.594914:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:0.0:1789402627.594923:0:14428:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:0.0:1789402627.595024:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.595032:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.595039:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.595078:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402627.595083:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.595091:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.595104:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:0.0:1789402627.595107:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789402627.595112:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.595117:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f917b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.595156:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9174 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475ee expref: 26 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.595167:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c6c3a3e700) 00010000:00010000:0.0:1789402627.595169:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789402627.595173:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f9174 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475ee expref: 26 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.595182:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82000, rc 0) 00000100:00100000:0.0:1789402627.595251:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+25:14489:x1876324199292928:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 530us (738us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789402627.595259:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 41 00000100:00100000:3.0:1789402627.602278:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.602396:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199293056 00000100:00100000:0.0:1789402627.602418:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199293056 00000100:00100000:0.0:1789402627.602467:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 42 00000100:00100000:0.0:1789402627.602476:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+25:14489:x1876324199293056:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789402627.602524:0:14429:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789402627.602624:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+25:14489:x1876324199293056:12345-192.168.203.8@tcp:53:lhsmtool_posix.0 Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402627.602631:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 42 00000100:00100000:3.0:1789402627.644413:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.644509:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199293312 00000100:00100000:1.0:1789402627.644519:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199293312 00000100:00100000:1.0:1789402627.644578:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 43 00000100:00100000:1.0:1789402627.644589:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ff633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+25:14489:x1876324199293312:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789402627.644610:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402627.644630:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f9189 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475f5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789402627.645386:0:14427:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1789402627.645394:0:14427:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1789402627.645455:0:14427:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1789402627.645716:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9190 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.645730:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.645740:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789402627.645747:0:14427:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:1.0:1789402627.645757:0:14427:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:1.0:1789402627.645801:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cdc00/0x9403f4af875f9189 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475f5 expref: 28 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.645819:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9190 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475f5 expref: 27 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.645828:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbac000) 00010000:00010000:1.0:1789402627.645837:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789402627.645841:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cc200, rc 0) 00000100:00100000:1.0:1789402627.645904:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ff633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+27:14489:x1876324199293312:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 1316us (1500us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789402627.645911:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 43 00000100:00100000:3.0:1789402627.650589:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.650883:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199293568 00000100:00100000:1.0:1789402627.650893:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199293568 00000100:00100000:1.0:1789402627.650946:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:1.0:1789402627.650956:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+27:14489:x1876324199293568:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789402627.651010:0:14428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402627.651035:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f9190 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475f5 expref: 27 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651065:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbac000) 00010000:00010000:1.0:1789402627.651075:0:14428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402627.651096:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651108:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651117:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651131:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651139:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651164:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651235:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651242:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651249:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651255:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cc600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402627.651259:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651267:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651275:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c6cbbac600) 00010000:00010000:1.0:1789402627.651278:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402627.651281:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651287:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc600/0x9403f4af875f919e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651295:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651302:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651315:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651320:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cd000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402627.651324:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651331:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651340:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa5070eaa (ffff93c6cbbac900) 00010000:00010000:1.0:1789402627.651373:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402627.651377:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.651382:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cd000/0x9403f4af875f91a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa5070eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402627.651459:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+26:14489:x1876324199293568:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 505us (878us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789402627.651467:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 44 00000100:00100000:3.0:1789402627.654313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.654439:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199293696 00000100:00100000:1.0:1789402627.654449:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199293696 00000100:00100000:1.0:1789402627.654504:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:1.0:1789402627.654513:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+26:14489:x1876324199293696:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789402627.654531:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402627.654562:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f91ac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b475fc expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.654612:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc400/0x9403f4af875f91b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.654625:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc400/0x9403f4af875f91b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.654635:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc400/0x9403f4af875f91b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.654723:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc800/0x9403f4af875f91ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475fc expref: 28 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.654739:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc400/0x9403f4af875f91b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475fc expref: 27 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.654747:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:1.0:1789402627.654759:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789402627.654763:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cc400, rc 0) 00000100:00100000:1.0:1789402627.654820:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+27:14489:x1876324199293696:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 307us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402627.654827:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 45 00000100:00100000:3.0:1789402627.659928:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.660555:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199293952 00000100:00100000:0.0:1789402627.660565:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199293952 00000100:00100000:0.0:1789402627.660621:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 46 00000100:00100000:0.0:1789402627.660630:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+27:14489:x1876324199293952:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789402627.660709:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.660725:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.660736:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789402627.661119:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789402627.661129:0:14429:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 532809784791ns, next at 533809782625ns, rc = 0 00000004:00010000:0.0:1789402627.661212:0:14429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000daa18085 reply state 00000000e41f00f2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402627.661233:0:14429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789402627.661327:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+29:14489:x1876324199293952:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 697us (1407us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789402627.661334:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 46 00010000:00010000:0.0:1789402627.666326:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.666377:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.666384:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.666389:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402627.666394:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.666402:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.666417:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:0.0:1789402627.666420:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789402627.666424:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.666430:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91ba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402627.667959:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.668688:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199294080 00000100:00100000:0.0:1789402627.668698:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199294080 00000100:00100000:0.0:1789402627.668886:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:0.0:1789402627.668897:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+28:14489:x1876324199294080:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402627.668921:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402627.668940:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47603 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.669018:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47603 expref: 29 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.669032:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47603 expref: 29 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.669051:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:0.0:1789402627.669054:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789402627.669058:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c6c2a82a00, rc 0) 00000100:00100000:0.0:1789402627.669121:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+29:14489:x1876324199294080:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 225us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402627.669128:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 47 00000100:00100000:3.0:1789402627.671711:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.671850:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199294208 00000100:00100000:1.0:1789402627.671859:0:16610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199294208 00000100:00100000:1.0:1789402627.671911:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:1.0:1789402627.671920:0:16610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2352:x1876324199294208:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789402627.672246:0:16610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+6:2352:x1876324199294208:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 321us (538us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789402627.672270:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 12 00000100:00100000:1.0:1789402627.675110:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.675204:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199294464 00000100:00100000:0.0:1789402627.675221:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199294464 00000100:00100000:0.0:1789402627.675272:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:0.0:1789402627.675282:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+29:14489:x1876324199294464:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789402627.675519:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+30:14489:x1876324199294464:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 237us (417us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789402627.675527:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 9 00000100:00100000:2.0:1789402627.677900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.678253:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199294720 00000100:00100000:1.0:1789402627.678262:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199294720 00000100:00100000:1.0:1789402627.678388:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:1.0:1789402627.678402:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+30:14489:x1876324199294720:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789402627.678512:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+30:14489:x1876324199294720:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 115us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402627.678519:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 48 00000100:00100000:1.0:1789402627.681448:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.681537:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199294848 00000100:00100000:0.0:1789402627.681557:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199294848 00000100:00100000:0.0:1789402627.681614:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:0.0:1789402627.681623:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+30:14489:x1876324199294848:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789402627.681643:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789402627.681678:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b4760a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.681783:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378000/0x9403f4af875f91cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.681798:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378000/0x9403f4af875f91cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.681810:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378000/0x9403f4af875f91cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789402627.681845:0:14428:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789402627.681863:0:14428:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378000/0x9403f4af875f91cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.681888:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82000/0x9403f4af875f91c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4760a expref: 32 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.681904:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378000/0x9403f4af875f91cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4760a expref: 31 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.681912:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:0.0:1789402627.681915:0:14428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789402627.681918:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701378000, rc 0) 00000100:00100000:0.0:1789402627.681980:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+31:14489:x1876324199294848:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 358us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402627.681987:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 49 00000100:00100000:2.0:1789402627.694696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.694853:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199294976 00000100:00100000:1.0:1789402627.694863:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199294976 00000100:00100000:1.0:1789402627.694966:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:1.0:1789402627.694977:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+6:2352:x1876324199294976:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789402627.694994:0:15111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402627.695015:0:15111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47611 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789402627.695041:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa81e02, blocks: 0x1 00010000:00010000:1.0:1789402627.695060:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1789402627.695066:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402627.695075:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47611 expref: 7 pid: 15111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.695096:0:15111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47611 expref: 7 pid: 15111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.695123:0:15111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cc600, rc 0) 00000100:00100000:1.0:1789402627.695191:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+7:2352:x1876324199294976:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 215us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402627.695199:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:2.0:1789402627.706203:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.706400:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199295232 00000100:00100000:1.0:1789402627.706411:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199295232 00000100:00100000:1.0:1789402627.706465:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 50 00000100:00100000:1.0:1789402627.706475:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+31:14489:x1876324199295232:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789402627.706679:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+31:14489:x1876324199295232:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 205us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402627.706687:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 50 00000100:00100000:3.0:1789402627.711523:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.711605:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199295360 00000100:00100000:0.0:1789402627.711616:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199295360 00000100:00100000:0.0:1789402627.711691:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 51 00000100:00100000:0.0:1789402627.711702:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+31:14489:x1876324199295360:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789402627.806368:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1789402627.806385:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789402627.806406:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+29:14489:x1876324199295360:12345-192.168.203.8@tcp:44:lhsmtool_posix.0 Request processed in 94702us (94888us total) trans 0 rc 0/0 00000001:00080000:1.0:1789402627.806410:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000100:00100000:0.0:1789402627.806417:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 51 00000001:00080000:1.0:1789402627.806440:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789402627.806978:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224445056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789402627.807036:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789402627.807082:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224445056 00000100:00100000:1.0:1789402627.807091:0:16610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224445056 00000100:00100000:1.0:1789402627.807156:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789402627.807165:0:16610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876324224445056:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1789402627.807236:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789402627.807322:0:16610:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789402627.807326:0:16610:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789402627.807328:0:16610:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789402627.807330:0:16610:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789402626 -> 1789402626 00002000:00010000:1.0:1789402627.807333:0:16610:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789402627.808414:0:16610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1876324224445056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1247us (1374us total) trans 8589934595 rc 0/0 00000004:00080000:3.0:1789402627.808419:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6da91ea00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789402627.808429:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da91ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876324224445056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789402627.808443:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789402627.816846:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.817027:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199295488 00000100:00100000:0.0:1789402627.817037:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199295488 00000100:00100000:0.0:1789402627.817166:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:0.0:1789402627.817177:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da91d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+7:2351:x1876324199295488:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789402627.817306:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da91d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+7:2351:x1876324199295488:12345-192.168.203.8@tcp:16:lhsmtool_posix.0 Request processed in 130us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402627.817314:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:2.0:1789402627.822780:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.822889:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199295744 00000100:00100000:1.0:1789402627.822900:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199295744 00000100:00100000:1.0:1789402627.822961:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 52 00000100:00100000:1.0:1789402627.822971:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+14:14489:x1876324199295744:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789402627.823023:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402627.823050:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378000/0x9403f4af875f91cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b4760a expref: 14 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.823071:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:1.0:1789402627.823076:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789402627.823107:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.823123:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.823133:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789402627.823669:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000102319ba reply state 000000006289eda9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402627.823679:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789402627.823789:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+15:14489:x1876324199295744:12345-192.168.203.8@tcp:36:lhsmtool_posix.0 Request processed in 819us (1017us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789402627.823797:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 52 00010000:00010000:1.0:1789402627.828543:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.828574:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.828582:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.828589:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cc200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1789402627.828594:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.828601:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.828625:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:1.0:1789402627.828628:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789402627.828632:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.828638:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c5c25cc200/0x9403f4af875f91dd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402627.843729:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.843930:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199295872 00000100:00100000:1.0:1789402627.843939:0:16610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199295872 00000100:00100000:1.0:1789402627.843999:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:1.0:1789402627.844010:0:16610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+7:14489:x1876324199295872:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789402627.844028:0:16610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789402627.844047:0:16610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c28020d00b47618 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.844097:0:16610:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47611 expref: 8 pid: 15111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.844106:0:16610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402627.844110:0:16610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402627.844116:0:16610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 8 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.844150:0:16610:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47611 expref: 8 pid: 15111 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.844163:0:16610:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47611 expref: 8 pid: 15111 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402627.844178:0:16610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16610:1876324224445184:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402627.844423:0:16610:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e61393c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789402627.848062:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.850063:0:16610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16610:1876324224445184:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402627.850101:0:16610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 8 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.850122:0:16610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c5c25cc200, rc 0) 00000100:00100000:1.0:1789402627.850211:0:16610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+8:14489:x1876324199295872:12345-192.168.203.8@tcp:101:lhsmtool_posix.0 Request processed in 6202us (6489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402627.850252:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:0.0:1789402627.850273:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199296000 00000100:00100000:0.0:1789402627.850280:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199296000 00010000:00010000:0.0:1789402627.850311:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47611 expref: 8 pid: 15111 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402627.850389:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:0.0:1789402627.850398:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+8:2351:x1876324199296000:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789402627.850414:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789402627.850436:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47611 expref: 8 pid: 15111 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.850450:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47611 expref: 8 pid: 15111 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.850481:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f91d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47611 expref: 8 pid: 15111 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.850495:0:14412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402627.850500:0:14412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402627.850506:0:14412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 7 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.850517:0:14412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 7 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.850552:0:14412:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 7 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402627.850566:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14412:1876324224445312:192.168.203.8@tcp:105: 00000100:00100000:0.0:1789402627.850630:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c8e5b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789402627.855955:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14412:1876324224445312:192.168.203.8@tcp:105: 00010000:00010000:0.0:1789402627.855982:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789402627.856039:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+7:2351:x1876324199296000:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 5641us (7984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402627.856050:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 13 00000100:00100000:3.0:1789402627.856246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.856310:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199296128 00000100:00100000:1.0:1789402627.856317:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199296128 00000100:00100000:1.0:1789402627.856387:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:1.0:1789402627.856397:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+7:2351:x1876324199296128:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789402627.856584:0:15111:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789402627.856588:0:15111:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789402626 00002000:00010000:1.0:1789402627.856590:0:15111:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789402625 00002000:00010000:1.0:1789402627.856592:0:15111:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789402626 -> 1789402626 00002000:00010000:1.0:1789402627.856595:0:15111:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789402627.856625:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+8:2351:x1876324199296128:12345-192.168.203.8@tcp:2:lhsmtool_posix.0 Request processed in 229us (379us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789402627.856632:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:3.0:1789402627.861934:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.862045:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199296256 00000100:00100000:1.0:1789402627.862054:0:15113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199296256 00000100:00100000:1.0:1789402627.862114:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:1.0:1789402627.862124:0:15113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+8:2352:x1876324199296256:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789402627.862182:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.862211:0:15113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 8 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.862228:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789402627.862233:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789402627.862250:0:15113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.862283:0:15113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 8 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.862296:0:15113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 8 pid: 16610 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402627.862310:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb8d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15113:1876324224445440:192.168.203.8@tcp:104: 00000100:00100000:1.0:1789402627.862426:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6e61393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789402627.867152:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb8d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15113:1876324224445440:192.168.203.8@tcp:104: 00010000:00010000:1.0:1789402627.867194:0:15113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402627.868849:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402627.869088:0:16539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199296384 00000100:00100000:2.0:1789402627.869098:0:16539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199296384 00010000:00010000:2.0:1789402627.869151:0:16539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 9 pid: 16610 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402627.869202:0:16539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 14 00000100:00100000:2.0:1789402627.869220:0:16539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+9:2352:x1876324199296384:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789402627.869236:0:16539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789402627.869272:0:16539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 9 pid: 16610 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.869286:0:16539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 9 pid: 16610 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.869310:0:16539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a6e8570/0x9403f4af875f91e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47618 expref: 9 pid: 16610 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.869327:0:16539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402627.869331:0:16539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789402627.869337:0:16539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.869720:0:16539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.869751:0:16539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789402627.869852:0:16539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+8:2352:x1876324199296384:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 639us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402627.869860:0:16539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 14 00010000:00010000:3.0:1789402627.869956:0:15113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.869968:0:15113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.870009:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.870018:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.870027:0:15113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.870034:0:15113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cdc00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402627.870039:0:15113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.870048:0:15113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.870060:0:15113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.870069:0:15113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c497eb5/0x9403f4af875f91eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402627.870116:0:15113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+7:2352:x1876324199296256:12345-192.168.203.8@tcp:1:lhsmtool_posix.0 Request processed in 7993us (8191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402627.870134:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:3.0:1789402627.883288:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.883573:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199296640 00000100:00100000:0.0:1789402627.883583:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199296640 00000100:00100000:0.0:1789402627.883725:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 53 00000100:00100000:0.0:1789402627.883750:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+14:14489:x1876324199296640:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789402627.883830:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.883847:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.883863:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.884096:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.884108:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47603 expref: 15 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.884116:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.884149:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47603 expref: 15 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.884164:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47603 expref: 15 pid: 14428 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402627.884178:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c7006d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14429:1876324224445568:192.168.203.8@tcp:104: 00000100:00100000:0.0:1789402627.884270:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6c8e5b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789402627.891833:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402627.891939:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199296768 00000100:00100000:1.0:1789402627.891948:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199296768 00010000:00010000:1.0:1789402627.891987:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47603 expref: 16 pid: 14428 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402627.892026:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 15 00000100:00100000:1.0:1789402627.892035:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+16:2351:x1876324199296768:12345-192.168.203.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789402627.892049:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789402627.892056:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47603 expref: 16 pid: 14428 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.892099:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47603 expref: 16 pid: 14428 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.892121:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:1.0:1789402627.892127:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.892137:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.892145:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402627.892164:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789402627.892337:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82a00/0x9403f4af875f91c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.8@tcp remote: 0x4c28020d00b47603 expref: 16 pid: 14428 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402627.892380:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c7006d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14429:1876324224445568:192.168.203.8@tcp:104: 00010000:00010000:3.0:1789402627.892400:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.892409:0:14429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.892415:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789402627.892602:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000100:00100000:1.0:1789402627.892913:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+15:2351:x1876324199296768:12345-192.168.203.8@tcp:103:ldlm_bl.0 Request processed in 877us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402627.892922:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 15 00000001:00080000:3.0:1789402627.893285:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789402627.893334:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789402627.893454:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14429:1876324224445696:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789402627.893727:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402627.893762:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ffa0ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789402627.893797:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224445696 00000100:00100000:3.0:1789402627.893804:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224445696 00000100:00100000:3.0:1789402627.893836:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789402627.893844:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1876324224445696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789402627.893906:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1876324224445696:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402627.893913:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789402627.893958:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14429:1876324224445696:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789402627.897055:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789402627.899159:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14429:1876324224445824:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789402627.899238:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402627.899275:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ffa0a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789402627.899917:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224445824 00000100:00100000:1.0:1789402627.899927:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224445824 00000100:00100000:1.0:1789402627.899981:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789402627.899990:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1876324224445824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789402627.900196:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14429:x1876324224445824:12345-0@lo:1000:mdt00_002.0 Request processed in 207us (958us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789402627.900204:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789402627.900720:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14429:1876324224445824:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789402627.900760:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900770:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900777:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900783:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701378400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402627.900788:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900795:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900809:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:3.0:1789402627.900812:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402627.900817:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900822:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378400/0x9403f4af875f91f9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900852:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900871:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900877:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900881:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6c2a82200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1789402627.900884:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900890:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900898:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:3.0:1789402627.900900:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789402627.900906:0:14429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9158 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e7 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900917:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9158 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e7 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900925:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9158 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e7 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.900955:0:14429:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a83400/0x9403f4af875f9158 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.8@tcp remote: 0x4c28020d00b475e7 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402627.900968:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6fb46ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14429:1876324224445952:192.168.203.8@tcp:105: 00000100:00100000:3.0:1789402627.901034:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff93c6ffa0a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789402627.908321:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402627.908437:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6fb46ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14429:1876324224445952:192.168.203.8@tcp:105: 00010000:00010000:0.0:1789402627.908475:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908491:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6c2a82200/0x9403f4af875f9151 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908537:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908552:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908564:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908576:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908583:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908590:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908596:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701379000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402627.908600:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908616:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908628:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:0.0:1789402627.908630:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789402627.908641:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908646:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701379000/0x9403f4af875f9200 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908657:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908662:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908668:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908674:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701378e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1789402627.908676:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908682:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908691:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c6c30f8e00) 00010000:00010000:0.0:1789402627.908694:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789402627.908698:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402627.908704:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701378e00/0x9403f4af875f91f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402627.908944:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd0f85ca-e975-4487-8e2d-28d921391c29+18:14489:x1876324199296640:12345-192.168.203.8@tcp:57:lhsmtool_posix.0 Request processed in 25196us (25664us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789402627.908956:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 53 00000020:00080000:0.0:1789402627.908969:0:14429:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789402627.909270:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199296896 00000100:00100000:2.0:1789402627.909278:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199296896 00000100:00100000:2.0:1789402627.909327:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 10 00000100:00100000:2.0:1789402627.909336:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7004b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+18:14488:x1876324199296896:12345-192.168.203.8@tcp:49:dd.0 00000100:00100000:2.0:1789402627.909469:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7004b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+18:14488:x1876324199296896:12345-192.168.203.8@tcp:49:dd.0 Request processed in 134us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402627.909487:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 10 00000040:00080000:1.0:1789402627.911117:0:14461:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789402627.911125:0:14461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789402627.912125:0:14461:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789402627.912142:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789402627.916279:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402627.916396:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199297152 00000100:00100000:2.0:1789402627.916408:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199297152 00000100:00100000:2.0:1789402627.916457:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 11 00000100:00100000:2.0:1789402627.916467:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+18:14489:x1876324199297152:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789402627.917130:0:14430:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789402627.917259:0:14430:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789402627.917299:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.917316:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.917327:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.917335:0:14430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.917384:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.917392:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402627.917417:0:14430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789402627.917514:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+20:14489:x1876324199297152:12345-192.168.203.8@tcp:35:lhsmtool_posix.0 Request processed in 1047us (1242us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789402627.917522:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 11 00000020:00080000:2.0:1789402627.917534:0:14430:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789402627.919516:0:14415:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789402627.919529:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.919549:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3df400 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402627.919554:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.919564:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.919580:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c6cbbacb00) 00010000:00010000:3.0:1789402627.919583:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789402627.919587:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.919593:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c6ef3df400/0x9403f4af875f9207 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402627.919609:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402627.919611:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789402627.919613:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789402628.132438:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402628.152180:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402628.152325:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199297280 00000100:00100000:0.0:1789402628.152335:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199297280 00000100:00100000:0.0:1789402628.152457:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:0.0:1789402628.152472:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+7:2353:x1876324199297280:12345-192.168.203.8@tcp:4:dd.0 00002000:00010000:0.0:1789402628.152536:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa81e02, atime: 0x6aa81e01, ctime: 0x6aa81e02, blocks: 0x1 00010000:00010000:0.0:1789402628.152558:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.152799:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1789402628.152806:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402628.152814:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789402628.152824:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789402628.152831:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402628.153279:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:3.0:1789402628.153636:0:15118:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789402628.153649:0:15118:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789402628.154814:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789402628.154838:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199297408 00000100:00100000:2.0:1789402628.154847:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199297408 00000100:00100000:1.0:1789402628.154893:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402628.154923:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789402628.154934:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199297536 00000100:00100000:2.0:1789402628.154938:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199297536 00000100:00100000:2.0:1789402628.155396:0:16654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 1 00000100:00100000:2.0:1789402628.155406:0:16654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+9:2351:x1876324199297408:12345-192.168.203.8@tcp:4:dd.0 00010000:00010000:2.0:1789402628.155437:0:16654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402628.155453:0:16654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402628.155458:0:16654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789402628.155464:0:16654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402628.155478:0:16654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789402628.261334:0:15116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1789402628.261365:0:15116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789402626 -> 1789402627 00002000:00010000:3.0:1789402628.261368:0:15116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789402628.261395:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.261407:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.261416:0:15116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.261423:0:15116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701378e00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402628.261428:0:15116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.261436:0:15116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.261454:0:15116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.261473:0:15116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d37e90e/0x9403f4af875f920e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402628.262160:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+14:2353:x1876324199297280:12345-192.168.203.8@tcp:4:dd.0 Request processed in 109687us (109982us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789402628.262170:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 0 00000100:00100000:3.0:1789402628.262199:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:3.0:1789402628.262220:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+13:2353:x1876324199297536:12345-192.168.203.8@tcp:4:dd.0 00010000:00010000:3.0:1789402628.262264:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.262276:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402628.262280:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402628.262286:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.262297:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789402628.263272:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1789402628.263293:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:0.0:1789402628.300723:0:16654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789402628.300733:0:16654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1789402628.300758:0:16654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.300772:0:16654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.300780:0:16654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.300803:0:16654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6ef3dfa00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:0.0:1789402628.300807:0:16654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.300816:0:16654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.300835:0:16654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.300842:0:16654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017933839/0x9403f4af875f9215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789402628.300924:0:16654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+11:2351:x1876324199297408:12345-192.168.203.8@tcp:4:dd.0 Request processed in 145515us (147647us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789402628.300934:0:16654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 1 00000001:00080000:2.0:1789402628.301017:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1789402628.336891:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1789402628.336969:0:15116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789402628.336986:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402628.336999:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402628.337024:0:15116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402628.337032:0:15116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ca00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:2.0:1789402628.337037:0:15116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402628.337048:0:15116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402628.337067:0:15116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789402628.337076:0:15116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f921c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789402628.337420:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2353:x1876324199297536:12345-192.168.203.8@tcp:4:dd.0 Request processed in 75208us (182530us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789402628.337430:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 2 00000100:00100000:2.0:1789402628.347576:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402628.347679:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199297664 00000100:00100000:0.0:1789402628.347689:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199297664 00000100:00100000:0.0:1789402628.347782:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:0.0:1789402628.347793:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2352:x1876324199297664:12345-192.168.203.8@tcp:4:dd.0 00002000:00010000:0.0:1789402628.347838:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa81e03, atime: 0x6aa81e01, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1789402628.347847:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.347879:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1789402628.347883:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402628.347889:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.347902:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402628.361787:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402628.362064:0:16654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199297792 00000100:00100000:0.0:1789402628.362074:0:16654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199297792 00000100:00100000:0.0:1789402628.362138:0:16654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 4 00000100:00100000:0.0:1789402628.362149:0:16654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+7:2351:x1876324199297792:12345-192.168.203.8@tcp:4:dd.0 00010000:00010000:0.0:1789402628.362181:0:16654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.362197:0:16654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402628.362201:0:16654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789402628.362207:0:16654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789402628.362230:0:16654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789402628.368734:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402628.370289:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402628.370313:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402628.374277:0:15116:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789402628.374295:0:15116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1789402628.381481:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199298048 00000100:00100000:1.0:1789402628.381499:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199298048 00000100:00100000:1.0:1789402628.381636:0:15116:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789402628.381648:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199297920 00000100:00100000:1.0:1789402628.381652:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199297920 00000100:00100000:1.0:1789402628.381672:0:15116:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789402628.381677:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199298176 00000100:00100000:1.0:1789402628.381680:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199298176 00000100:00100000:1.0:1789402628.382414:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:1.0:1789402628.382428:0:16656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f85ca-e975-4487-8e2d-28d921391c29+11:2351:x1876324199298048:12345-192.168.203.8@tcp:4:dd.0 00010000:00010000:1.0:1789402628.382463:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402628.382480:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402628.382484:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789402628.382491:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789402628.382505:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789402628.447438:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1789402628.447668:0:15117:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:3.0:1789402628.447676:0:15117:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789402627 00002000:00010000:3.0:1789402628.447678:0:15117:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1789402628.447694:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.447711:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.447724:0:15117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.447732:0:15117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701379a00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402628.447736:0:15117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.447765:0:15117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.447789:0:15117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.447798:0:15117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002831f965/0x9403f4af875f9223 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402628.447892:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+15:2352:x1876324199297664:12345-192.168.203.8@tcp:4:dd.0 Request processed in 100096us (100320us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789402628.447902:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 3 00000100:00100000:3.0:1789402628.447934:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 6 00000100:00100000:3.0:1789402628.447945:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+14:2352:x1876324199297920:12345-192.168.203.8@tcp:4:dd.0 00010000:00010000:3.0:1789402628.447974:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.447987:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402628.447992:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402628.449005:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.449024:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789402628.496618:0:16656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1789402628.496637:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.496655:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.496665:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.496673:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c5c25cc600 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402628.496678:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.496686:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789402628.496693:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:3.0:1789402628.496707:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789402628.496710:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00010000:00010000:3.0:1789402628.496719:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023852e41/0x9403f4af875f9231 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402628.496937:0:16656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f85ca-e975-4487-8e2d-28d921391c29+12:2351:x1876324199298048:12345-192.168.203.8@tcp:4:dd.0 Request processed in 114508us (128207us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789402628.496964:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 5 00000100:00100000:3.0:1789402628.496997:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 7 00000100:00100000:3.0:1789402628.497008:0:16656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f85ca-e975-4487-8e2d-28d921391c29+11:2352:x1876324199298176:12345-192.168.203.8@tcp:4:dd.0 00010000:00010000:3.0:1789402628.497041:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.497053:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402628.497057:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789402628.497063:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.497075:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.499114:0:16654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.499131:0:16654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.499247:0:16654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.499255:0:16654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701378a00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402628.499259:0:16654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.499476:0:16654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.499513:0:16654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.499521:0:16654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a0713fd/0x9403f4af875f922a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402628.500004:0:16654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fd0f85ca-e975-4487-8e2d-28d921391c29+11:2351:x1876324199297792:12345-192.168.203.8@tcp:4:dd.0 Request processed in 137590us (137956us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789402628.500016:0:16654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 4 00000001:00080000:0.0:1789402628.552187:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1789402628.552552:0:15117:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1789402628.552558:0:15117:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1789402628.552576:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.552589:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.552599:0:15117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.552607:0:15117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90ca00 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402628.552616:0:15117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.552641:0:15117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.552662:0:15117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.552671:0:15117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb328e5d/0x9403f4af875f9238 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402628.552805:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7006d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+9:2352:x1876324199297920:12345-192.168.203.8@tcp:4:dd.0 Request processed in 104858us (182517us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789402628.552817:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 6 00002000:00010000:3.0:1789402628.603661:0:16656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789402628.603681:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.603694:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.603703:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.603710:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c6fb90c000 already unused, calling callback (ffffffffc172d8b0) 00010000:00010000:3.0:1789402628.603715:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.603750:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.603771:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789402628.603779:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000578c024c/0x9403f4af875f923f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789402628.603889:0:16656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6da8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f85ca-e975-4487-8e2d-28d921391c29+7:2352:x1876324199298176:12345-192.168.203.8@tcp:4:dd.0 Request processed in 106879us (233570us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789402628.603899:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 7 00000001:00080000:0.0:1789402628.604012:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1789402629.154667:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789402629.347133:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224446336:0@lo:400:kworker.0 00000100:00100000:2.0:1789402629.347217:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402629.347287:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e31f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224446848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789402629.347327:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402629.347378:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789402629.347384:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224446464:0@lo:400:kworker.0 00000100:00100000:2.0:1789402629.347408:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402629.347441:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224446848 00000100:00100000:2.0:1789402629.347448:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224446848 00000100:00100000:2.0:1789402629.347493:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789402629.347501:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224446848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789402629.347634:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224446336 00000100:00100000:0.0:1789402629.347639:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224446336 00000100:00100000:0.0:1789402629.347671:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789402629.347677:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876324224446336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402629.347723:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876324224446336:12345-0@lo:400:kworker.0 Request processed in 46us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402629.347730:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789402629.347772:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224446336:0@lo:400:kworker.0 00000100:00100000:0.0:1789402629.347820:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224446464 00000100:00100000:0.0:1789402629.347824:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224446464 00000100:00100000:0.0:1789402629.347850:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789402629.347856:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e31f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224446464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789402629.347892:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876324224446464:12345-0@lo:400:kworker.0 Request processed in 35us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789402629.347898:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789402629.347923:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876324224446464:0@lo:400:kworker.0 00002000:00000024:2.0:1789402629.348122:0:15115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789402629.348173:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e31f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224446848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 672us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402629.348180:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789402629.348655:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e31f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224446848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789402629.348746:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3315:1876324224446080:0@lo:400:kworker.0 00000100:00100000:3.0:1789402629.348790:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402629.348833:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224446592:0@lo:400:kworker.0 00000100:00100000:3.0:1789402629.348859:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402629.348888:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789402629.348895:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224446208:0@lo:400:kworker.0 00000100:00100000:3.0:1789402629.348919:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789402629.348940:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224446720:0@lo:400:kworker.0 00000100:00100000:3.0:1789402629.348963:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789402629.348995:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402629.349012:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224446208 00000100:00100000:3.0:1789402629.349027:0:16610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224446208 00000100:00100000:3.0:1789402629.349068:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789402629.349075:0:16610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224446208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402629.349117:0:16610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876324224446208:12345-0@lo:400:kworker.0 Request processed in 42us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402629.349124:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789402629.349146:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789402629.349154:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224446592 00000100:00100000:3.0:1789402629.349157:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224446592 00000100:00100000:3.0:1789402629.349181:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224446720 00000100:00100000:3.0:1789402629.349184:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224446720 00000100:00100000:3.0:1789402629.349198:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789402629.349216:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224446592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402629.349247:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876324224446592:12345-0@lo:400:kworker.0 Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402629.349265:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789402629.349276:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789402629.349282:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6c998ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224446720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789402629.349311:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6c998ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876324224446720:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402629.349316:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789402629.349332:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789402629.349371:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789402629.349376:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6da91ea00, transno 8589934595 00000004:00080000:3.0:1789402629.349388:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789402629.349409:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876324224446208:0@lo:400:kworker.0 00000100:00100000:3.0:1789402629.349419:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876324224446720:0@lo:400:kworker.0 00000100:00100000:3.0:1789402629.349438:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876324224446592:0@lo:400:kworker.0 00000100:00100000:2.0:1789402629.350652:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224446080 00000100:00100000:2.0:1789402629.350663:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224446080 00000100:00100000:2.0:1789402629.350715:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789402629.350725:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3315:x1876324224446080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789402629.350803:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02178a1e-a899-49a2-9d98-ac5bd5af3b2b+19:3315:x1876324224446080:12345-0@lo:400:kworker.0 Request processed in 80us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402629.350811:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789402629.350858:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6da8d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02178a1e-a899-49a2-9d98-ac5bd5af3b2b:3315:1876324224446080:0@lo:400:kworker.0 00010000:00010000:0.0:1789402630.179155:0:14416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789402630.328159:0:16694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1789402630.882645:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789402630.882668:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93c6e622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224446976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789402630.882745:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789402630.883327:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324224446976 00000100:00100000:2.0:1789402630.883337:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324224446976 00000100:00100000:2.0:1789402630.883406:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789402630.883416:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6fb8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224446976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789402630.884300:0:15115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789402630.884417:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6fb8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876324224446976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1001us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402630.884440:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789402630.884573:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93c6e622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876324224446976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789402631.203637:0:14415:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789402631.206732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402631.207404:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402631.207446:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402631.207545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402631.207580:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:2.0:1789402631.207630:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199298560 00000100:00100000:2.0:1789402631.207639:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199298560 00000100:00100000:2.0:1789402631.207695:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199299072 00000100:00100000:2.0:1789402631.207699:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199299072 00000100:00100000:2.0:1789402631.207723:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:2.0:1789402631.207733:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2353:x1876324199298560:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402631.207801:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2353:x1876324199298560:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 70us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402631.207809:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 16 00000100:00100000:2.0:1789402631.207838:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00100000:2.0:1789402631.207845:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2353:x1876324199299072:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402631.207870:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2353:x1876324199299072:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402631.207876:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 17 00000100:00080000:2.0:1789402631.207913:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789402631.207917:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789402631.208500:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199298304 00000100:00100000:1.0:1789402631.208507:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199298304 00000100:00100000:2.0:1789402631.208919:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 121 00000100:00100000:2.0:1789402631.208930:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6ddef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:2353:x1876324199298304:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402631.208976:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6ddef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e458e935-6ed5-4b3c-9a8d-9ee3137a1a21+13:2353:x1876324199298304:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 48us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402631.208984:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 121 00000100:00100000:0.0:1789402631.212442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:0.0:1789402631.212475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.8@tcp (source: 12345-192.168.203.8@tcp) 00000100:00100000:1.0:1789402631.214800:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199298688 00000100:00100000:1.0:1789402631.214814:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199298688 00000100:00100000:1.0:1789402631.214894:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199298944 00000100:00100000:1.0:1789402631.214898:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199298944 00000100:00100000:1.0:1789402631.214927:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:1.0:1789402631.214937:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2353:x1876324199298688:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402631.215013:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+5:2353:x1876324199298688:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 78us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402631.215022:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 18 00000100:00100000:1.0:1789402631.215040:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00100000:1.0:1789402631.215047:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2353:x1876324199298944:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:1.0:1789402631.215073:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+5:2353:x1876324199298944:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 26us (2597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789402631.215080:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 19 00000100:00080000:0.0:1789402631.216113:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789402631.216119:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789402631.216907:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199298816 00000100:00100000:3.0:1789402631.216917:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199298816 00000100:00100000:2.0:1789402631.217016:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876324199298432 00000100:00100000:2.0:1789402631.217022:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876324199298432 00000100:00100000:3.0:1789402631.217088:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00100000:3.0:1789402631.217097:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:2353:x1876324199298816:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:3.0:1789402631.217181:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08a34b02-10c3-4e61-b7aa-639ea7f7cde7+6:2353:x1876324199298816:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 84us (9734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789402631.217198:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 27 00000100:00080000:0.0:1789402631.221693:0:14423:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789402631.222181:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.8@tcp, seq: 28 00000100:00100000:2.0:1789402631.222217:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+20:2353:x1876324199298432:12345-192.168.203.8@tcp:400:kworker.0 00000100:00100000:2.0:1789402631.222305:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6e622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd0f85ca-e975-4487-8e2d-28d921391c29+20:2353:x1876324199298432:12345-192.168.203.8@tcp:400:kworker.0 Request processed in 93us (14723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789402631.222314:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.8@tcp, seq: 28 Debug log: 29692 lines, 29692 kept, 0 dropped, 0 bad.