00000100:00100000:0.0F:1762167019.620820:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0F:1762167019.620933:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452056832 00000100:00100000:1.0:1762167019.620964:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452056832 00002000:00100000:1.0:1762167019.621049:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x803:0x0] (0->42816) req@ffff9ee37f797480 x1847765452056832/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:50/0 lens 488/0 e 0 to 0 dl 1762167030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167019.621061:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f797480 with x1847765452056832 ext(0->42816) 00002000:00010000:1.0:1762167019.621069:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f797480 00000100:00100000:1.0:1762167019.621105:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3273 00000100:00100000:1.0:1762167019.621119:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452056832:12345-192.168.203.35@tcp:4:fsx.0 00000100:00080000:0.0:1762167019.621365:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762167019.624321:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765452056832:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 3197us (3505us total) trans 17179876155 rc 0/0 00000100:00100000:1.0:1762167019.624336:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3273 00002000:00100000:1.0:1762167019.624351:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x803:0x0] (0->42816) req@ffff9ee37f797480 x1847765452056832/t17179876155(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:50/0 lens 488/448 e 0 to 0 dl 1762167030 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167019.624362:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f797480 with x1847765452056832 ext(0->42816) 00002000:00010000:1.0:1762167019.624368:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f797480 00010000:00010000:0.0:1762167019.943972:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167020.968603:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1762167021.318879:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.318949:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.318989:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.319123:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452057216 00000100:00100000:1.0:1762167021.319135:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452057216 00000100:00100000:0.0:1762167021.319138:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452056960 00000100:00100000:0.0:1762167021.319146:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452056960 00000100:00100000:0.0:1762167021.319203:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452057088 00000100:00100000:0.0:1762167021.319208:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452057088 00000100:00100000:1.0:1762167021.319218:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 667 00000100:00100000:1.0:1762167021.319231:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d2907fd-ec36-418b-9892-2b7af8c34cb2+17:2358:x1847765452056960:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167021.319248:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 668 00000100:00100000:0.0:1762167021.319260:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1d2907fd-ec36-418b-9892-2b7af8c34cb2+17:2361:x1847765452057216:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167021.319266:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167021.319271:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0F:1762167021.319277:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 669 00010000:00010000:1.0:1762167021.319298:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee381f1d200/0xf915a5bdf3d0c5a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4347 expref: 17 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.319300:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee381f1d800/0xf915a5bdf3d0c59a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb431d expref: 17 pid: 30815 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167021.319316:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+17:2358:x1847765452057088:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167021.319324:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167021.319327:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167021.319328:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167021.319335:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee381f1c600/0xf915a5bdf3d0c5a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb434e expref: 15 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.319344:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167021.319381:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:2361:x1847765452057216:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 122us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.319390:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 668 00000100:00100000:1.0:1762167021.319696:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:2358:x1847765452056960:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 467us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.319714:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:2358:x1847765452057088:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 392us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.319715:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 667 00000100:00100000:2.0:1762167021.319727:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 669 00000100:00100000:0.0:1762167021.330711:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.330843:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452057600 00000100:00100000:1.0:1762167021.330854:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452057600 00000100:00100000:1.0:1762167021.330929:0:34500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17594 00000100:00100000:1.0:1762167021.330941:0:34500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:12bd460f-a83f-41fe-92df-dfba4795e03a+7:2357:x1847765452057600:12345-192.168.203.35@tcp:9:umount.0 00000020:00000080:1.0:1762167021.330976:0:34500:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3d0c5bd 00000020:00010000:1.0:1762167021.330986:0:34500:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee37f2a6800: total 0 00000100:00080000:1.0:1762167021.330989:0:34500:0:(import.c:65:import_set_state_nolock()) ffff9ee24530a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1762167021.331044:0:34500:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179876155 00000100:00100000:1.0:1762167021.331313:0:34500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:12bd460f-a83f-41fe-92df-dfba4795e03a+5:2357:x1847765452057600:12345-192.168.203.35@tcp:9:umount.0 Request processed in 375us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.331322:0:34500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17594 00000100:00080000:0.0:1762167021.331385:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:2.0:1762167021.331650:0:5744:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee37f2a6800: total 0 00010000:00010000:2.0:1762167021.331686:0:5744:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee37f2a6800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1762167021.331745:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0c7f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4458 expref: 4 pid: 34499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167021.331811:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c802 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4466 expref: 3 pid: 34500 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167021.331824:0:5744:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee37f2a6800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1762167021.331842:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167021.331844:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167021.331846:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167021.341349:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.341422:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452057984 00000100:00100000:1.0:1762167021.341434:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452057984 00000100:00100000:1.0:1762167021.341503:0:34500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17595 00000100:00100000:1.0:1762167021.341514:0:34500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:12bd460f-a83f-41fe-92df-dfba4795e03a+7:2357:x1847765452057984:12345-192.168.203.35@tcp:9:umount.0 00000020:00000080:1.0:1762167021.341545:0:34500:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3d0c5b6 00000020:00010000:1.0:1762167021.341553:0:34500:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee2448da000: total 0 00000100:00080000:1.0:1762167021.341557:0:34500:0:(import.c:65:import_set_state_nolock()) ffff9ee2448df000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1762167021.341599:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1762167021.341605:0:34500:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474843736 00000020:00010000:2.0:1762167021.341657:0:5743:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee2448da000: total 0 00010000:00010000:2.0:1762167021.341661:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167021.341696:0:5743:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee2448da000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1762167021.341793:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c809 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb446d expref: 6 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167021.341820:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c7df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4443 expref: 6 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.341844:0:5743:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee2448da000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1762167021.341855:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167021.341856:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167021.341858:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167021.341874:0:34500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:12bd460f-a83f-41fe-92df-dfba4795e03a+2:2357:x1847765452057984:12345-192.168.203.35@tcp:9:umount.0 Request processed in 362us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.341881:0:34500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17595 00000100:00100000:2.0:1762167021.347163:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.347336:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452058368 00000100:00100000:3.0:1762167021.347347:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452058368 00000100:00100000:3.0:1762167021.347429:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20156 00000100:00100000:3.0:1762167021.347442:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12bd460f-a83f-41fe-92df-dfba4795e03a+9:2357:x1847765452058368:12345-192.168.203.35@tcp:39:umount.0 00000020:00000080:3.0:1762167021.347475:0:30819:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3d0c5af 00000020:00010000:3.0:1762167021.347492:0:30819:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee2448df800: total 0 00000100:00080000:3.0:1762167021.347497:0:30819:0:(import.c:65:import_set_state_nolock()) ffff9ee2448d9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1762167021.347530:0:30819:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589953238 00000100:00080000:0.0:1762167021.347577:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762167021.347923:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12bd460f-a83f-41fe-92df-dfba4795e03a+8:2357:x1847765452058368:12345-192.168.203.35@tcp:39:umount.0 Request processed in 483us (768us total) trans 8589953239 rc 0/0 00000100:00100000:3.0:1762167021.347931:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20156 00000020:00010000:1.0:1762167021.348036:0:6548:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee2448df800: total 0 00010000:00010000:1.0:1762167021.348084:0:6548:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee2448df800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1762167021.348121:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:1.0:1762167021.348131:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762167021.348140:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c6ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43f6 expref: 7 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.348164:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167021.348168:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167021.348172:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c7ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4451 expref: 6 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.348187:0:6548:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee2448df800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1762167021.348201:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167021.348204:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167021.348206:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167021.777237:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.777294:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.777327:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.777372:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.777385:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452058624 00000100:00100000:1.0:1762167021.777398:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452058624 00000100:00100000:2.0:1762167021.777404:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452058496 00000100:00100000:2.0:1762167021.777412:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452058496 00000100:00100000:0.0:1762167021.777413:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452058880 00000100:00100000:0.0:1762167021.777419:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452058880 00000100:00100000:1.0:1762167021.777460:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452058752 00000100:00100000:1.0:1762167021.777465:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452058752 00000100:00100000:0.0:1762167021.777472:0:34500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17596 00000100:00100000:0.0:1762167021.777484:0:34500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+5:2357:x1847765452058880:12345-192.168.203.35@tcp:9:umount.0 00000020:00000080:0.0:1762167021.777519:0:34500:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3d0c5e7 00000100:00100000:2.0:1762167021.777539:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 670 00000100:00080000:0.0:1762167021.777545:0:34500:0:(import.c:65:import_set_state_nolock()) ffff9ee245308000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1762167021.777554:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 671 00000100:00100000:2.0:1762167021.777554:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:2358:x1847765452058624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762167021.777569:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 672 00000100:00100000:3.0:1762167021.777573:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:2361:x1847765452058496:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167021.777575:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762167021.777584:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:2361:x1847765452058752:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167021.777587:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00000004:0.0:1762167021.777593:0:34500:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179876155 00010000:00010000:1.0:1762167021.777597:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167021.777599:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee381f1dc00/0xf915a5bdf3d0c5c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4378 expref: 14 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.777603:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee347922600/0xf915a5bdf3d0c5cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43a2 expref: 14 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.777612:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ee347922e00/0xf915a5bdf3d0c5d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43a9 expref: 14 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.777622:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167021.777627:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167021.777635:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167021.777678:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:2358:x1847765452058624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 130us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167021.777683:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:2361:x1847765452058496:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 112us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.777683:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:2361:x1847765452058752:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 99us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.777695:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 670 00000100:00100000:1.0:1762167021.777703:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 672 00000100:00100000:3.0:1762167021.777715:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 671 00000100:00100000:0.0:1762167021.777804:0:34500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+2:2357:x1847765452058880:12345-192.168.203.35@tcp:9:umount.0 Request processed in 321us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.777812:0:34500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17596 00000100:00080000:1.0:1762167021.777814:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1762167021.777843:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167021.780591:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.780650:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452059008 00000100:00100000:1.0:1762167021.780660:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452059008 00000100:00080000:0.0:1762167021.780713:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762167021.780728:0:34500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17597 00000100:00100000:1.0:1762167021.780738:0:34500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+5:2357:x1847765452059008:12345-192.168.203.35@tcp:9:umount.0 00000020:00000080:1.0:1762167021.780796:0:34500:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3d0c5e0 00000100:00080000:1.0:1762167021.780805:0:34500:0:(import.c:65:import_set_state_nolock()) ffff9ee34a53c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1762167021.780842:0:34500:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474843736 00010000:00010000:2.0:1762167021.780953:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167021.781047:0:34500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+2:2357:x1847765452059008:12345-192.168.203.35@tcp:9:umount.0 Request processed in 310us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.781055:0:34500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17597 00000100:00100000:2.0:1762167021.785129:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.785197:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452059264 00000100:00100000:3.0:1762167021.785207:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452059264 00000100:00100000:3.0:1762167021.785303:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20157 00000100:00100000:3.0:1762167021.785315:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:2357:x1847765452059264:12345-192.168.203.35@tcp:39:umount.0 00000100:00080000:0.0:1762167021.785349:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1762167021.785365:0:30819:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf915a5bdf3d0c5d9 00000020:00010000:3.0:1762167021.785373:0:30819:0:(genops.c:1938:obd_stale_export_put()) Put export ffff9ee24530f000: total 0 00000100:00080000:3.0:1762167021.785379:0:30819:0:(import.c:65:import_set_state_nolock()) ffff9ee24530e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1762167021.785408:0:30819:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589953239 00000020:00010000:0.0:1762167021.785460:0:5743:0:(genops.c:1924:obd_stale_export_get()) Get export ffff9ee24530f000: total 0 00010000:00010000:0.0:1762167021.785517:0:5743:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff9ee24530f000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1762167021.785551:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:0.0:1762167021.785555:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762167021.785563:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c5f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43d3 expref: 5 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.785580:0:5743:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff9ee24530f000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1762167021.785590:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167021.785592:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167021.785594:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167021.785622:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+3:2357:x1847765452059264:12345-192.168.203.35@tcp:39:umount.0 Request processed in 310us (506us total) trans 8589953240 rc 0/0 00000100:00100000:3.0:1762167021.785630:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20157 00000100:00100000:0.0:1762167021.806878:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.806965:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452059392 00000100:00100000:1.0:1762167021.806976:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452059392 00000100:00080000:0.0:1762167021.807061:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762167021.807073:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20158 00000100:00100000:1.0:1762167021.807086:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58121:x1847765452059392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167021.807113:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167021.807133:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c825 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4489 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.807200:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807213:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807224:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807238:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807265:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807273:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807422:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807431:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807437:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167021.807474:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 2133921 00000004:00200000:1.0:1762167021.807479:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167021.807498:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807510:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807518:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807525:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807531:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807536:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167021.807541:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807555:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807568:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:1.0:1762167021.807571:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167021.807576:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807583:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c82c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807597:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807603:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807607:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807611:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167021.807613:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807618:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807624:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee2429d0c00) 00010000:00010000:1.0:1762167021.807627:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167021.807629:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807634:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c833 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.807672:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4489 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.807685:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4489 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.807692:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167021.807695:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167021.807698:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:1.0:1762167021.807812:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58121:x1847765452059392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 679us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.807821:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20158 00000100:00100000:1.0:1762167021.810926:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.810986:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452059648 00000100:00100000:3.0:1762167021.810997:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452059648 00000100:00100000:3.0:1762167021.811046:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20159 00000100:00100000:3.0:1762167021.811054:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58121:x1847765452059648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167021.811070:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167021.811086:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4490 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.811181:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167021.811197:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4489 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.811205:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167021.811238:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4489 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.811257:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4489 expref: 895 pid: 30819 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1762167021.811305:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454561920:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167021.811395:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167021.812465:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454561920:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167021.812488:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167021.812688:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.812750:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452059776 00000100:00100000:0.0:1762167021.812756:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452059776 00010000:00010000:0.0:1762167021.812816:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4489 expref: 896 pid: 30819 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1762167021.812838:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7707 00000100:00100000:0.0:1762167021.812846:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765452059776:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167021.812857:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167021.812874:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4489 expref: 896 pid: 30819 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.812885:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4489 expref: 896 pid: 30819 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.812905:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c83a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4489 expref: 896 pid: 30819 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.812922:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167021.812927:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167021.812933:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167021.812938:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167021.812959:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167021.812988:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167021.812998:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167021.813008:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765452059776:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 162us (321us total) trans 0 rc 0/0 00000004:00200000:3.0:1762167021.813015:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 2133921 00000100:00100000:0.0:1762167021.813018:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7707 00010000:00010000:3.0:1762167021.813154:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4490 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.813166:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4490 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.813171:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:3.0:1762167021.813173:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167021.813174:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167021.813258:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58121:x1847765452059648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2156us (2295us total) trans 8589953241 rc 0/0 00000100:00100000:3.0:1762167021.813266:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20159 00000100:00100000:1.0:1762167021.815017:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.815061:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452059904 00000100:00100000:3.0:1762167021.815068:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452059904 00000100:00100000:3.0:1762167021.815125:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20160 00000100:00100000:3.0:1762167021.815134:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58121:x1847765452059904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167021.815158:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167021.815179:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c856 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4497 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.815251:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167021.815265:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4490 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.815274:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167021.815317:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4490 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.815330:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4490 expref: 896 pid: 30819 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1762167021.815344:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454562048:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167021.815426:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167021.817115:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454562048:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167021.817145:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167021.817168:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.817212:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452060032 00000100:00100000:0.0:1762167021.817220:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452060032 00010000:00010000:0.0:1762167021.817251:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4490 expref: 897 pid: 30819 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1762167021.817296:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7708 00000100:00100000:0.0:1762167021.817306:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765452060032:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167021.817338:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167021.817345:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4490 expref: 897 pid: 30819 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.817357:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4490 expref: 897 pid: 30819 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.817379:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c848 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4490 expref: 897 pid: 30819 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.817400:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167021.817404:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167021.817414:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167021.817423:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167021.817450:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167021.817468:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167021.817486:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167021.817502:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765452060032:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 197us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.817510:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7708 00000004:00200000:3.0:1762167021.817537:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 2133921 00000004:00200000:3.0:1762167021.817543:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167021.817562:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167021.817594:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c856 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4497 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.817611:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4497 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.817619:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:3.0:1762167021.817622:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167021.817625:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167021.817715:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58121:x1847765452059904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2582us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167021.817723:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20160 00000100:00100000:1.0:1762167021.821059:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.821166:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452060288 00000100:00100000:3.0:1762167021.821177:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452060288 00000100:00100000:3.0:1762167021.821237:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20161 00000100:00100000:3.0:1762167021.821247:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58121:x1847765452060288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167021.821268:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167021.821301:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c864 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb449e expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.821414:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0c86b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167021.821429:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0c86b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167021.821439:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0c86b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167021.821450:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 2133921 00010000:00010000:3.0:1762167021.821582:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c864 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb449e expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.821604:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0c86b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb449e expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.821612:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:3.0:1762167021.821615:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167021.821619:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167021.821685:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:58121:x1847765452060288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 439us (635us total) trans 8589953242 rc 0/0 00000100:00100000:3.0:1762167021.821692:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20161 00000100:00100000:2.0:1762167021.823559:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.823595:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.823619:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.823649:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.823730:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452060416 00000100:00100000:1.0:1762167021.823738:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452060416 00000100:00100000:1.0:1762167021.823815:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452060544 00000100:00100000:1.0:1762167021.823819:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452060544 00000100:00100000:1.0:1762167021.823835:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452060672 00000100:00100000:1.0:1762167021.823837:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452060672 00000100:00100000:1.0:1762167021.823848:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452060800 00000100:00100000:1.0:1762167021.823851:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452060800 00000100:00100000:1.0:1762167021.823866:0:34500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17598 00000100:00100000:1.0:1762167021.823875:0:34500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765452060416:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167021.823911:0:34500:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.823938:0:34500:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb445f expref: 13 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.823946:0:34500:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.823947:0:34500:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.823951:0:34500:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.823980:0:34500:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb445f expref: 13 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.823993:0:34500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb445f expref: 13 pid: 34501 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1762167021.824007:0:34500:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:34500:1847765454562176:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167021.824060:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17599 00000100:00100000:3.0:1762167021.824073:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765452060544:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167021.824081:0:34500:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1762167021.824097:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.824111:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4474 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167021.824126:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167021.824128:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167021.824131:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.824153:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4474 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167021.824163:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4474 expref: 21 pid: 26444 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1762167021.824174:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454562304:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167021.824206:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17600 00000100:00100000:3.0:1762167021.824215:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427379c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167021.824216:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765452060672:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167021.824237:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.824247:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb447b expref: 21 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167021.824255:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.824257:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.824266:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.824303:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb447b expref: 21 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167021.824311:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb447b expref: 21 pid: 6535 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1762167021.824321:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454562432:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167021.824356:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17601 00000100:00100000:0.0:1762167021.824369:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765452060800:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167021.824372:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c540 going to sleep for 11 seconds 00010000:00010000:0.0:1762167021.824392:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.824415:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4482 expref: 13 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.824422:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.824423:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.824425:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.824445:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4482 expref: 13 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.824454:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4482 expref: 13 pid: 6535 timeout: 742 lvb_type: 1 00000100:00080000:2.0:1762167021.824460:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762167021.824466:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454562560:192.168.203.35@tcp:104: 00000100:00080000:2.0:1762167021.824467:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762167021.824496:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345adf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167021.826500:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454562304:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167021.826501:0:34500:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:34500:1847765454562176:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167021.826533:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454562560:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167021.826540:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.826540:0:34500:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167021.826541:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167021.826575:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167021.826578:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.826598:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452060928 00000100:00100000:0.0:1762167021.826605:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452060928 00000100:00100000:3.0:1762167021.826614:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454562432:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167021.826617:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.826620:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452061184 00000100:00100000:2.0:1762167021.826627:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452061184 00010000:00010000:3.0:1762167021.826635:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.826639:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4482 expref: 15 pid: 6535 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1762167021.826649:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb445f expref: 15 pid: 34501 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1762167021.826659:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.826682:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452061056 00000100:00100000:0.0:1762167021.826694:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452061056 00000100:00100000:2.0:1762167021.826695:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7709 00000100:00100000:3.0:1762167021.826696:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452061312 00000100:00100000:3.0:1762167021.826703:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452061312 00000100:00100000:1.0:1762167021.826708:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7710 00000100:00100000:2.0:1762167021.826710:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2359:x1847765452060928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167021.826722:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4474 expref: 23 pid: 26444 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1762167021.826723:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765452061184:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167021.826726:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167021.826731:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb447b expref: 23 pid: 6535 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1762167021.826740:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167021.826797:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4482 expref: 15 pid: 6535 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1762167021.826797:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb445f expref: 15 pid: 34501 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1762167021.826797:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7711 00000100:00100000:0.0:1762167021.826815:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765452061056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762167021.826822:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7712 00010000:00010000:2.0:1762167021.826825:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4482 expref: 15 pid: 6535 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1762167021.826829:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167021.826830:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb445f expref: 15 pid: 34501 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1762167021.826837:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765452061312:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167021.826848:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4474 expref: 23 pid: 26444 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1762167021.826854:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167021.826858:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4482 expref: 15 pid: 6535 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1762167021.826864:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb445f expref: 15 pid: 34501 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.826866:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4474 expref: 23 pid: 26444 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1762167021.826872:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb447b expref: 23 pid: 6535 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1762167021.826884:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167021.826888:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167021.826894:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.826900:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb447b expref: 23 pid: 6535 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1762167021.826903:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4474 expref: 23 pid: 26444 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1762167021.826920:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.826923:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.826928:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.826933:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.826935:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.826937:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167021.826939:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb447b expref: 22 pid: 6535 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1762167021.826943:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.826964:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.826967:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.826968:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167021.826973:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167021.826978:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167021.826979:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.826993:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.826999:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167021.827005:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167021.827016:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167021.827027:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2359:x1847765452060928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 320us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.827033:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765452061184:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 312us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.827040:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765452061056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 228us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.827041:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7709 00000100:00100000:3.0:1762167021.827049:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765452061312:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 213us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.827054:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7710 00000100:00100000:0.0:1762167021.827065:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7711 00010000:00010000:2.0:1762167021.827070:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.827080:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167021.827083:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7712 00010000:00010000:0.0:1762167021.827102:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.827107:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827109:0:34500:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.827114:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.827117:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.827133:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827135:0:34500:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.827146:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.827153:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.827158:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827172:0:34500:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.827174:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.827181:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167021.827183:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.827189:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.827196:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827199:0:34500:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.827211:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.827217:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.827218:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167021.827224:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827229:0:34500:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.827237:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.827241:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167021.827246:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.827260:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.827269:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.827274:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.827292:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.827298:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.827312:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c88e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827316:0:34500:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167021.827319:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c880 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.827321:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c887 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827324:0:34500:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827348:0:34500:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827365:0:34500:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.827374:0:34500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c879 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167021.827383:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452060672:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3167us (3761us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.827396:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765452060800:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3027us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.827397:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452060544:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3327us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167021.827408:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17600 00000100:00100000:0.0:1762167021.827416:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17599 00000100:00100000:2.0:1762167021.827427:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17601 00000100:00100000:1.0:1762167021.827427:0:34500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2360:x1847765452060416:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3549us (3882us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.827440:0:34500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17598 00000100:00100000:3.0:1762167021.828922:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.828971:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452061568 00000100:00100000:1.0:1762167021.828978:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452061568 00000100:00100000:1.0:1762167021.829027:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20162 00000100:00100000:1.0:1762167021.829036:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:58121:x1847765452061568:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167021.829088:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1762167021.829110:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c85d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4497 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.829138:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4435 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.829165:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb444a expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.829178:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167021.829183:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167021.829211:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.829222:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.829231:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00080000:1.0:1762167021.829872:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x822:0x0], index 0: 0 00000004:00080000:1.0:1762167021.829886:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x825:0x0], index 1: 0 00000040:00080000:1.0:1762167021.830048:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5690, 88 off460712 00000004:00080000:1.0:1762167021.830059:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642622295379ns, next at 639432226677ns, rc = 0 00000040:00080000:1.0:1762167021.830166:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5698, 88 off461768 00000004:00080000:1.0:1762167021.830173:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642622410323ns, next at 639432380558ns, rc = 0 00000040:00080000:1.0:1762167021.830206:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5699, 88 off461856 00000004:00080000:1.0:1762167021.830210:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642622447686ns, next at 639432380558ns, rc = 0 00000040:00080000:1.0:1762167021.830228:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5691, 88 off460800 00000004:00080000:1.0:1762167021.830232:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642622469431ns, next at 639432226677ns, rc = 0 00000040:00080000:1.0:1762167021.830271:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5700, 88 off461944 00000004:00080000:1.0:1762167021.830276:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642622513126ns, next at 639432380558ns, rc = 0 00000040:00080000:1.0:1762167021.830310:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5692, 88 off460888 00000004:00080000:1.0:1762167021.830314:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642622551448ns, next at 639432226677ns, rc = 0 00000040:00080000:1.0:1762167021.830379:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5701, 88 off462032 00000004:00080000:1.0:1762167021.830384:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642622621449ns, next at 639432380558ns, rc = 0 00000040:00080000:1.0:1762167021.830419:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5693, 88 off460976 00000004:00080000:1.0:1762167021.830424:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642622660933ns, next at 639432226677ns, rc = 0 00000004:00010000:2.0:1762167021.849248:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c074bee0 reply state 00000000acd164a4 transno 8589953243 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167021.849258:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953243 is committed 00000100:00100000:2.0:1762167021.849268:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1762167021.849269:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3790 committed 00000004:00080000:0.0:1762167021.849291:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3803 committed 00000004:00080000:0.0:1762167021.849303:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3789 committed 00000004:00080000:0.0:1762167021.849305:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3802 committed 00000004:00080000:0.0:1762167021.849310:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3788 committed 00000004:00080000:0.0:1762167021.849312:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3801 committed 00000004:00080000:0.0:1762167021.849315:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3800 committed 00000004:00080000:0.0:1762167021.849318:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3787 committed 00000001:00100000:0.0:1762167021.849339:0:30849:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b4e369e7-58c9-4605-91cc-bb6f1ca9b31b 00000001:00080000:0.0:1762167021.849347:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953240 is committed 00000020:00000080:0.0:1762167021.849351:0:30849:0:(genops.c:904:class_export_put()) final put ffff9ee24530f000/b4e369e7-58c9-4605-91cc-bb6f1ca9b31b 00000001:00100000:0.0:1762167021.849370:0:30849:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 12bd460f-a83f-41fe-92df-dfba4795e03a 00000001:00080000:0.0:1762167021.849376:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953239 is committed 00000020:00000080:0.0:1762167021.849385:0:30849:0:(genops.c:904:class_export_put()) final put ffff9ee2448df800/12bd460f-a83f-41fe-92df-dfba4795e03a 00010000:00080000:2.0:1762167021.849413:0:30819:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762167021.849442:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58121:x1847765452061568:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 20401us (20518us total) trans 8589953243 rc 0/0 00000100:00100000:2.0:1762167021.849454:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20162 00000100:00100000:1.0:1762167021.849487:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454562816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167021.849488:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454562688:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762167021.849495:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.849505:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.849512:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.849519:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167021.849524:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.849546:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167021.849556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167021.849558:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454562944:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167021.849568:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167021.849574:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167021.849579:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.849586:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0c895 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167021.849594:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454562688 00000100:00100000:3.0:1762167021.849595:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454563200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167021.849603:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454562688 00000100:00100000:1.0:1762167021.849604:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167021.849636:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454563456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167021.849637:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1762167021.849637:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762167021.849669:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454562944 00000100:00100000:0.0:1762167021.849670:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454563200 00000100:00100000:3.0:1762167021.849673:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1762167021.849676:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454562944 00000100:00100000:1.0:1762167021.849676:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167021.849677:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454563200 00000100:00100000:3.0:1762167021.849684:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454563072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167021.849710:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454563456 00000100:00100000:0.0:1762167021.849715:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454563456 00000100:00100000:3.0:1762167021.849726:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167021.849732:0:34501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17602 00000100:00100000:2.0:1762167021.849744:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17603 00000100:00100000:1.0:1762167021.849750:0:34501:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454562688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167021.849753:0:34500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454563072 00000100:00100000:3.0:1762167021.849754:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454563584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167021.849759:0:34500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454563072 00000100:00100000:2.0:1762167021.849803:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454563200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167021.849818:0:34500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17604 00000100:00100000:3.0:1762167021.849819:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167021.849830:0:34500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454562944:12345-0@lo:2:osp-syn-1-0.0 00000020:00000080:3.0:1762167021.849871:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee24530f000/b4e369e7-58c9-4605-91cc-bb6f1ca9b31b for lustre-MDT0000 00000020:00000080:3.0:1762167021.849934:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee2448df800/12bd460f-a83f-41fe-92df-dfba4795e03a for lustre-MDT0000 00000020:00000080:3.0:1762167021.849980:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee24530e800 for lustre-MDT0000 00000020:00000080:3.0:1762167021.849987:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee2448d9800 for lustre-MDT0000 00000100:00100000:3.0:1762167021.850010:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454563584 00000100:00100000:3.0:1762167021.850014:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454563584 00000100:00100000:1.0:1762167021.850026:0:34501:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454562688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 282us (474us total) trans 21474843737 rc 0/0 00000100:00100000:1.0:1762167021.850033:0:34501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17602 00000100:00100000:0.0:1762167021.850042:0:34500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454562944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (442us total) trans 17179876156 rc 0/0 00000100:00100000:3.0:1762167021.850051:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17605 00000100:00100000:2.0:1762167021.850052:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454563200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 296us (415us total) trans 21474843738 rc 0/0 00000100:00100000:0.0:1762167021.850061:0:34500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17604 00000100:00100000:3.0:1762167021.850065:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454563456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167021.850070:0:34501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17606 00000100:00100000:1.0:1762167021.850080:0:34501:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454563072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167021.850085:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17603 00000100:00100000:0.0:1762167021.850091:0:34500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17607 00000100:00100000:0.0:1762167021.850103:0:34500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454563584:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1762167021.850125:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762167021.850203:0:34501:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454563072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (478us total) trans 21474843739 rc 0/0 00000100:00100000:1.0:1762167021.850208:0:34501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17606 00000004:00080000:1.0:1762167021.850245:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240a680/2, rc 0, transno 17179876156 00000100:00100000:1.0:1762167021.850252:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454562944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167021.850254:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454563456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (579us total) trans 21474843740 rc 0/0 00000100:00100000:3.0:1762167021.850264:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17605 00000004:00080000:1.0:1762167021.850264:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b1c00/2, rc 0, transno 21474843740 00000100:00100000:1.0:1762167021.850269:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454563456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167021.850304:0:34500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454563584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (487us total) trans 17179876157 rc 0/0 00000100:00100000:0.0:1762167021.850313:0:34500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17607 00000100:00100000:3.0:1762167021.850325:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167021.850354:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454562816 00000100:00100000:0.0:1762167021.850360:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454562816 00000100:00100000:3.0:1762167021.850364:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454563328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167021.850391:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167021.851805:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454563328 00000100:00100000:0.0:1762167021.851817:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454563328 00000100:00100000:0.0:1762167021.851857:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17608 00000100:00100000:3.0:1762167021.851863:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17609 00000100:00100000:0.0:1762167021.851864:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454562816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167021.851871:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454563328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167021.852099:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454563328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (1705us total) trans 17179876158 rc 0/0 00000100:00100000:3.0:1762167021.852106:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17609 00000004:00080000:2.0:1762167021.852150:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240ad80/2, rc 0, transno 17179876158 00000004:00080000:3.0:1762167021.852156:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b1500/2, rc 0, transno 21474843739 00000100:00100000:2.0:1762167021.852161:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454563328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167021.852165:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454563072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167021.852166:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454562816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 301us (1841us total) trans 17179876159 rc 0/0 00000100:00100000:0.0:1762167021.852173:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17608 00000004:00080000:2.0:1762167021.852182:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240bb80/2, rc 0, transno 17179876159 00000100:00100000:2.0:1762167021.852187:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454562816:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167021.852191:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242409500/2, rc 0, transno 17179876157 00000100:00100000:3.0:1762167021.852197:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454563584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167021.852207:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b3480/2, rc 0, transno 21474843737 00000100:00100000:3.0:1762167021.852211:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454562688:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167021.852219:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b3800/2, rc 0, transno 21474843738 00000100:00100000:3.0:1762167021.852222:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454563200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167021.852353:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.852377:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452061696 00000100:00100000:2.0:1762167021.852381:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452061696 00000100:00100000:2.0:1762167021.852419:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20163 00000100:00100000:2.0:1762167021.852426:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:58121:x1847765452061696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167021.852454:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167021.852472:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44a5 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.852526:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44a5 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.852540:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44a5 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.852559:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167021.852562:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167021.852566:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167021.852610:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58121:x1847765452061696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 184us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.852616:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20163 00000100:00100000:0.0:1762167021.854314:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.854370:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452061824 00000100:00100000:2.0:1762167021.854379:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452061824 00000100:00100000:2.0:1762167021.854445:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20164 00000100:00100000:2.0:1762167021.854455:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58121:x1847765452061824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167021.854471:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167021.854492:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c8a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44ac expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.854573:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c8aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.854586:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c8aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.854625:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c8aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167021.854653:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 2133921 00000004:00200000:2.0:1762167021.854657:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167021.854671:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c8aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.854709:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c8a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ac expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.854733:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c8aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ac expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.854742:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167021.854745:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167021.854750:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167021.854878:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58121:x1847765452061824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 424us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.854887:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20164 00000100:00100000:3.0:1762167021.856896:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.856940:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.857008:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452061952 00000100:00100000:0.0:1762167021.857024:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452061952 00000100:00100000:1.0:1762167021.857027:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452062080 00000100:00100000:1.0:1762167021.857052:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452062080 00000100:00100000:3.0:1762167021.857054:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.857120:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452062208 00000100:00100000:3.0:1762167021.857136:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17610 00000100:00100000:0.0:1762167021.857138:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452062208 00000100:00100000:1.0:1762167021.857149:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17611 00000100:00100000:3.0:1762167021.857156:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2359:x1847765452061952:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762167021.857166:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765452062080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167021.857179:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167021.857179:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167021.857195:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17612 00010000:00010000:3.0:1762167021.857204:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44b3 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.857204:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44ba expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167021.857226:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765452062208:12345-192.168.203.35@tcp:101:lfs.0 00002000:00010000:1.0:1762167021.857250:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x823:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167021.857250:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167021.857277:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.857292:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44c1 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.857293:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.857308:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ba expref: 20 pid: 33892 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1762167021.857313:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81f:0x0] initial LVB size: 0, mtime: 0x690888e9, atime: 0x690888e9, ctime: 0x690888e9, blocks: 0x1 00010000:00010000:1.0:1762167021.857335:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ba expref: 20 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167021.857338:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167021.857350:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.857351:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00002000:00010000:0.0:1762167021.857353:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x824:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762167021.857359:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44b3 expref: 11 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.857376:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167021.857379:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44b3 expref: 11 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.857382:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762167021.857384:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167021.857394:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00010000:00010000:0.0:1762167021.857399:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c1 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167021.857414:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765452062080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 252us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167021.857425:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2359:x1847765452061952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 276us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.857429:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17611 00010000:00010000:0.0:1762167021.857435:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c1 expref: 21 pid: 26444 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167021.857446:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17610 00000100:00100000:1.0:1762167021.857456:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452062336 00010000:00010000:0.0:1762167021.857463:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f5c00, rc 0) 00000100:00100000:1.0:1762167021.857465:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452062336 00000100:00100000:1.0:1762167021.857506:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17613 00000100:00100000:1.0:1762167021.857516:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765452062336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167021.857525:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167021.857537:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44c8 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167021.857539:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765452062208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 331us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.857549:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17612 00002000:00010000:1.0:1762167021.857641:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x821:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167021.857653:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.857654:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.857661:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c8 expref: 12 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167021.857674:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c8 expref: 12 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167021.857682:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:1.0:1762167021.857729:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2358:x1847765452062336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 216us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.857736:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17613 00000100:00100000:2.0:1762167021.894566:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.894752:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452062592 00000100:00100000:1.0:1762167021.894792:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452062592 00000100:00100000:1.0:1762167021.894865:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20165 00000100:00100000:1.0:1762167021.894876:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58121:x1847765452062592:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167021.894933:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167021.894974:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c8aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ac expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.894995:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167021.895000:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167021.895313:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.895332:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.895357:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167021.895419:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953244 00000004:00010000:1.0:1762167021.895448:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f3bf1081 reply state 0000000093fcc23b transno 8589953245 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167021.895457:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167021.895557:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58121:x1847765452062592:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 682us (1001us total) trans 8589953245 rc 0/0 00000100:00100000:1.0:1762167021.895566:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20165 00000020:00080000:1.0:1762167021.895572:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167021.897235:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.897249:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.897256:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.897261:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167021.897266:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.897273:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.897296:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167021.897300:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167021.897304:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.897326:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8cd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167021.897702:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.897912:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452062720 00000100:00100000:1.0:1762167021.897922:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452062720 00000100:00100000:1.0:1762167021.897978:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17614 00000100:00100000:1.0:1762167021.897988:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:58121:x1847765452062720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167021.898006:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167021.898026:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44cf expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167021.898050:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x822:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167021.898071:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.898073:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.898081:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44cf expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.898094:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44cf expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.898104:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8000, rc 0) 00000100:00100000:1.0:1762167021.898169:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:58121:x1847765452062720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 181us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.898176:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17614 00000100:00100000:2.0:1762167021.900991:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.901096:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452062848 00000100:00100000:1.0:1762167021.901106:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452062848 00000100:00100000:1.0:1762167021.901166:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17615 00000100:00100000:1.0:1762167021.901178:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:58121:x1847765452062848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167021.901211:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167021.901235:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44d6 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167021.901258:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x822:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167021.901293:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.901296:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.901305:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44d6 expref: 13 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.901322:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44d6 expref: 13 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.901335:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00000100:00100000:1.0:1762167021.901397:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:58121:x1847765452062848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 222us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.901404:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17615 00000100:00100000:3.0:1762167021.903121:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.903525:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452062976 00000100:00100000:1.0:1762167021.903534:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452062976 00000100:00100000:1.0:1762167021.903587:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17616 00000100:00100000:1.0:1762167021.903596:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:58121:x1847765452062976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167021.903612:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167021.903633:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44dd expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167021.903657:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x825:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167021.903675:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.903688:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.903695:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44dd expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.903711:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44dd expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.903723:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:1.0:1762167021.903804:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:58121:x1847765452062976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 209us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.903810:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17616 00000100:00100000:2.0:1762167021.905742:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.906115:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.906350:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452063232 00000100:00100000:3.0:1762167021.906359:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452063232 00000100:00100000:1.0:1762167021.906359:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452063104 00000100:00100000:1.0:1762167021.906367:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452063104 00002000:00010000:3.0:1762167021.906404:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2082 (0->18446744073709551615) 00002000:00010000:1.0:1762167021.906409:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2082 (0->18446744073709551615) 00002000:00100000:3.0:1762167021.906410:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc31180 with x1847765452063232 ext(0->18446744073709551615) 00002000:00100000:1.0:1762167021.906418:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc31f80 with x1847765452063104 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167021.906425:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dc31180. 00002000:00010000:1.0:1762167021.906437:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc31f80. 00000100:00100000:3.0:1762167021.906477:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3274 00000100:00100000:3.0:1762167021.906491:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765452063232:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167021.906570:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.906713:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452063360 00000100:00100000:1.0:1762167021.906728:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452063360 00002000:00010000:1.0:1762167021.906747:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2085 (0->18446744073709551615) 00002000:00100000:1.0:1762167021.906750:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc33100 with x1847765452063360 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167021.906784:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc33100. 00002000:00010000:3.0:1762167021.906813:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167021.906814:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3275 00002000:00010000:3.0:1762167021.906820:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb mtime from disk: 0 -> 1762167022 00002000:00010000:3.0:1762167021.906823:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762167021.906825:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb ctime from disk: 0 -> 1762167022 00002000:00010000:3.0:1762167021.906829:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167021.906836:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765452063104:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167021.906836:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3276 00000100:00100000:0.0:1762167021.906854:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765452063360:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167021.906884:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765452063232:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 394us (768us total) trans 21474843741 rc 0/0 00000100:00100000:3.0:1762167021.906893:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3274 00002000:00010000:3.0:1762167021.906911:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2082 (0->18446744073709551615) 00002000:00100000:3.0:1762167021.906914:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc31180 with x1847765452063232 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167021.906919:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dc31180. 00002000:00010000:0.0:1762167021.907091:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167021.907096:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb mtime from disk: 0 -> 1762167022 00002000:00010000:0.0:1762167021.907098:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762167021.907100:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb ctime from disk: 0 -> 1762167022 00002000:00010000:0.0:1762167021.907102:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167021.907149:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765452063360:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 300us (579us total) trans 17179876160 rc 0/0 00000100:00100000:0.0:1762167021.907157:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3276 00002000:00010000:0.0:1762167021.907160:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2085 (0->18446744073709551615) 00002000:00100000:0.0:1762167021.907164:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc33100 with x1847765452063360 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167021.907178:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc33100. 00002000:00010000:1.0:1762167021.907198:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167021.907203:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb mtime from disk: 0 -> 1762167022 00002000:00010000:1.0:1762167021.907206:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167021.907209:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb ctime from disk: 0 -> 1762167022 00002000:00010000:1.0:1762167021.907218:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167021.907328:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765452063104:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 494us (1591us total) trans 17179876161 rc 0/0 00000100:00100000:1.0:1762167021.907337:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3275 00002000:00010000:1.0:1762167021.907341:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2082 (0->18446744073709551615) 00002000:00100000:1.0:1762167021.907344:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc31f80 with x1847765452063104 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167021.907365:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc31f80. 00000100:00100000:3.0:1762167021.909132:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.909208:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452063488 00000100:00100000:1.0:1762167021.909240:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452063488 00000100:00100000:1.0:1762167021.909353:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20166 00000100:00100000:1.0:1762167021.909387:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58121:x1847765452063488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167021.909412:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167021.909451:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8e9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44e4 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.909591:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c8f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.909643:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.909663:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167021.909698:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000004:00200000:1.0:1762167021.909703:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167021.909729:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.909808:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0c8e9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44e4 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.909851:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44e4 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.909858:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167021.909860:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167021.909862:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:1.0:1762167021.909951:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58121:x1847765452063488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 590us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.909967:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20166 00000100:00100000:3.0:1762167021.913484:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.913841:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452063744 00000100:00100000:1.0:1762167021.913852:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452063744 00000100:00100000:1.0:1762167021.913914:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20167 00000100:00100000:1.0:1762167021.913924:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58121:x1847765452063744:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167021.913980:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167021.914014:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c8f0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44e4 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.914033:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167021.914038:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167021.914257:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.914271:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.914292:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167021.914363:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953246 00000004:00010000:1.0:1762167021.914391:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c94fdeeb reply state 00000000256bd64e transno 8589953247 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167021.914400:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167021.914480:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:58121:x1847765452063744:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 553us (1003us total) trans 8589953247 rc 0/0 00000100:00100000:1.0:1762167021.914487:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20167 00000020:00080000:1.0:1762167021.914492:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762167021.916495:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167021.916626:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167021.916630:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452063872 00000100:00100000:0.0:1762167021.916639:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452063872 00010000:00010000:2.0:1762167021.916648:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.916655:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.916660:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167021.916663:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.916671:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.916687:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00000100:00100000:0.0:1762167021.916689:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17617 00010000:00010000:2.0:1762167021.916690:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167021.916694:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167021.916697:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:58121:x1847765452063872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167021.916700:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c8f7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167021.916712:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167021.916732:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44eb expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167021.916756:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x820:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167021.916795:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.916797:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.916806:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44eb expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.916821:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44eb expref: 15 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.916832:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee38216cc00, rc 0) 00000100:00100000:0.0:1762167021.916884:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:58121:x1847765452063872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 187us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.916890:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17617 00000100:00100000:3.0:1762167021.919026:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.919077:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452064000 00000100:00100000:2.0:1762167021.919085:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452064000 00002000:00010000:2.0:1762167021.919119:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2080 (0->18446744073709551615) 00002000:00100000:2.0:1762167021.919123:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa9c00 with x1847765452064000 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167021.919132:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa9c00. 00000100:00100000:2.0:1762167021.919155:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3277 00000100:00100000:2.0:1762167021.919161:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765452064000:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167021.919441:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167021.919445:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb mtime from disk: 0 -> 1762167022 00002000:00010000:2.0:1762167021.919459:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167021.919462:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb ctime from disk: 0 -> 1762167022 00002000:00010000:2.0:1762167021.919464:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167021.919527:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765452064000:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 365us (509us total) trans 21474843742 rc 0/0 00000100:00100000:2.0:1762167021.919536:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3277 00002000:00010000:2.0:1762167021.919540:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2080 (0->18446744073709551615) 00002000:00100000:2.0:1762167021.919543:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa9c00 with x1847765452064000 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167021.919547:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa9c00. 00000100:00100000:3.0:1762167021.922131:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.922272:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452064256 00000100:00100000:1.0:1762167021.922295:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452064256 00000100:00100000:1.0:1762167021.922356:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20168 00000100:00100000:1.0:1762167021.922367:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58121:x1847765452064256:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167021.922468:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.922485:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.922497:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00010000:1.0:1762167021.922657:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c44af640 reply state 00000000a3aa24e7 transno 8589953248 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167021.922666:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167021.922758:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:58121:x1847765452064256:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 392us (634us total) trans 8589953248 rc 0/0 00000100:00100000:1.0:1762167021.922792:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20168 00000100:00100000:3.0:1762167021.925975:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167021.926003:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.926026:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.926033:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.926039:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167021.926043:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.926048:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.926070:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167021.926073:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167021.926077:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167021.926083:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c905 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167021.928005:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452064384 00000100:00100000:0.0:1762167021.928020:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452064384 00000100:00100000:0.0:1762167021.928090:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17618 00000100:00100000:0.0:1762167021.928101:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:58121:x1847765452064384:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167021.928120:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167021.928169:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44f2 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.928201:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44b3 expref: 17 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.928211:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.928213:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.928217:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.928252:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44b3 expref: 17 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.928276:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44b3 expref: 17 pid: 12402 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1762167021.928301:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454563712:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167021.928388:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2430fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167021.930256:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454563712:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167021.930304:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.930321:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2431a1e00, rc 0) 00000100:00100000:0.0:1762167021.930392:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:58121:x1847765452064384:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2292us (4424us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.930401:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17618 00000100:00100000:3.0:1762167021.930556:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.930744:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452064512 00000100:00100000:2.0:1762167021.930752:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452064512 00010000:00010000:2.0:1762167021.930825:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44b3 expref: 17 pid: 12402 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1762167021.930858:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7713 00000100:00100000:2.0:1762167021.930868:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765452064512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167021.930882:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167021.930904:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44b3 expref: 17 pid: 12402 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1762167021.930916:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44b3 expref: 17 pid: 12402 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1762167021.930939:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c8b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44b3 expref: 17 pid: 12402 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1762167021.930953:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167021.930962:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167021.931242:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.931256:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.931303:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167021.931317:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454563840:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167021.931383:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167021.933721:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454563840:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167021.933741:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167021.933749:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167021.933844:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765452064512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2976us (3290us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.933856:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7713 00000100:00100000:0.0:1762167021.933970:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452064640 00000100:00100000:0.0:1762167021.933978:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452064640 00000100:00100000:0.0:1762167021.934025:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17619 00000100:00100000:0.0:1762167021.934036:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:58121:x1847765452064640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167021.934051:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167021.934067:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb44f9 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.934095:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ba expref: 25 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.934104:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.934106:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.934110:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 25 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.934144:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ba expref: 25 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.934157:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ba expref: 25 pid: 33892 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1762167021.934170:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454563968:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167021.934228:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2430fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167021.936152:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454563968:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167021.936185:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 25 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.936222:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2431a1000, rc 0) 00000100:00100000:3.0:1762167021.936224:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.936268:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452064768 00000100:00100000:0.0:1762167021.936269:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:58121:x1847765452064640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2234us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.936278:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452064768 00000100:00100000:0.0:1762167021.936294:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17619 00010000:00010000:2.0:1762167021.936324:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ba expref: 25 pid: 33892 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1762167021.936362:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7714 00000100:00100000:2.0:1762167021.936371:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765452064768:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167021.936385:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167021.936408:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ba expref: 25 pid: 33892 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1762167021.936433:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ba expref: 25 pid: 33892 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1762167021.936484:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c8b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44ba expref: 25 pid: 33892 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1762167021.936498:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167021.936500:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167021.936511:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.936523:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.936565:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167021.936579:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454564096:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167021.936642:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167021.938272:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.938370:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454564096:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167021.938389:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167021.938433:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765452064768:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2062us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.938444:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7714 00000100:00100000:0.0:1762167021.939330:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452064896 00000100:00100000:0.0:1762167021.939339:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452064896 00000100:00100000:0.0:1762167021.939394:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17620 00000100:00100000:0.0:1762167021.939404:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:58121:x1847765452064896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167021.939423:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167021.939441:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4500 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.939469:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c1 expref: 25 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.939477:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.939480:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.939484:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 25 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.939514:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c1 expref: 25 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167021.939527:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c1 expref: 25 pid: 26444 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1762167021.939562:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454564224:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167021.939637:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2430fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167021.941469:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454564224:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167021.941499:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 25 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.941516:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2446c8000, rc 0) 00000100:00100000:0.0:1762167021.941575:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:58121:x1847765452064896:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2172us (3308us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.941582:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17620 00000100:00100000:3.0:1762167021.941703:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.941748:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452065024 00000100:00100000:0.0:1762167021.941755:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452065024 00010000:00010000:0.0:1762167021.941823:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c1 expref: 25 pid: 26444 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1762167021.941861:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7715 00000100:00100000:0.0:1762167021.941869:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765452065024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167021.941887:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167021.941909:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c1 expref: 25 pid: 26444 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1762167021.941920:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c1 expref: 25 pid: 26444 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1762167021.941961:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c8bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c1 expref: 25 pid: 26444 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1762167021.941973:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.941974:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.941981:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.941990:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.942027:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 24 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167021.942040:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454564352:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167021.942102:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2430fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167021.944464:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.944663:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454564352:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762167021.944684:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167021.944742:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765452065024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2872us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.944753:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7715 00000100:00100000:1.0:1762167021.944932:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452065152 00000100:00100000:1.0:1762167021.944940:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452065152 00000100:00100000:1.0:1762167021.944992:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17621 00000100:00100000:1.0:1762167021.945002:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:58121:x1847765452065152:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167021.945018:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167021.945037:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4507 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.945063:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c8 expref: 17 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167021.945089:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.945091:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167021.945096:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.945134:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c8 expref: 17 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167021.945147:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c8 expref: 17 pid: 33892 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1762167021.945160:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454564480:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167021.945224:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee344d6cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167021.946808:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454564480:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167021.946818:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167021.946843:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167021.946861:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:0.0:1762167021.946861:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452065280 00000100:00100000:0.0:1762167021.946867:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452065280 00010000:00010000:0.0:1762167021.946894:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c8 expref: 18 pid: 33892 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1762167021.946912:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:58121:x1847765452065152:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1908us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167021.946919:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17621 00000100:00100000:0.0:1762167021.946946:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7716 00000100:00100000:0.0:1762167021.946956:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765452065280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167021.946970:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167021.946990:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c8 expref: 17 pid: 33892 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1762167021.947002:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c8 expref: 17 pid: 33892 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1762167021.947024:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0c8c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44c8 expref: 17 pid: 33892 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1762167021.947036:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.947038:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167021.947045:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.947053:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167021.947082:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167021.947093:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454564608:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167021.947146:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345adfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167021.948906:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454564608:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167021.948928:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167021.948929:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167021.948984:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.949014:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452065408 00000100:00100000:2.0:1762167021.949021:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.949021:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452065408 00000100:00100000:1.0:1762167021.949063:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452065536 00000100:00100000:1.0:1762167021.949066:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452065536 00000100:00100000:2.0:1762167021.949087:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167021.949257:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452065664 00000100:00100000:1.0:1762167021.949265:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452065664 00000100:00100000:1.0:1762167021.949307:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452065792 00000100:00100000:1.0:1762167021.949310:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452065792 00000100:00100000:1.0:1762167021.949332:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17622 00000100:00100000:1.0:1762167021.949340:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452065408:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167021.949379:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17623 00000100:00100000:3.0:1762167021.949390:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765452065536:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167021.949528:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167021.949532:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb mtime from disk: 1762167017 -> 1762167017 00002000:00010000:1.0:1762167021.949535:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb atime from disk: 1762167017 -> 1762167018 00002000:00010000:1.0:1762167021.949537:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb ctime from disk: 1762167017 -> 1762167022 00002000:00010000:1.0:1762167021.949540:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1762167021.949548:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167021.949553:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb mtime from disk: 0 -> 1762167017 00002000:00010000:3.0:1762167021.949555:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb atime from disk: 0 -> 1762167018 00002000:00010000:3.0:1762167021.949557:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb ctime from disk: 0 -> 1762167022 00002000:00010000:3.0:1762167021.949560:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167021.949788:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452065280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2809us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.949798:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7716 00000100:00100000:0.0:1762167021.949846:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17624 00000100:00100000:0.0:1762167021.949855:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765452065664:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762167021.949952:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167021.949955:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb mtime from disk: 0 -> 1762167017 00002000:00010000:0.0:1762167021.949957:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb atime from disk: 0 -> 1762167018 00002000:00010000:0.0:1762167021.949959:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb ctime from disk: 0 -> 1762167022 00002000:00010000:0.0:1762167021.949961:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167021.950028:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765452065536:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 639us (1044us total) trans 17179876162 rc 0/0 00000100:00100000:3.0:1762167021.950035:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17623 00000100:00100000:3.0:1762167021.950064:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17625 00000100:00100000:3.0:1762167021.950071:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452065792:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167021.950091:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452065408:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 750us (1166us total) trans 21474843743 rc 0/0 00000100:00100000:1.0:1762167021.950101:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17622 00002000:00010000:3.0:1762167021.950172:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167021.950176:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb mtime from disk: 0 -> 1762167017 00002000:00010000:3.0:1762167021.950178:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb atime from disk: 0 -> 1762167018 00002000:00010000:3.0:1762167021.950181:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb ctime from disk: 0 -> 1762167022 00002000:00010000:3.0:1762167021.950183:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167021.950346:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765452065664:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 491us (1324us total) trans 17179876163 rc 0/0 00000100:00100000:0.0:1762167021.950354:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17624 00000100:00100000:3.0:1762167021.950687:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452065792:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 615us (1599us total) trans 21474843744 rc 0/0 00000100:00100000:3.0:1762167021.950694:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17625 00000100:00100000:1.0:1762167021.953642:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167021.953794:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452066048 00000100:00100000:3.0:1762167021.953804:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452066048 00000100:00100000:3.0:1762167021.953855:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7422 00000100:00100000:3.0:1762167021.953865:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:58121:x1847765452066048:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762167021.953927:0:30820:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x64f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0c86b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb449e expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.953971:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167021.953984:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44a5 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.953992:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167021.954023:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44a5 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167021.954058:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44a5 expref: 896 pid: 30819 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1762167021.954072:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454564736:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167021.954150:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34881f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167021.956621:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454564736:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167021.956650:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167021.957270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167021.957345:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452066176 00000100:00100000:0.0:1762167021.957352:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452066176 00010000:00010000:0.0:1762167021.957393:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44a5 expref: 897 pid: 30819 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1762167021.957430:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7717 00000100:00100000:0.0:1762167021.957440:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765452066176:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167021.957455:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167021.957462:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44a5 expref: 897 pid: 30819 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.957491:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44a5 expref: 897 pid: 30819 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.957513:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c89c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44a5 expref: 897 pid: 30819 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1762167021.957530:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167021.957535:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167021.957544:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167021.957551:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167021.957574:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167021.957636:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765452066176:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 196us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167021.957644:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7717 00010000:00010000:3.0:1762167021.957685:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167021.957693:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000040:00080000:3.0:1762167021.958229:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5694, 88 off461064 00000004:00080000:3.0:1762167021.958246:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642750482488ns, next at 639432226677ns, rc = 0 00000040:00080000:3.0:1762167021.958326:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5702, 88 off462120 00000004:00080000:3.0:1762167021.958332:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642750568787ns, next at 639432380558ns, rc = 0 00000040:00080000:3.0:1762167021.958381:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5703, 88 off462208 00000004:00080000:3.0:1762167021.958388:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642750624625ns, next at 639432380558ns, rc = 0 00000040:00080000:3.0:1762167021.958423:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5695, 88 off461152 00000004:00080000:3.0:1762167021.958428:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642750664984ns, next at 639432226677ns, rc = 0 00000040:00080000:3.0:1762167021.958463:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5704, 88 off462296 00000004:00080000:3.0:1762167021.958468:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642750705074ns, next at 639432380558ns, rc = 0 00000040:00080000:3.0:1762167021.958491:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5696, 88 off461240 00000004:00080000:3.0:1762167021.958496:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642750732695ns, next at 639432226677ns, rc = 0 00000040:00080000:3.0:1762167021.958537:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5705, 88 off462384 00000004:00080000:3.0:1762167021.958542:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642750779412ns, next at 639432380558ns, rc = 0 00000040:00080000:3.0:1762167021.958576:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5697, 88 off461328 00000004:00080000:3.0:1762167021.958582:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642750819355ns, next at 639432226677ns, rc = 0 00000004:00010000:2.0:1762167021.977240:0:30820:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e60e7a0f reply state 00000000ffe2c3ea transno 8589953249 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167021.977256:0:30820:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1762167021.977261:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953248 is committed 00010000:00010000:2.0:1762167021.977266:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167021.977271:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167021.977278:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0c86b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb449e expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167021.977300:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953249 is committed 00000004:00080000:0.0:1762167021.977307:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3794 committed 00000004:00080000:0.0:1762167021.977325:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3807 committed 00000004:00080000:0.0:1762167021.977342:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3793 committed 00000004:00080000:0.0:1762167021.977345:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3806 committed 00000004:00080000:0.0:1762167021.977348:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3792 committed 00000004:00080000:0.0:1762167021.977351:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3805 committed 00000004:00080000:0.0:1762167021.977353:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3804 committed 00000004:00080000:0.0:1762167021.977369:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3791 committed 00000100:00100000:0.0:1762167021.977416:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454564864:0@lo:2:osp-syn-0-0.0 00010000:00080000:2.0:1762167021.977423:0:30820:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762167021.977438:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:58121:x1847765452066048:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 23573us (23803us total) trans 8589953249 rc 0/0 00000100:00100000:2.0:1762167021.977449:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7422 00000100:00100000:3.0:1762167021.977452:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454565248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167021.977484:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167021.977488:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454564992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167021.977506:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167021.977531:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454565376:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167021.977533:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167021.977540:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454565120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167021.977552:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454565760:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167021.977556:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167021.977563:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167021.977568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167021.977575:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167021.977581:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167021.977589:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167021.977604:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167021.977611:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167021.977614:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167021.977619:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167021.977625:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c928 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167021.977627:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454564864 00000100:00100000:0.0:1762167021.977634:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454565248 00000100:00100000:1.0:1762167021.977637:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454564864 00000100:00100000:0.0:1762167021.977641:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454565248 00000100:00100000:2.0:1762167021.977657:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167021.977688:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454565504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167021.977695:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454565376 00000100:00100000:1.0:1762167021.977701:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454565376 00000100:00100000:3.0:1762167021.977705:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454565760 00000100:00100000:0.0:1762167021.977707:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454564992 00000100:00100000:3.0:1762167021.977711:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454565760 00000100:00100000:0.0:1762167021.977713:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454564992 00000100:00100000:2.0:1762167021.977715:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167021.977742:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454565504 00000100:00100000:1.0:1762167021.977747:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454565504 00000100:00100000:3.0:1762167021.977755:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17626 00000100:00100000:3.0:1762167021.977789:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454564864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167021.977794:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17627 00000100:00100000:0.0:1762167021.977809:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454565248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167021.977810:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17628 00000100:00100000:1.0:1762167021.977819:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17629 00000100:00100000:2.0:1762167021.977823:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454565376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167021.977833:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454565760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167021.977994:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167021.977994:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167021.977998:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb mtime from disk: 1762167017 -> 1762167017 00002000:00010000:2.0:1762167021.977998:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb mtime from disk: 1762167017 -> 1762167017 00002000:00010000:3.0:1762167021.978002:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb atime from disk: 1762167018 -> 1762167018 00002000:00010000:2.0:1762167021.978002:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb atime from disk: 1762167018 -> 1762167018 00002000:00010000:3.0:1762167021.978006:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb ctime from disk: 1762167022 -> 1762167022 00002000:00010000:2.0:1762167021.978006:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb ctime from disk: 1762167022 -> 1762167022 00002000:00010000:3.0:1762167021.978009:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1762167021.978009:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x823:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1762167021.978012:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167021.978014:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167021.978018:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb mtime from disk: 1762167022 -> 1762167022 00002000:00010000:1.0:1762167021.978020:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb mtime from disk: 1762167022 -> 1762167022 00002000:00010000:0.0:1762167021.978022:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167021.978024:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762167021.978028:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb ctime from disk: 1762167022 -> 1762167022 00002000:00010000:0.0:1762167021.978031:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x820:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1762167021.978038:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb ctime from disk: 1762167022 -> 1762167022 00002000:00010000:1.0:1762167021.978041:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x825:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167021.978046:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3296:x1847765454564864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (561us total) trans 21474843745 rc 0/0 00000100:00100000:2.0:1762167021.978047:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3296:x1847765454565376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (478us total) trans 17179876164 rc 0/0 00000100:00100000:3.0:1762167021.978055:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17626 00000100:00100000:2.0:1762167021.978062:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17628 00000100:00100000:0.0:1762167021.978082:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454565248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 277us (574us total) trans 21474843746 rc 0/0 00000100:00100000:1.0:1762167021.978089:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454565760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 258us (482us total) trans 17179876165 rc 0/0 00000100:00100000:2.0:1762167021.978092:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17630 00000100:00100000:0.0:1762167021.978101:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17627 00000100:00100000:2.0:1762167021.978104:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454564992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167021.978110:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17629 00000100:00100000:0.0:1762167021.978129:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17631 00000100:00100000:0.0:1762167021.978141:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454565504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167021.978162:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167021.978192:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454565632:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167021.978202:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167021.978206:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb mtime from disk: 1762167017 -> 1762167017 00002000:00010000:2.0:1762167021.978209:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb atime from disk: 1762167018 -> 1762167018 00000100:00100000:3.0:1762167021.978212:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454565120 00000100:00100000:3.0:1762167021.978216:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454565120 00002000:00010000:2.0:1762167021.978217:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb ctime from disk: 1762167022 -> 1762167022 00002000:00010000:2.0:1762167021.978220:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x821:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167021.978226:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167021.978258:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454565632 00000100:00100000:3.0:1762167021.978262:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454565632 00000100:00100000:2.0:1762167021.978265:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454564992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (607us total) trans 21474843747 rc 0/0 00002000:00010000:0.0:1762167021.978272:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167021.978273:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17630 00002000:00010000:0.0:1762167021.978288:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb mtime from disk: 1762167017 -> 1762167017 00002000:00010000:0.0:1762167021.978292:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb atime from disk: 1762167018 -> 1762167018 00000100:00100000:1.0:1762167021.978293:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17632 00002000:00010000:0.0:1762167021.978296:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb ctime from disk: 1762167022 -> 1762167022 00002000:00010000:0.0:1762167021.978301:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x824:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167021.978302:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17633 00000100:00100000:1.0:1762167021.978307:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3294:x1847765454565120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167021.978315:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454565632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167021.978345:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454565504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (629us total) trans 17179876166 rc 0/0 00000004:00080000:2.0:1762167021.978346:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aaa680/2, rc 0, transno 21474843747 00000100:00100000:2.0:1762167021.978357:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454564992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167021.978359:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17631 00000004:00080000:2.0:1762167021.978377:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242408700/2, rc 0, transno 17179876166 00000100:00100000:2.0:1762167021.978384:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454565504:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167021.978407:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240b100/2, rc 0, transno 17179876165 00000004:00080000:2.0:1762167021.978413:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242409c00/2, rc 0, transno 17179876164 00000100:00100000:0.0:1762167021.978415:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454565760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167021.978422:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454565376:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167021.978430:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:0.0:1762167021.978437:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aaaa00/2, rc 0, transno 21474843746 00002000:00010000:3.0:1762167021.978440:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb mtime from disk: 1762167022 -> 1762167022 00000004:00080000:2.0:1762167021.978440:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aaa300/2, rc 0, transno 21474843745 00002000:00010000:3.0:1762167021.978445:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1762167021.978445:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454565248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167021.978448:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454564864:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167021.978451:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb ctime from disk: 1762167022 -> 1762167022 00002000:00010000:3.0:1762167021.978454:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x822:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1762167021.978477:0:34499:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167021.978481:0:34499:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb mtime from disk: 1762167022 -> 1762167022 00002000:00010000:1.0:1762167021.978483:0:34499:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167021.978485:0:34499:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb ctime from disk: 1762167022 -> 1762167022 00002000:00010000:1.0:1762167021.978489:0:34499:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x822:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167021.978490:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454565632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (262us total) trans 17179876167 rc 0/0 00000100:00100000:3.0:1762167021.978499:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17633 00000004:00080000:0.0:1762167021.978519:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240aa00/2, rc 0, transno 17179876167 00000100:00100000:0.0:1762167021.978526:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454565632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167021.978534:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454565120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 229us (371us total) trans 21474843748 rc 0/0 00000100:00100000:1.0:1762167021.978542:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17632 00000004:00080000:0.0:1762167021.978542:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aa8380/2, rc 0, transno 21474843748 00000100:00100000:0.0:1762167021.978548:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454565120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167021.980020:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.980060:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452066304 00000100:00100000:2.0:1762167021.980067:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452066304 00000100:00100000:2.0:1762167021.980107:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20169 00000100:00100000:2.0:1762167021.980114:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:58121:x1847765452066304:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167021.980130:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167021.980150:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c92f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb450e expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.980206:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c92f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb450e expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.980222:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c92f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb450e expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.980265:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:2.0:1762167021.980268:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167021.980272:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:2.0:1762167021.980339:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:58121:x1847765452066304:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 225us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167021.980346:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20169 00000100:00100000:1.0:1762167021.982578:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.982630:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452066560 00000100:00100000:2.0:1762167021.982639:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452066560 00000100:00100000:2.0:1762167021.982690:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7423 00000100:00100000:2.0:1762167021.982700:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:58121:x1847765452066560:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167021.983020:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58121:x1847765452066560:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 320us (448us total) trans 8589953250 rc 0/0 00000100:00100000:2.0:1762167021.983032:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7423 00010000:00010000:1.0:1762167021.994720:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167021.997717:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167021.998832:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452066816 00000100:00100000:2.0:1762167021.998845:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452066816 00000100:00100000:2.0:1762167021.998900:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20170 00000100:00100000:2.0:1762167021.998909:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58123:x1847765452066816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167021.998932:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167021.998951:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4515 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.999020:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999034:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999063:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999080:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999087:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999094:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999206:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999214:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999220:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999226:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167021.999230:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999238:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999249:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:2.0:1762167021.999252:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167021.999256:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999262:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c93d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999298:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999304:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999310:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999315:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167021.999318:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999324:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999332:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee342c23700) 00010000:00010000:2.0:1762167021.999334:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167021.999337:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999342:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c944 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167021.999386:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c936 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4515 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.999397:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:2.0:1762167021.999399:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762167021.999403:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4515 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167021.999424:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167021.999496:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58123:x1847765452066816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 587us (1789us total) trans 0 rc 301/301 00000100:00100000:2.0:1762167021.999504:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20170 00000100:00100000:1.0:1762167022.002227:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167022.002349:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452066944 00000100:00100000:2.0:1762167022.002364:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452066944 00000100:00100000:2.0:1762167022.002421:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20171 00000100:00100000:2.0:1762167022.002434:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58123:x1847765452066944:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:2.0:1762167022.002503:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002519:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002530:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002546:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002552:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002558:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002664:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002672:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002695:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167022.002737:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000004:00200000:2.0:1762167022.002742:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167022.002754:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002802:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002809:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002816:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002822:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167022.002826:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002834:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002845:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:2.0:1762167022.002848:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167022.002890:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002900:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c94b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002915:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002927:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002932:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002937:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167022.002940:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002946:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002953:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee342c23b00) 00010000:00010000:2.0:1762167022.002956:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167022.002959:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002964:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c952 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002978:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002984:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002990:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.002994:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167022.002996:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.003008:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.003016:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:2.0:1762167022.003018:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167022.003021:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.003026:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c959 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167022.003102:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58123:x1847765452066944:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 671us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167022.003110:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20171 00000100:00100000:1.0:1762167022.029334:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167022.029543:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452067200 00000100:00100000:2.0:1762167022.029553:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452067200 00000100:00100000:2.0:1762167022.029617:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20172 00000100:00100000:2.0:1762167022.029627:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58129:x1847765452067200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167022.029647:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167022.029666:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb451c expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167022.029750:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.029799:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.029810:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.029842:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.029849:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.029854:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.029991:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c975 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.029999:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c975 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030006:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c975 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167022.030016:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:2.0:1762167022.030108:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030115:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030121:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030138:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167022.030142:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030148:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030165:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:2.0:1762167022.030169:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167022.030173:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030179:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030192:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030198:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030203:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030207:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167022.030210:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030216:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030222:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee342c23b00) 00010000:00010000:2.0:1762167022.030224:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167022.030227:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030232:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c96e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.030268:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb451c expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167022.030299:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c975 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb451c expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167022.030307:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:2.0:1762167022.030310:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167022.030312:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167022.030366:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58129:x1847765452067200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 736us (1037us total) trans 8589953251 rc 0/0 00000100:00100000:2.0:1762167022.030374:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20172 00000100:00100000:0.0:1762167022.070210:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167022.070459:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452067456 00000100:00100000:2.0:1762167022.070468:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452067456 00000100:00100000:2.0:1762167022.070527:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7424 00000100:00100000:2.0:1762167022.070537:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fe8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58129:x1847765452067456:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167022.070821:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fe8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58129:x1847765452067456:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 285us (619us total) trans 8589953252 rc 0/0 00000100:00100000:2.0:1762167022.070830:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7424 00000100:00100000:1.0:1762167022.083293:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167022.083392:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452067712 00000100:00100000:2.0:1762167022.083403:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452067712 00000100:00100000:2.0:1762167022.083457:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20173 00000100:00100000:2.0:1762167022.083478:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58132:x1847765452067712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167022.083504:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167022.083524:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c983 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4523 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167022.083620:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c98a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.083645:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c98a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167022.083656:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c98a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167022.083674:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:2.0:1762167022.083830:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c983 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4523 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167022.083849:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c98a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4523 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167022.083858:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:2.0:1762167022.083861:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167022.083864:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167022.083930:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:58132:x1847765452067712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 464us (658us total) trans 8589953253 rc 0/0 00000100:00100000:2.0:1762167022.083938:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20173 00000100:00100000:3.0:1762167022.692269:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167022.692337:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167022.692387:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167022.692422:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452067968 00000100:00100000:3.0:1762167022.692432:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167022.692433:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452067968 00000100:00100000:0.0:1762167022.692449:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452067840 00000100:00100000:0.0:1762167022.692455:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452067840 00000100:00100000:3.0:1762167022.692462:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452068096 00000100:00100000:3.0:1762167022.692466:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452068096 00000100:00100000:3.0:1762167022.692493:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452068224 00000100:00100000:3.0:1762167022.692496:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452068224 00000100:00100000:0.0:1762167022.692498:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 149 00000100:00100000:2.0:1762167022.692501:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 120 00000100:00100000:0.0:1762167022.692510:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765452067840:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762167022.692517:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765452067968:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762167022.692518:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 248 00000100:00100000:3.0:1762167022.692530:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452068096:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762167022.692583:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765452067840:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167022.692591:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 149 00000100:00100000:1.0:1762167022.692616:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 249 00000100:00100000:1.0:1762167022.692629:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765452068224:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762167022.692656:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452068096:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 127us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167022.692665:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765452067968:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 152us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167022.692669:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 248 00000100:00100000:2.0:1762167022.692679:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 120 00000100:00100000:1.0:1762167022.692683:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765452068224:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 55us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167022.692694:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 249 00000100:00100000:3.0:1762167022.761325:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765454565888:0@lo:400:kworker.0 00000100:00100000:0.0:1762167022.761404:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765454566272:0@lo:400:kworker.0 00000100:00100000:3.0:1762167022.761407:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167022.761481:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454566400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762167022.761491:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167022.761539:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765454566784:0@lo:400:kworker.0 00000100:00100000:3.0:1762167022.761546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167022.761592:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454566016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762167022.761607:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167022.761611:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454565888 00000100:00100000:3.0:1762167022.761622:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454565888 00000100:00100000:2.0:1762167022.761665:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167022.761672:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1847765454566144:0@lo:400:kworker.0 00000100:00100000:3.0:1762167022.761685:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1762167022.761701:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454566528:0@lo:400:kworker.0 00000100:00100000:3.0:1762167022.761710:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3296:x1847765454565888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762167022.761802:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167022.761803:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167022.761820:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3296:x1847765454565888:12345-0@lo:400:kworker.0 Request processed in 115us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167022.761831:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1762167022.761847:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454566656:0@lo:400:kworker.0 00000100:00100000:2.0:1762167022.761872:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454566272 00000100:00100000:2.0:1762167022.761879:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454566272 00000100:00100000:0.0:1762167022.761900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167022.761914:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f1807908-b95d-4027-b65a-753b7d69e554:3296:1847765454565888:0@lo:400:kworker.0 00000100:00100000:2.0:1762167022.761931:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454566784 00000100:00100000:2.0:1762167022.761937:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454566784 00000100:00100000:0.0:1762167022.761972:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454566400 00000100:00100000:0.0:1762167022.761981:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454566400 00000100:00100000:2.0:1762167022.761985:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454566144 00000100:00100000:3.0:1762167022.761989:0:34176:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454566016 00000100:00100000:2.0:1762167022.761992:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454566144 00000100:00100000:3.0:1762167022.761994:0:34176:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454566016 00000100:00100000:2.0:1762167022.762059:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1762167022.762066:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1762167022.762073:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765454566272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762167022.762079:0:34176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1762167022.762086:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+26:3296:x1847765454566400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762167022.762097:0:34176:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454566016:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762167022.762129:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765454566272:12345-0@lo:400:kworker.0 Request processed in 56us (638us total) trans 0 rc 0/0 00002000:00000024:3.0:1762167022.762131:0:34176:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 347930624 pending 0 free 3855613952 avail 3853516800 00002000:00000024:0.0:1762167022.762133:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 228524032 pending 1703936 free 3855613952 avail 3853516800 00000100:00100000:2.0:1762167022.762154:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1762167022.762179:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1762167022.762190:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765454566784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762167022.762197:0:34176:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454566016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167022.762225:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+26:3296:x1847765454566400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167022.762237:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1762167022.762245:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765454566784:12345-0@lo:400:kworker.0 Request processed in 57us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167022.762256:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1762167022.762290:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1762167022.762301:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1847765454566144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762167022.762329:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454566528 00000100:00100000:0.0:1762167022.762337:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454566528 00000100:00100000:2.0:1762167022.762348:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1847765454566144:12345-0@lo:400:kworker.0 Request processed in 50us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167022.762358:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1762167022.762386:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454566656 00000100:00100000:0.0:1762167022.762392:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454566656 00000100:00100000:2.0:1762167022.762401:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1762167022.762415:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3293:x1847765454566528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762167022.762431:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1762167022.762448:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454566656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762167022.762463:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3293:x1847765454566528:12345-0@lo:400:kworker.0 Request processed in 52us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167022.762471:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:2.0:1762167022.762497:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762167022.762509:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454566656:12345-0@lo:400:kworker.0 Request processed in 65us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167022.762523:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1762167022.762564:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454566016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762167022.762586:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454566528:0@lo:400:kworker.0 00000100:00100000:2.0:1762167022.762654:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1847765454566144:0@lo:400:kworker.0 00000100:00100000:2.0:1762167022.762678:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454566656:0@lo:400:kworker.0 00000100:00100000:2.0:1762167022.762727:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765454566272:0@lo:400:kworker.0 00000100:00100000:2.0:1762167022.762746:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765454566784:0@lo:400:kworker.0 00000100:00100000:2.0:1762167022.762976:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454566400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762167022.764414:0:34176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000001:00080000:1.0:1762167022.794892:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876166 is committed 00000001:00080000:1.0:1762167022.794905:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876163 is committed 00000001:00100000:1.0:1762167022.794918:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b4e369e7-58c9-4605-91cc-bb6f1ca9b31b 00000020:00000080:1.0:1762167022.794922:0:23749:0:(genops.c:904:class_export_put()) final put ffff9ee24530c800/b4e369e7-58c9-4605-91cc-bb6f1ca9b31b 00000020:00000080:0.0:1762167022.794966:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee24530c800/b4e369e7-58c9-4605-91cc-bb6f1ca9b31b for lustre-OST0001 00000001:00100000:1.0:1762167022.794967:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12bd460f-a83f-41fe-92df-dfba4795e03a 00000020:00000080:1.0:1762167022.794973:0:23749:0:(genops.c:904:class_export_put()) final put ffff9ee37f2a6800/12bd460f-a83f-41fe-92df-dfba4795e03a 00000020:00000080:0.0:1762167022.795026:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee37f2a6800/12bd460f-a83f-41fe-92df-dfba4795e03a for lustre-OST0001 00000001:00080000:1.0:1762167022.795028:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876167 is committed 00000020:00000080:0.0:1762167022.795053:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee245308000 for lustre-OST0001 00000020:00000080:0.0:1762167022.795059:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee24530a000 for lustre-OST0001 00000001:00080000:1.0:1762167022.798655:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843746 is committed 00000001:00080000:1.0:1762167022.798679:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843748 is committed 00000001:00080000:1.0:1762167022.798685:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843743 is committed 00000001:00100000:1.0:1762167022.798695:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b4e369e7-58c9-4605-91cc-bb6f1ca9b31b 00000020:00000080:1.0:1762167022.798700:0:22362:0:(genops.c:904:class_export_put()) final put ffff9ee2448d8000/b4e369e7-58c9-4605-91cc-bb6f1ca9b31b 00000020:00000080:3.0:1762167022.798719:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee2448d8000/b4e369e7-58c9-4605-91cc-bb6f1ca9b31b for lustre-OST0000 00000001:00100000:1.0:1762167022.798721:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12bd460f-a83f-41fe-92df-dfba4795e03a 00000020:00000080:1.0:1762167022.798724:0:22362:0:(genops.c:904:class_export_put()) final put ffff9ee2448da000/12bd460f-a83f-41fe-92df-dfba4795e03a 00000001:00080000:1.0:1762167022.798751:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843744 is committed 00000020:00000080:3.0:1762167022.798753:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff9ee2448da000/12bd460f-a83f-41fe-92df-dfba4795e03a for lustre-OST0000 00000020:00000080:3.0:1762167022.798964:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee34a53c000 for lustre-OST0000 00000020:00000080:3.0:1762167022.798970:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9ee2448df000 for lustre-OST0000 00010000:00010000:1.0:1762167023.015932:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167024.039901:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167024.112102:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167024.112317:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452068480 00000100:00100000:1.0:1762167024.112332:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452068480 00000100:00100000:1.0:1762167024.112495:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7425 00000100:00100000:1.0:1762167024.112510:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:58555:x1847765452068480:12345-192.168.203.35@tcp:35:rm.0 00000100:00080000:2.0:1762167024.112622:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762167024.112803:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:58555:x1847765452068480:12345-192.168.203.35@tcp:35:rm.0 Request processed in 297us (714us total) trans 8589953254 rc 0/0 00000100:00100000:1.0:1762167024.112812:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7425 00000100:00100000:0.0:1762167024.114365:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167024.115190:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452068736 00000100:00100000:1.0:1762167024.115199:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452068736 00000100:00100000:1.0:1762167024.115279:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20174 00000100:00100000:1.0:1762167024.115289:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:58555:x1847765452068736:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:1.0:1762167024.115341:0:31205:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1762167024.115404:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c975 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb451c expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167024.115427:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c98a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4523 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167024.115439:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c92f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb450e expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167024.115450:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:1.0:1762167024.115465:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c62d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43e1 expref: 894 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167024.115473:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:1.0:1762167024.115479:0:31205:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167024.115502:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.115514:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.115524:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.115552:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.115567:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.115575:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.115699:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.115708:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.115716:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000040:00080000:1.0:1762167024.116382:0:31205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5698, 64 off461392 00000004:00080000:1.0:1762167024.116393:0:31205:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 644908630054ns, next at 645908627261ns, rc = 0 00000040:00080000:1.0:1762167024.116454:0:31205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5706, 64 off462448 00000004:00080000:1.0:1762167024.116463:0:31205:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 644908700131ns, next at 645908698203ns, rc = 0 00000040:00080000:1.0:1762167024.116486:0:31205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5707, 64 off462512 00000040:00080000:1.0:1762167024.116507:0:31205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5699, 64 off461456 00000040:00080000:1.0:1762167024.116531:0:31205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5708, 64 off462576 00000040:00080000:1.0:1762167024.116548:0:31205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5700, 64 off461520 00000040:00080000:1.0:1762167024.116569:0:31205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5709, 64 off462640 00000040:00080000:1.0:1762167024.116592:0:31205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5701, 64 off461584 00010000:00010000:1.0:1762167024.116676:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116685:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116693:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116707:0:31205:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116712:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116718:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116747:0:31205:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167024.116792:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116798:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116804:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116809:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167024.116813:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116820:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116832:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167024.116835:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762167024.116839:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.116844:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c9a6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.116994:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167024.117001:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.117007:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167024.117011:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.117016:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.117025:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167024.117027:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762167024.117043:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 1/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.117049:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c9ad lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.117156:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.117163:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.117168:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.117172:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167024.117175:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167024.117179:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.117188:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167024.117189:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0700) 00010000:00010000:2.0:1762167024.117191:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167024.117192:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167024.117195:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.117196:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167024.117201:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c998 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000004:00010000:1.0:1762167024.117213:0:31205:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cc6cad08 reply state 0000000094cc61d4 transno 8589953255 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:1.0:1762167024.117221:0:31205:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167024.117338:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58555:x1847765452068736:12345-192.168.203.35@tcp:36:rm.0 Request processed in 2048us (2978us total) trans 8589953255 rc 0/0 00000100:00100000:1.0:1762167024.117347:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20174 00010000:00010000:2.0:1762167024.120324:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.120339:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.120346:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.120352:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167024.120356:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.120363:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.120380:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee2429d0b00) 00000100:00100000:3.0:1762167024.120385:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167024.120386:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167024.120392:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167024.120399:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c99f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000100:00100000:3.0:1762167024.120421:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452068864 00000100:00100000:3.0:1762167024.120429:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452068864 00000100:00100000:3.0:1762167024.120478:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20175 00000100:00100000:3.0:1762167024.120490:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58555:x1847765452068864:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762167024.120511:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167024.120530:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb452a expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167024.120606:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c9bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.120619:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.120629:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167024.120690:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:3.0:1762167024.120694:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167024.120725:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.120750:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb452a expref: 896 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167024.121182:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c9bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb452a expref: 895 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167024.121192:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:3.0:1762167024.121195:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762167024.121198:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167024.121353:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58555:x1847765452068864:12345-192.168.203.35@tcp:101:rm.0 Request processed in 865us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167024.121360:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20175 00000100:00100000:2.0:1762167024.124546:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167024.124613:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452068992 00000100:00100000:3.0:1762167024.124622:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452068992 00000100:00100000:3.0:1762167024.124678:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20176 00000100:00100000:3.0:1762167024.124688:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58555:x1847765452068992:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:3.0:1762167024.124714:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167024.124731:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c9c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4531 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167024.124869:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.124883:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.124893:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.124923:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.124929:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.124935:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.124991:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.124997:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125002:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125007:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167024.125010:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125026:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125036:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:3.0:1762167024.125039:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167024.125042:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125047:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c9c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125057:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125062:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125067:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125071:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167024.125074:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125079:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125085:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff9ee345a77d00) 00010000:00010000:3.0:1762167024.125087:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167024.125089:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125095:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c9d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167024.125134:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c9c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4531 expref: 896 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167024.125144:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:3.0:1762167024.125147:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167024.125150:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c9c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4531 expref: 896 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167024.125159:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167024.125220:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58555:x1847765452068992:12345-192.168.203.35@tcp:101:rm.0 Request processed in 534us (684us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167024.125228:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20176 00000100:00100000:3.0:1762167024.127255:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167024.127394:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452069120 00000100:00100000:0.0:1762167024.127403:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452069120 00000100:00100000:0.0:1762167024.127457:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20177 00000100:00100000:0.0:1762167024.127481:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58555:x1847765452069120:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:0.0:1762167024.127498:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167024.127516:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0c9d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4538 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167024.127574:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127587:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127598:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127638:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127647:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127655:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127721:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127729:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127736:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127751:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167024.127755:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127786:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127800:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:0.0:1762167024.127803:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167024.127808:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127815:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c9de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127829:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127835:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127848:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127854:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167024.127858:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127865:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127945:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff9ee2477ef100) 00010000:00010000:0.0:1762167024.127949:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167024.127959:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.127966:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c9e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167024.128019:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0c9d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4538 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167024.128032:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:0.0:1762167024.128035:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167024.128040:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0c9d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4538 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167024.128053:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f78aa00, rc 0) 00000100:00100000:0.0:1762167024.128133:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58555:x1847765452069120:12345-192.168.203.35@tcp:101:rm.0 Request processed in 665us (883us total) trans 0 rc 301/301 00000100:00100000:0.0:1762167024.128142:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20177 00010000:00010000:0.0:1762167025.064272:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167026.087912:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167027.112822:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762167027.383730:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953255 is committed 00000004:00080000:1.0:1762167027.383754:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3808 committed 00000004:00080000:1.0:1762167027.383798:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3795 committed 00000100:00100000:0.0:1762167027.383991:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454567040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167027.384005:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454566912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762167027.384089:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167027.384131:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454566912 00000100:00100000:0.0:1762167027.384140:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454566912 00000100:00100000:3.0:1762167027.384152:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167027.384184:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454567040 00000100:00100000:2.0:1762167027.384189:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454567040 00000100:00100000:0.0:1762167027.384203:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17634 00000100:00100000:0.0:1762167027.384211:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765454566912:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1762167027.384230:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1762167027.384234:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1762167027.384236:0:12402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2083 count 1 00010000:00010000:0.0:1762167027.384272:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167027.384289:0:34501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17635 00010000:00010000:0.0:1762167027.384292:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167027.384296:0:34501:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765454567040:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762167027.384306:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1762167027.384308:0:34501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2079 count 1 00010000:00010000:0.0:1762167027.384308:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167027.384312:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.384321:0:34501:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.384331:0:34501:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.384335:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.384338:0:34501:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167027.384340:0:34501:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167027.384342:0:34501:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.384348:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 19 pid: 26444 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1762167027.384356:0:34501:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 13 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167027.384359:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454567168:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167027.384365:0:34501:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 13 pid: 26444 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1762167027.384374:0:34501:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:34501:1847765454567296:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167027.384422:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167027.384437:0:34501:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24463ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.386023:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454567168:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.386046:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167027.386142:0:34501:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:34501:1847765454567296:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167027.386158:0:34501:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167027.386183:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167027.386222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.386265:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452069376 00000100:00100000:0.0:1762167027.386272:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452069376 00000100:00100000:1.0:1762167027.386290:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452069248 00000100:00100000:1.0:1762167027.386296:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452069248 00010000:00010000:1.0:1762167027.386324:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 14 pid: 26444 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.386326:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 20 pid: 26444 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1762167027.386375:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7718 00000100:00100000:0.0:1762167027.386383:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7719 00000100:00100000:1.0:1762167027.386389:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765452069248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1762167027.386396:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762167027.386398:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765452069376:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1762167027.386401:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1762167027.386404:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167027.386411:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 14 pid: 26444 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.386413:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167027.386424:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 14 pid: 26444 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.386426:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 20 pid: 26444 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.386448:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 20 pid: 26444 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1762167027.386461:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0c90c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f2 expref: 14 pid: 26444 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.386472:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0c913 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44f9 expref: 20 pid: 26444 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1762167027.386476:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167027.386479:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167027.386485:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.386487:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.386491:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.386496:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167027.386500:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.386511:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167027.386552:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.386559:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167027.386579:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.386590:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.386611:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.386619:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.386640:0:12402:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762167027.386647:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452069376:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 251us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.386655:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7719 00010000:00010000:2.0:1762167027.386738:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167027.386745:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.386752:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167027.386756:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.386789:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.386802:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.386809:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c9ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.386829:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167027.386831:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167027.386833:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167027.386844:0:34501:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.386858:0:34501:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.386877:0:34501:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.386885:0:34501:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.386913:0:34501:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762167027.386996:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2360:x1847765452069248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 215us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167027.387004:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7718 00010000:00010000:0.0:1762167027.387042:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167027.387049:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.387058:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167027.387062:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.387083:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.387097:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.387104:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0c9f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.387125:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167027.387128:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167027.387131:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167027.387370:0:34501:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765454567040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3074us (3220us total) trans 21474843749 rc 0/0 00000100:00100000:2.0:1762167027.387377:0:34501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17635 00000100:00100000:3.0:1762167027.387409:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765454566912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3198us (3318us total) trans 17179876168 rc 0/0 00000100:00100000:3.0:1762167027.387418:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17634 00000100:00100000:0.0:1762167027.387450:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843748 gen 2 00000004:00080000:0.0:1762167027.387456:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e62b480, transno 21474843724 00000100:00100000:1.0:1762167027.387467:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876167 gen 2 00000004:00080000:1.0:1762167027.387470:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c1880, transno 17179876142 00000004:00080000:0.0:1762167027.387476:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e629880, transno 21474843725 00000004:00080000:0.0:1762167027.387479:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e629500, transno 21474843726 00000004:00080000:0.0:1762167027.387481:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e629f80, transno 21474843727 00000004:00080000:0.0:1762167027.387484:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e62aa00, transno 21474843728 00000004:00080000:1.0:1762167027.387486:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c0700, transno 17179876143 00000004:00080000:0.0:1762167027.387487:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e629180, transno 21474843729 00000004:00080000:1.0:1762167027.387488:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359065f80, transno 17179876144 00000004:00080000:0.0:1762167027.387489:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550e680, transno 21474843730 00000004:00080000:1.0:1762167027.387490:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24732d500, transno 17179876145 00000004:00080000:0.0:1762167027.387492:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e628e00, transno 21474843731 00000004:00080000:1.0:1762167027.387493:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc5a680, transno 17179876146 00000004:00080000:0.0:1762167027.387494:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e62b800, transno 21474843732 00000004:00080000:1.0:1762167027.387495:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c0380, transno 17179876147 00000004:00080000:0.0:1762167027.387496:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550f800, transno 21474843733 00000004:00080000:1.0:1762167027.387497:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c3b80, transno 17179876148 00000004:00080000:1.0:1762167027.387499:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359065500, transno 17179876149 00000004:00080000:0.0:1762167027.387499:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550c000, transno 21474843734 00000004:00080000:0.0:1762167027.387501:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550ea00, transno 21474843735 00000004:00080000:1.0:1762167027.387502:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c3800, transno 17179876150 00000004:00080000:0.0:1762167027.387503:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550d500, transno 21474843736 00000004:00080000:1.0:1762167027.387504:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345730700, transno 17179876151 00000004:00080000:0.0:1762167027.387505:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b3480, transno 21474843737 00000004:00080000:1.0:1762167027.387506:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb10000, transno 17179876152 00000004:00080000:1.0:1762167027.387508:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb10700, transno 17179876153 00000004:00080000:1.0:1762167027.387510:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24732c380, transno 17179876154 00000004:00080000:1.0:1762167027.387513:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240a680, transno 17179876156 00000004:00080000:0.0:1762167027.387514:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b3800, transno 21474843738 00000004:00080000:1.0:1762167027.387515:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242409500, transno 17179876157 00000004:00080000:0.0:1762167027.387516:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b1500, transno 21474843739 00000004:00080000:1.0:1762167027.387517:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240ad80, transno 17179876158 00000004:00080000:1.0:1762167027.387519:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240bb80, transno 17179876159 00000004:00080000:0.0:1762167027.387519:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b1c00, transno 21474843740 00000004:00080000:1.0:1762167027.387522:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242409c00, transno 17179876164 00000004:00080000:0.0:1762167027.387522:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aaa300, transno 21474843745 00000004:00080000:1.0:1762167027.387524:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240b100, transno 17179876165 00000004:00080000:0.0:1762167027.387524:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aaaa00, transno 21474843746 00000004:00080000:1.0:1762167027.387526:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242408700, transno 17179876166 00000004:00080000:0.0:1762167027.387526:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aaa680, transno 21474843747 00000004:00080000:0.0:1762167027.387528:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aa8380, transno 21474843748 00000004:00080000:1.0:1762167027.387530:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240aa00, transno 17179876167 00000100:00100000:1.0:1762167027.387535:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37ff80e00 x1847765454566912/t17179876168(17179876168) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167043 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762167027.387535:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee347b04e00 x1847765454567040/t21474843749(21474843749) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167043 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762167027.387545:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b04e00/2, rc 0, transno 21474843749 00000004:00080000:1.0:1762167027.387546:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff80e00/2, rc 0, transno 17179876168 00000100:00100000:0.0:1762167027.387550:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454567040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762167027.387551:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454566912:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1762167027.387823:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 3 changes, 1 in progress, 0 in flight, 21 done 00000004:00080000:2.0:1762167027.387878:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 3 changes, 1 in progress, 0 in flight, 21 done 00000001:02000400:2.0:1762167027.591416:0:35588:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 200b: racing IO, mirror extend and resync ========================================================== 05:50:27 (1762167027) 00000100:00100000:3.0:1762167027.642644:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.642710:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452069504 00000100:00100000:0.0:1762167027.642720:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452069504 00000100:00080000:2.0:1762167027.642746:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762167027.642813:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20178 00000100:00100000:3.0:1762167027.642826:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:58836:x1847765452069504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167027.642849:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167027.642869:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c9fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb453f expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.642931:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.642942:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.642952:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.642999:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643004:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643008:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643078:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643083:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643087:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643090:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167027.643093:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643097:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643105:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:3.0:1762167027.643107:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167027.643110:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643115:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ca01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643121:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643135:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643138:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643141:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167027.643148:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643152:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643157:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee345a77d00) 00010000:00010000:3.0:1762167027.643159:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167027.643161:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643164:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ca08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.643191:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c9fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb453f expref: 890 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.643197:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:3.0:1762167027.643199:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167027.643201:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c9fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb453f expref: 890 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.643207:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167027.643270:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:58836:x1847765452069504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 449us (639us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167027.643275:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20178 00000100:00100000:1.0:1762167027.646094:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167027.646167:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452069760 00000100:00100000:3.0:1762167027.646178:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452069760 00000100:00100000:3.0:1762167027.646258:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20179 00000100:00100000:3.0:1762167027.646270:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:58836:x1847765452069760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167027.646300:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167027.646303:0:31205:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762167027.646330:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c9bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb452a expref: 889 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.646350:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:3.0:1762167027.646365:0:31205:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167027.646380:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0ca0f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4546 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.646515:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.646528:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.646552:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.646567:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.646575:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.646583:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.647211:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.647222:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.647237:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167027.647260:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:3.0:1762167027.647286:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.647292:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.647299:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.647305:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167027.647309:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.647316:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.647326:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77f00) 00010000:00010000:3.0:1762167027.647329:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167027.647333:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167027.647339:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ca16 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000004:00010000:3.0:1762167027.647350:0:31205:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005b81cf99 reply state 00000000da71762d transno 8589953256 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:3.0:1762167027.647357:0:31205:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762167027.647381:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0ca0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4546 expref: 891 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.647410:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4546 expref: 890 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.647419:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:3.0:1762167027.647422:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167027.647425:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167027.647492:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58836:x1847765452069760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1226us (1408us total) trans 8589953256 rc 0/0 00000100:00100000:3.0:1762167027.647501:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20179 00010000:00010000:2.0:1762167027.649200:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167027.649215:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167027.649222:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167027.649227:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167027.649231:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167027.649250:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167027.649280:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee345a77400) 00010000:00010000:2.0:1762167027.649283:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167027.649287:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:2.0:1762167027.649293:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0ca1d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000100:00100000:3.0:1762167027.651056:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.651101:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452070016 00000100:00100000:0.0:1762167027.651112:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452070016 00000100:00100000:0.0:1762167027.651163:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20180 00000100:00100000:0.0:1762167027.651172:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:58836:x1847765452070016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.651192:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.651209:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0ca32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb454d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.651305:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.651319:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4546 expref: 891 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.651327:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.651371:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4546 expref: 891 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.651507:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4546 expref: 891 pid: 31205 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.651522:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454567424:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167027.651895:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167027.653419:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167027.653468:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452070144 00000100:00100000:1.0:1762167027.653477:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452070144 00010000:00010000:1.0:1762167027.653512:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4546 expref: 892 pid: 31205 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1762167027.653557:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7720 00000100:00100000:0.0:1762167027.653564:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454567424:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167027.653571:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:2360:x1847765452070144:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167027.653587:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167027.653589:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167027.653596:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4546 expref: 892 pid: 31205 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1762167027.653611:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4546 expref: 892 pid: 31205 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1762167027.653634:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ca24 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4546 expref: 892 pid: 31205 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1762167027.653649:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:1.0:1762167027.653653:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167027.653662:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167027.653670:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167027.653704:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.653721:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.653729:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.653745:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00000100:00100000:1.0:1762167027.653751:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:2360:x1847765452070144:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 183us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167027.653759:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7720 00000004:00080000:0.0:1762167027.654096:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x826:0x0], index 1: 0 00010000:00010000:0.0:1762167027.654257:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.654265:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.654272:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.654277:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.654287:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.654294:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.654305:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:0.0:1762167027.654308:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167027.654311:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.654317:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca39 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.654386:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0ca32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb454d expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.654396:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477efc00) 00010000:00010000:0.0:1762167027.654399:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762167027.654403:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0ca32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb454d expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.654415:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d200, rc 0) 00000100:00100000:0.0:1762167027.654455:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:58836:x1847765452070016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3284us (3405us total) trans 8589953257 rc 301/301 00000100:00100000:0.0:1762167027.654461:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20180 00000100:00100000:3.0:1762167027.656622:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167027.656704:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452070400 00000100:00100000:1.0:1762167027.656713:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452070400 00000100:00100000:1.0:1762167027.656800:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7426 00000100:00100000:1.0:1762167027.656817:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:58836:x1847765452070400:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167027.657178:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58836:x1847765452070400:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 367us (563us total) trans 8589953258 rc 0/0 00000100:00100000:1.0:1762167027.657186:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7426 00000100:00100000:3.0:1762167027.658689:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167027.658872:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452070656 00000100:00100000:1.0:1762167027.658881:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452070656 00000100:00100000:1.0:1762167027.658933:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7427 00000100:00100000:1.0:1762167027.658944:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:58836:x1847765452070656:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167027.659151:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58836:x1847765452070656:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 209us (467us total) trans 8589953259 rc 0/0 00000100:00100000:1.0:1762167027.659159:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7427 00000100:00100000:2.0:1762167027.670375:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.670447:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452070784 00000100:00100000:0.0:1762167027.670457:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452070784 00000100:00100000:0.0:1762167027.670519:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20181 00000100:00100000:0.0:1762167027.670529:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58842:x1847765452070784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.670561:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.670582:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0ca47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4554 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.670645:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.670659:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.670669:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.670846:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:0.0:1762167027.670851:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167027.670874:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.670898:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0ca47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4554 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.670914:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4554 expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.670923:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477efc00) 00010000:00010000:0.0:1762167027.670927:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762167027.670942:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ce00, rc 0) 00000100:00100000:0.0:1762167027.671005:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58842:x1847765452070784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 477us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.671013:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20181 00000100:00100000:3.0:1762167027.672998:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.673146:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452070912 00000100:00100000:0.0:1762167027.673162:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452070912 00000100:00100000:0.0:1762167027.673215:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20182 00000100:00100000:0.0:1762167027.673226:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58842:x1847765452070912:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.673257:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.673277:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ca55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb455b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.673341:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673356:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673379:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673433:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673442:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673449:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673515:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673523:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673530:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673547:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.673552:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673560:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673572:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477efc00) 00010000:00010000:0.0:1762167027.673575:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.673580:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673586:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0ca5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673597:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673609:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673624:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673638:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.673641:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673647:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673657:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a1902b1 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167027.673660:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.673671:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673677:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0ca63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.673711:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ca55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb455b expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.673722:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477efc00) 00010000:00010000:0.0:1762167027.673725:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.673728:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ca55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb455b expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.673738:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167027.673818:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58842:x1847765452070912:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 594us (829us total) trans 0 rc 301/301 00000100:00100000:0.0:1762167027.673826:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20182 00000100:00100000:2.0:1762167027.676607:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.676687:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452071168 00000100:00100000:0.0:1762167027.676697:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452071168 00000100:00100000:0.0:1762167027.676753:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20183 00000100:00100000:0.0:1762167027.676800:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58842:x1847765452071168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.676820:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.676824:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762167027.676850:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0ca4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4554 expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.676870:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477efc00) 00010000:00010000:0.0:1762167027.676881:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.676916:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ca6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4562 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.677049:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677061:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677071:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677087:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677094:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677102:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677689:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x653:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677701:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677711:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.677722:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x653:0x0]: returning size 0 00010000:00010000:0.0:1762167027.677753:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677804:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677824:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677833:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.677839:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677848:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677860:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167027.677864:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.677869:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.677876:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca71 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762167027.677893:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c92bca74 reply state 000000009f9b1934 transno 8589953260 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167027.677902:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762167027.677936:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ca6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4562 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.677961:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4562 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.677969:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167027.677973:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167027.677976:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c200, rc 0) 00000100:00100000:0.0:1762167027.678078:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58842:x1847765452071168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1313us (1476us total) trans 8589953260 rc 0/0 00000100:00100000:0.0:1762167027.678088:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20183 00010000:00010000:0.0:1762167027.679369:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.679382:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.679388:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.679392:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.679396:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.679402:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.679424:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a1902b1 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167027.679428:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.679431:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.679437:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ca78 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167027.682190:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.682302:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452071424 00000100:00100000:0.0:1762167027.682313:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452071424 00000100:00100000:0.0:1762167027.682381:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20184 00000100:00100000:0.0:1762167027.682391:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58842:x1847765452071424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.682421:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.682453:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ca8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4569 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.682547:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.682562:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4562 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.682571:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.682604:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4562 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.682617:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4562 expref: 895 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.682631:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454567552:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167027.682724:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.684332:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454567552:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.684356:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167027.684942:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167027.685148:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452071552 00000100:00100000:3.0:1762167027.685156:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452071552 00010000:00010000:3.0:1762167027.685187:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4562 expref: 896 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1762167027.685231:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7721 00000100:00100000:3.0:1762167027.685254:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765452071552:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167027.685268:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167027.685274:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4562 expref: 896 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1762167027.685287:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4562 expref: 896 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1762167027.685320:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0ca7f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4562 expref: 896 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1762167027.685336:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167027.685340:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.685349:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.685355:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.685384:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.685402:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.685411:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.685426:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x653:0x0]: returning size 0 00000100:00100000:3.0:1762167027.685445:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765452071552:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 192us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167027.685454:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7721 00000004:00080000:0.0:1762167027.685619:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x823:0x0], index 0: 0 00010000:00010000:0.0:1762167027.685817:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.685825:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.685831:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.685836:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.685839:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.685846:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.685855:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167027.685858:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167027.685862:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.685866:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0ca94 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.685917:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ca8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4569 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.685927:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167027.685930:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762167027.685942:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ca8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4569 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.685967:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c600, rc 0) 00000100:00100000:0.0:1762167027.686002:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58842:x1847765452071424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3613us (3821us total) trans 8589953261 rc 301/301 00000100:00100000:0.0:1762167027.686009:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20184 00000100:00100000:2.0:1762167027.687285:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167027.687371:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452071808 00000100:00100000:1.0:1762167027.687378:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452071808 00000100:00100000:1.0:1762167027.687426:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7428 00000100:00100000:1.0:1762167027.687435:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58842:x1847765452071808:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167027.687753:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58842:x1847765452071808:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 317us (470us total) trans 8589953262 rc 0/0 00000100:00100000:1.0:1762167027.687801:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7428 00000100:00100000:3.0:1762167027.688974:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.689033:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452072064 00000100:00100000:0.0:1762167027.689038:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452072064 00000100:00100000:0.0:1762167027.689066:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7429 00000100:00100000:0.0:1762167027.689072:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:58842:x1847765452072064:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167027.689216:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:58842:x1847765452072064:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 142us (247us total) trans 8589953263 rc 0/0 00000100:00100000:0.0:1762167027.689224:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7429 00000100:00100000:2.0:1762167027.697377:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.697472:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452072192 00000100:00100000:0.0:1762167027.697482:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452072192 00000100:00100000:0.0:1762167027.697539:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20185 00000100:00100000:0.0:1762167027.697549:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:58843:x1847765452072192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.697574:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.697598:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0caa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4570 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.697667:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0caa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.697680:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.697691:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.697750:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:0.0:1762167027.697753:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167027.697793:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.697815:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0caa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4570 expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.697832:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4570 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.697840:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167027.697843:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762167027.697846:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167027.697936:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:58843:x1847765452072192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 388us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.697945:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20185 00000100:00100000:2.0:1762167027.699983:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.700032:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452072320 00000100:00100000:0.0:1762167027.700042:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452072320 00000100:00100000:0.0:1762167027.700098:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20186 00000100:00100000:0.0:1762167027.700109:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:58843:x1847765452072320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.700127:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.700144:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4577 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.700200:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700224:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700235:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700263:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700269:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700276:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700353:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700361:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700372:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700378:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.700382:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700388:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700400:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167027.700403:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.700414:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700420:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700433:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700439:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700444:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700449:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.700452:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700457:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700465:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbdcc6f6 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167027.700468:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.700471:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700476:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cabe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.700512:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cab0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4577 expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.700521:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167027.700529:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.700533:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4577 expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.700543:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c400, rc 0) 00000100:00100000:0.0:1762167027.700590:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:58843:x1847765452072320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 484us (616us total) trans 0 rc 301/301 00000100:00100000:0.0:1762167027.700598:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20186 00000100:00100000:3.0:1762167027.702646:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.702746:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452072576 00000100:00100000:0.0:1762167027.702754:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452072576 00000100:00100000:0.0:1762167027.703217:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20187 00000100:00100000:0.0:1762167027.703231:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:58843:x1847765452072576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.703257:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.703261:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762167027.703283:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0caa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4570 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.703300:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167027.703308:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.703321:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cac5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb457e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.703427:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703439:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703448:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703474:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703480:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703487:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703900:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 3/1,0 mode: --/PR res: [0x200000404:0x654:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703910:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703917:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.703926:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x654:0x0]: returning size 0 00010000:00010000:0.0:1762167027.703944:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703950:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703956:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703962:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.703965:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703971:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703985:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167027.703988:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.703992:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.703998:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cacc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762167027.704007:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000089734f7d reply state 00000000b2c14147 transno 8589953264 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167027.704014:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762167027.704035:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cac5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb457e expref: 899 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.704051:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb457e expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.704058:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee2477efc00) 00010000:00010000:0.0:1762167027.704061:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167027.704063:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c000, rc 0) 00000100:00100000:0.0:1762167027.704121:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:58843:x1847765452072576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 895us (1483us total) trans 8589953264 rc 0/0 00000100:00100000:0.0:1762167027.704128:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20187 00010000:00010000:0.0:1762167027.705498:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.705513:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.705535:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.705540:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.705543:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.705550:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.705563:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbdcc6f6 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167027.705566:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.705570:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.705576:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cad3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167027.706068:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.706136:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452072832 00000100:00100000:0.0:1762167027.706145:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452072832 00000100:00100000:0.0:1762167027.706195:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20188 00000100:00100000:0.0:1762167027.706205:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:58843:x1847765452072832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.706225:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.706252:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4585 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.706354:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.706368:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb457e expref: 899 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.706383:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 4/0,1 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.706416:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb457e expref: 899 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.706430:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb457e expref: 899 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.706443:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454567680:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167027.706516:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.708082:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454567680:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.708106:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167027.708217:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167027.708279:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452072960 00000100:00100000:1.0:1762167027.708294:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452072960 00010000:00010000:1.0:1762167027.708341:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb457e expref: 900 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1762167027.708398:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7722 00000100:00100000:1.0:1762167027.708409:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765452072960:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167027.708432:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167027.708439:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb457e expref: 900 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1762167027.708456:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb457e expref: 900 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1762167027.708485:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cada lrc: 0/0,0 mode: --/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb457e expref: 900 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1762167027.708504:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee2477efc00) 00010000:00010000:1.0:1762167027.708509:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167027.708519:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167027.708527:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167027.708562:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.708629:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.708640:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167027.708645:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765452072960:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 234us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167027.708662:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7722 00000004:00200000:0.0:1762167027.708666:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x654:0x0]: returning size 0 00000004:00080000:0.0:1762167027.708886:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x827:0x0], index 1: 0 00010000:00010000:0.0:1762167027.709031:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.709039:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.709045:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.709063:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2431a1e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.709067:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.709075:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.709089:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee2477efc00) 00010000:00010000:0.0:1762167027.709091:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167027.709095:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 2/0,0 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.709101:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0caef lrc: 0/0,0 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.709150:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cae8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4585 expref: 899 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.709161:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167027.709163:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762167027.709167:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4585 expref: 899 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.709180:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c200, rc 0) 00000100:00100000:0.0:1762167027.709234:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:58843:x1847765452072832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3029us (3166us total) trans 8589953265 rc 301/301 00000100:00100000:0.0:1762167027.709255:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20188 00000100:00100000:3.0:1762167027.710612:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.710675:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452073216 00000100:00100000:0.0:1762167027.710684:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452073216 00000100:00100000:0.0:1762167027.710739:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7430 00000100:00100000:0.0:1762167027.710802:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:58843:x1847765452073216:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167027.711105:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:58843:x1847765452073216:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 343us (497us total) trans 8589953266 rc 0/0 00000100:00100000:0.0:1762167027.711113:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7430 00000100:00100000:2.0:1762167027.712455:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.712515:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452073472 00000100:00100000:0.0:1762167027.712521:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452073472 00000100:00100000:0.0:1762167027.712552:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7431 00000100:00100000:0.0:1762167027.712558:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:58843:x1847765452073472:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167027.712713:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:58843:x1847765452073472:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 150us (257us total) trans 8589953267 rc 0/0 00000100:00100000:0.0:1762167027.712720:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7431 00000100:00100000:2.0:1762167027.719692:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.719834:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452073600 00000100:00100000:0.0:1762167027.719843:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452073600 00000100:00100000:0.0:1762167027.719898:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20189 00000100:00100000:0.0:1762167027.719909:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:58844:x1847765452073600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.719935:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.719956:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cafd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb458c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.720024:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cb04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.720037:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cb04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.720048:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cb04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.720124:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:0.0:1762167027.720128:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 34 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167027.720151:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cb04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.720174:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cafd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb458c expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.720191:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cb04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb458c expref: 901 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.720201:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167027.720203:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762167027.720207:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2431a1000, rc 0) 00000100:00100000:0.0:1762167027.720286:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:58844:x1847765452073600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 378us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.720293:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20189 00000100:00100000:3.0:1762167027.722729:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.722886:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452073856 00000100:00100000:0.0:1762167027.722895:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452073856 00000100:00100000:0.0:1762167027.722956:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20190 00000100:00100000:0.0:1762167027.722966:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:58844:x1847765452073856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.722984:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.723003:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4593 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.723067:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723096:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723107:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723121:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723142:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723149:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723290:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cb20 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723299:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cb20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723305:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cb20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.723315:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:0.0:1762167027.723416:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723424:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723431:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723437:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.723448:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723455:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723466:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167027.723469:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.723474:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723480:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723493:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723499:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723504:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723508:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.723511:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723515:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723522:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee2477efc00) 00010000:00010000:0.0:1762167027.723524:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.723526:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723541:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.723579:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4593 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.723592:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cb20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4593 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.723600:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167027.723602:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167027.723604:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c000, rc 0) 00000100:00100000:0.0:1762167027.723663:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:58844:x1847765452073856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 699us (940us total) trans 8589953268 rc 0/0 00000100:00100000:0.0:1762167027.723670:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20190 00000100:00100000:2.0:1762167027.725453:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.725504:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452074112 00000100:00100000:0.0:1762167027.725513:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452074112 00000100:00100000:0.0:1762167027.725561:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20191 00000100:00100000:0.0:1762167027.725570:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:58844:x1847765452074112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.725589:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.725606:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb459a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.725671:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.725683:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.725706:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.725724:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.725747:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.725758:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.725927:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x653:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.725935:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.725942:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.725951:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x653:0x0]: returning size 0 00010000:00010000:0.0:1762167027.726042:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726050:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726055:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726062:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.726066:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726079:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726092:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167027.726095:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.726100:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726106:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726118:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726124:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726130:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726135:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.726137:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726143:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726150:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a1902b1 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167027.726152:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.726155:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726160:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.726206:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb459a expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.726218:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb459a expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.726226:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167027.726228:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167027.726230:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167027.726304:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:58844:x1847765452074112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 735us (861us total) trans 8589953269 rc 0/0 00000100:00100000:0.0:1762167027.726311:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20191 00000100:00100000:2.0:1762167027.729220:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167027.729350:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452074240 00000100:00100000:3.0:1762167027.729358:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452074240 00000100:00100000:3.0:1762167027.729418:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17636 00000100:00100000:3.0:1762167027.729429:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765452074240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167027.729447:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167027.729479:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45a1 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167027.729504:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x826:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762167027.729521:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167027.729524:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167027.729533:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a1 expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167027.729550:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a1 expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167027.729563:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167027.729620:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452074240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 192us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167027.729627:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17636 00000100:00100000:3.0:1762167027.731391:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.731485:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452074368 00000100:00100000:0.0:1762167027.731494:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452074368 00000100:00100000:0.0:1762167027.731547:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17637 00000100:00100000:0.0:1762167027.731558:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765452074368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.731575:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.731594:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45a8 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167027.731618:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x823:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167027.731637:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.731640:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.731647:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a8 expref: 14 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167027.731663:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a8 expref: 14 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167027.731689:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c200, rc 0) 00000100:00100000:0.0:1762167027.731749:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765452074368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 193us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.731757:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17637 00000100:00100000:2.0:1762167027.733535:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.733995:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452074624 00000100:00100000:0.0:1762167027.734003:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452074624 00000100:00100000:0.0:1762167027.734050:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20192 00000100:00100000:0.0:1762167027.734061:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:58844:x1847765452074624:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.734083:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.734103:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb5f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45af expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.734207:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb66 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.734218:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb66 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.734226:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb66 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.734235:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:0.0:1762167027.734358:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb5f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45af expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.734375:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb66 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45af expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.734400:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167027.734403:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167027.734406:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d200, rc 0) 00000100:00100000:0.0:1762167027.734465:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:58844:x1847765452074624:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 406us (935us total) trans 8589953270 rc 0/0 00000100:00100000:0.0:1762167027.734472:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20192 00000100:00100000:2.0:1762167027.790987:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.791056:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452074752 00000100:00100000:0.0:1762167027.791067:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452074752 00000100:00100000:0.0:1762167027.791119:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17638 00000100:00100000:0.0:1762167027.791127:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452074752:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762167027.791166:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.791184:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a1 expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167027.791192:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.791194:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.791197:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.791231:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a1 expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167027.791256:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a1 expref: 20 pid: 12402 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1762167027.791294:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454567808:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167027.791377:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167027.793475:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.793589:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454567808:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.793614:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167027.793725:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452074880 00000100:00100000:1.0:1762167027.793733:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452074880 00010000:00010000:1.0:1762167027.793791:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a1 expref: 21 pid: 12402 timeout: 748 lvb_type: 1 00000100:00100000:1.0:1762167027.793832:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7723 00000100:00100000:1.0:1762167027.793842:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765452074880:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167027.793859:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167027.793883:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a1 expref: 21 pid: 12402 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1762167027.793895:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a1 expref: 21 pid: 12402 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1762167027.793916:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cb51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a1 expref: 21 pid: 12402 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1762167027.793932:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167027.793934:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167027.793939:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167027.793949:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167027.794042:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.794086:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167027.794097:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765452074880:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 254us (624us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167027.794100:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167027.794109:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7723 00010000:00010000:0.0:1762167027.794139:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.794148:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.794156:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.794167:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167027.794172:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.794193:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.794206:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.794214:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167027.794295:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765452074752:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3167us (3316us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.794303:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17638 00000100:00100000:3.0:1762167027.795517:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.795806:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452075008 00000100:00100000:0.0:1762167027.795813:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452075008 00000100:00100000:0.0:1762167027.795857:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17639 00000100:00100000:0.0:1762167027.795867:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2359:x1847765452075008:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762167027.795906:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.795923:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a8 expref: 14 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167027.795930:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.795932:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.795935:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.795984:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a8 expref: 14 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167027.795996:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a8 expref: 14 pid: 12402 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1762167027.796011:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454567936:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167027.796080:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.797822:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454567936:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.797847:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167027.798546:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167027.798708:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452075136 00000100:00100000:1.0:1762167027.798715:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452075136 00010000:00010000:1.0:1762167027.798745:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a8 expref: 15 pid: 12402 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1762167027.798797:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7724 00000100:00100000:3.0:1762167027.798809:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765452075136:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167027.798823:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167027.798845:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a8 expref: 15 pid: 12402 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1762167027.798858:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a8 expref: 15 pid: 12402 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1762167027.798892:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cb58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45a8 expref: 15 pid: 12402 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1762167027.798905:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167027.798907:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167027.798910:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.798916:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.798947:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167027.798995:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765452075136:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 189us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167027.799003:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7724 00010000:00010000:0.0:1762167027.799046:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.799055:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.799074:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.799080:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.799085:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.799095:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167027.799099:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.799104:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.799112:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.799117:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cb7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167027.799167:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2359:x1847765452075008:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3303us (3655us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.799175:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17639 00000100:00100000:3.0:1762167027.800368:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.800433:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452075392 00000100:00100000:0.0:1762167027.800438:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452075392 00000100:00100000:0.0:1762167027.800519:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20193 00000100:00100000:0.0:1762167027.800528:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:58844:x1847765452075392:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167027.800641:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167027.800662:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cb20 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4593 expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.800678:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167027.800691:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.800732:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.800744:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.800751:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762167027.800910:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000518e76c4 reply state 000000006bf1290c transno 8589953271 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167027.800918:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167027.800985:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:58844:x1847765452075392:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 458us (620us total) trans 8589953271 rc 0/0 00000100:00100000:0.0:1762167027.800992:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20193 00010000:00010000:0.0:1762167027.801804:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.801813:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.801817:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.801821:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.801823:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.801829:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.801839:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167027.801849:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.801853:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.801859:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cb82 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167027.802266:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.802312:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452075520 00000100:00100000:0.0:1762167027.802318:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452075520 00000100:00100000:0.0:1762167027.802359:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20194 00000100:00100000:0.0:1762167027.802368:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:58844:x1847765452075520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.802384:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.802398:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45b6 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.802441:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45b6 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.802455:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45b6 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.802472:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167027.802475:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167027.802478:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167027.802522:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:58844:x1847765452075520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 155us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.802530:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20194 00000100:00100000:3.0:1762167027.803865:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.803934:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452075648 00000100:00100000:0.0:1762167027.803941:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452075648 00000100:00100000:0.0:1762167027.803987:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17640 00000100:00100000:0.0:1762167027.804006:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:58844:x1847765452075648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.804020:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.804038:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45bd expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167027.804058:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x826:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167027.804072:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.804073:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.804079:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45bd expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.804088:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45bd expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.804095:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ce00, rc 0) 00000100:00100000:0.0:1762167027.804135:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:58844:x1847765452075648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 129us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.804142:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17640 00000100:00100000:3.0:1762167027.805350:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.805422:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452075776 00000100:00100000:0.0:1762167027.805430:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452075776 00000100:00100000:0.0:1762167027.805477:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17641 00000100:00100000:0.0:1762167027.805486:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452075776:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762167027.805710:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167027.805714:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb mtime from disk: 0 -> 1762167027 00002000:00010000:0.0:1762167027.805716:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb atime from disk: 0 -> 1762167027 00002000:00010000:0.0:1762167027.805719:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb ctime from disk: 0 -> 1762167028 00002000:00010000:0.0:1762167027.805721:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167027.805815:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765452075776:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 330us (471us total) trans 17179876169 rc 0/0 00000100:00100000:0.0:1762167027.805823:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17641 00000100:00100000:3.0:1762167027.807279:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.807352:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452076032 00000100:00100000:0.0:1762167027.807359:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452076032 00000100:00100000:0.0:1762167027.807411:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7432 00000100:00100000:0.0:1762167027.807420:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:58844:x1847765452076032:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762167027.807489:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x652:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb66 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45af expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.807526:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.807539:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45b6 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.807547:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.807580:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45b6 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.807592:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45b6 expref: 908 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.807607:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454568064:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167027.807681:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f000 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.809228:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454568064:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.809276:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167027.809318:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.809378:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452076160 00000100:00100000:0.0:1762167027.809384:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452076160 00010000:00010000:0.0:1762167027.809411:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45b6 expref: 909 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.809449:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7725 00000100:00100000:0.0:1762167027.809457:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2360:x1847765452076160:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167027.809470:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167027.809476:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45b6 expref: 909 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.809487:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45b6 expref: 909 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.809507:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cb89 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45b6 expref: 909 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.809523:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167027.809528:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.809537:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.809543:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.809578:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167027.809624:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167027.809632:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2360:x1847765452076160:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (312us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167027.809635:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167027.809644:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7725 00010000:00010000:3.0:1762167027.809660:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.809679:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb459a expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.809687:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.809711:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb459a expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.809721:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb459a expref: 907 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1762167027.809731:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454568192:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167027.809845:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee363992900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.811300:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454568192:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.811336:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167027.811478:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.811682:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452076288 00000100:00100000:0.0:1762167027.811688:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452076288 00010000:00010000:0.0:1762167027.811710:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb459a expref: 908 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.811747:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7726 00000100:00100000:0.0:1762167027.811756:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2360:x1847765452076288:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167027.811825:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167027.811832:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb459a expref: 908 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.811843:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb459a expref: 908 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.811861:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cb43 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb459a expref: 908 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.811875:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167027.811880:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.811899:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.811905:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.811928:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167027.811969:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:2360:x1847765452076288:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 213us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.811976:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7726 00010000:00010000:3.0:1762167027.812016:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.812028:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167027.812028:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.812079:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452076416 00000100:00100000:0.0:1762167027.812085:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452076416 00000100:00100000:0.0:1762167027.812116:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 151 00000100:00100000:0.0:1762167027.812123:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2358:x1847765452076416:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:0.0:1762167027.812181:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2358:x1847765452076416:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.812189:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 151 00000100:00100000:3.0:1762167027.812443:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454568320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167027.812539:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167027.812572:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345742840 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.812582:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454568320 00000100:00100000:0.0:1762167027.812587:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454568320 00000100:00100000:0.0:1762167027.812613:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1762167027.812620:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454568320:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167027.812684:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454568320:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.812689:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:2.0:1762167027.813262:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454568320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167027.813326:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359065500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454568448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167027.813357:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167027.813382:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.813438:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454568448 00000100:00100000:0.0:1762167027.813442:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454568448 00000100:00100000:0.0:1762167027.813565:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1762167027.813584:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454568448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167027.813653:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454568448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.813659:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1762167027.813835:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359065500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454568448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1762167027.813998:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953272 00000100:00100000:3.0:1762167027.814056:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454568576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167027.814086:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167027.814117:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167027.814138:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454568576 00000100:00100000:2.0:1762167027.814150:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454568576 00000100:00100000:2.0:1762167027.814191:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1762167027.814199:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454568576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167027.814351:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:30820:x1847765454568576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 152us (263us total) trans 17179876170 rc 0/0 00000100:00100000:2.0:1762167027.814357:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1762167027.814961:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454568576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1762167027.815033:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953273 00010000:00010000:3.0:1762167027.815087:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815096:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815102:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815107:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167027.815111:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815117:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815131:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:3.0:1762167027.815134:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762167027.815138:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815144:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cb9e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815162:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815167:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815172:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815184:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167027.815187:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815192:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815199:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:3.0:1762167027.815201:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762167027.815204:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815208:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0cb97 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167027.815219:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:3.0:1762167027.815221:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167027.815227:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0cb66 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45af expref: 909 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167027.815320:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:58844:x1847765452076032:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7901us (8046us total) trans 8589953274 rc 0/0 00000100:00100000:3.0:1762167027.815328:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7432 00000020:00080000:3.0:1762167027.815332:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762167027.817393:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.817462:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452076544 00000100:00100000:0.0:1762167027.817471:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452076544 00000100:00100000:0.0:1762167027.817527:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20195 00000100:00100000:0.0:1762167027.817538:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:58844:x1847765452076544:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.817559:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.817580:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45c4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.817647:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45c4 expref: 909 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.817661:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45c4 expref: 909 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.817679:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167027.817683:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167027.817685:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167027.817741:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:58844:x1847765452076544:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 205us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.817749:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20195 00000100:00100000:1.0:1762167027.819583:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167027.819686:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452076800 00000100:00100000:3.0:1762167027.819694:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452076800 00000100:00100000:3.0:1762167027.819745:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7433 00000100:00100000:3.0:1762167027.819757:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:58844:x1847765452076800:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167027.819993:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:58844:x1847765452076800:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 239us (416us total) trans 8589953275 rc 0/0 00000100:00100000:3.0:1762167027.820011:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7433 00000100:00100000:1.0:1762167027.821462:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167027.821571:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452077056 00000100:00100000:3.0:1762167027.821590:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452077056 00000100:00100000:3.0:1762167027.821672:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7434 00000100:00100000:3.0:1762167027.821684:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:58844:x1847765452077056:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167027.822128:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:58844:x1847765452077056:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 443us (681us total) trans 8589953276 rc 0/0 00000100:00100000:2.0:1762167027.822138:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7434 00000100:00100000:2.0:1762167027.824329:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.824430:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452077184 00000100:00100000:0.0:1762167027.824440:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452077184 00000100:00100000:0.0:1762167027.824497:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20196 00000100:00100000:0.0:1762167027.824508:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:58844:x1847765452077184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.824553:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.824573:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cbac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45cb expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.824635:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824648:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824659:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824677:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824684:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824691:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824838:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cbc1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x653:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824847:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824854:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.824886:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x653:0x0]: returning size 0 00000004:00200000:0.0:1762167027.824890:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167027.824906:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824922:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824930:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824936:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824942:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824947:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.824951:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824958:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824969:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167027.824972:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.824976:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824982:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0cbb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824994:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.824999:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.825005:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.825014:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.825017:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.825023:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.825030:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a1902b1 (ffff9ee242bbaf00) 00010000:00010000:0.0:1762167027.825032:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.825035:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.825040:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0cbba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.825067:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0cbac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45cb expref: 913 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.825079:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cbc1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45cb expref: 912 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.825086:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:0.0:1762167027.825089:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167027.825091:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167027.825155:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:58844:x1847765452077184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 649us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.825163:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20196 00000100:00100000:1.0:1762167027.827381:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.827471:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452077440 00000100:00100000:0.0:1762167027.827480:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452077440 00000100:00100000:0.0:1762167027.827553:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20197 00000100:00100000:0.0:1762167027.827564:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:58844:x1847765452077440:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167027.827613:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167027.827638:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0cbc1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x653:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45cb expref: 912 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.827659:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:0.0:1762167027.827675:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cb04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb458c expref: 911 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.827684:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167027.827692:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.827716:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.827729:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.827738:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.827751:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.827757:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.827794:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.827904:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.827923:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.827931:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828203:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x653:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828212:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828219:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828227:0:30817:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828233:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828254:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828273:0:30817:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762167027.828292:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828298:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828304:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828311:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2431a1e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167027.828317:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167027.828321:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.828327:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828331:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x653:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.828341:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f78aa00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167027.828347:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762167027.828351:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1762167027.828355:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828356:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.828371:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828373:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbd6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x653:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.828387:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x653:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:3.0:1762167027.828391:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762167027.828394:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 1/0,0 mode: --/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.828400:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbdd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x653:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.828418:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167027.828420:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167027.828420:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167027.828423:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167027.828431:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828437:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828441:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.828444:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828449:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828457:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee242bbad00) 00010000:00010000:0.0:1762167027.828460:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.828463:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.828479:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0cbc8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762167027.828491:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006d34f1eb reply state 000000000588efe3 transno 8589953277 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167027.828499:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167027.828589:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:58844:x1847765452077440:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 1026us (1214us total) trans 8589953277 rc 0/0 00000100:00100000:0.0:1762167027.828597:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20197 00010000:00010000:0.0:1762167027.829645:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.829702:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.829710:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.829716:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.829719:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.829727:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.829738:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a1902b1 (ffff9ee242bba400) 00010000:00010000:0.0:1762167027.829742:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.829746:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.829752:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0cbcf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3a1902b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167027.837511:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.837651:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452077568 00000100:00100000:0.0:1762167027.837663:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452077568 00000100:00100000:0.0:1762167027.837726:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20198 00000100:00100000:0.0:1762167027.837740:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:58845:x1847765452077568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.837815:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.837839:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45d2 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.837908:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.837922:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.837933:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.837992:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:0.0:1762167027.837997:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167027.838020:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.838044:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cbe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45d2 expref: 913 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.838062:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45d2 expref: 912 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.838071:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762167027.838074:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762167027.838099:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2431a1e00, rc 0) 00000100:00100000:0.0:1762167027.838168:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:58845:x1847765452077568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 432us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.838176:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20198 00000100:00100000:1.0:1762167027.840232:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.841018:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452077824 00000100:00100000:0.0:1762167027.841029:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452077824 00000100:00100000:0.0:1762167027.841092:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20199 00000100:00100000:0.0:1762167027.841103:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:58845:x1847765452077824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.841122:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.841139:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cbf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45d9 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.841208:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841221:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841232:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841258:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841265:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841272:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841400:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc07 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841426:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841433:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.841444:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:0.0:1762167027.841538:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841546:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841552:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841558:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee349126a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.841562:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841569:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841580:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762167027.841583:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.841587:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841593:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cbf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841606:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841622:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841628:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841633:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480efc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.841635:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841641:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841648:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee2477ef100) 00010000:00010000:0.0:1762167027.841651:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.841653:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841658:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cc00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.841698:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cbf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45d9 expref: 915 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.841712:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45d9 expref: 914 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.841719:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167027.841721:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167027.841724:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228400, rc 0) 00000100:00100000:0.0:1762167027.841804:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:58845:x1847765452077824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 703us (1580us total) trans 8589953278 rc 0/0 00000100:00100000:0.0:1762167027.841818:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20199 00000100:00100000:2.0:1762167027.844210:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.844306:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452078080 00000100:00100000:0.0:1762167027.844316:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452078080 00000100:00100000:0.0:1762167027.844375:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20200 00000100:00100000:0.0:1762167027.844386:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:58845:x1847765452078080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.844408:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.844427:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45e0 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.844495:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844510:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844521:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844536:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844543:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844551:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844677:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x654:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844686:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844706:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.844716:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x654:0x0]: returning size 0 00010000:00010000:0.0:1762167027.844865:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844873:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844879:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844884:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b1800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.844888:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844895:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844906:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762167027.844910:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.844914:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844920:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844933:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844939:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844957:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844967:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b0000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.844970:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844976:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844984:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbdcc6f6 (ffff9ee242bbad00) 00010000:00010000:0.0:1762167027.844987:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.844989:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.844994:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.845033:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e0 expref: 917 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.845045:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e0 expref: 916 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.845053:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:0.0:1762167027.845054:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167027.845056:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2ce00, rc 0) 00000100:00100000:0.0:1762167027.845634:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:58845:x1847765452078080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1247us (1430us total) trans 8589953279 rc 0/0 00000100:00100000:0.0:1762167027.845641:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20200 00000100:00100000:1.0:1762167027.847741:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.847827:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452078208 00000100:00100000:0.0:1762167027.847837:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452078208 00000100:00100000:0.0:1762167027.847894:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17642 00000100:00100000:0.0:1762167027.847906:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765452078208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.847925:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.847944:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45e7 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167027.847967:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x827:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167027.847986:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.847989:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.847999:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e7 expref: 22 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167027.848014:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e7 expref: 22 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167027.848026:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2c000, rc 0) 00000100:00100000:0.0:1762167027.848084:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765452078208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 180us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.848091:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17642 00000100:00100000:1.0:1762167027.849799:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.849875:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452078464 00000100:00100000:0.0:1762167027.849884:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452078464 00000100:00100000:0.0:1762167027.849933:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20201 00000100:00100000:0.0:1762167027.849942:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:58845:x1847765452078464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.849967:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.849986:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc3f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45ee expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.850110:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0cc46 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.850124:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0cc46 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.850134:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0cc46 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.850147:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:0.0:1762167027.850299:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc3f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45ee expref: 919 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.850322:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0cc46 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45ee expref: 918 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.850329:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167027.850332:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167027.850336:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2ca00, rc 0) 00000100:00100000:0.0:1762167027.850397:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:58845:x1847765452078464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 455us (643us total) trans 8589953280 rc 0/0 00000100:00100000:0.0:1762167027.850405:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20201 00000004:00080000:0.0:1762167027.879985:0:30843:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648672219509ns, next at 649672216544ns, rc = 0 00000100:00100000:2.0:1762167027.880004:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765454568704:0@lo:400:kworker.0 00000100:00100000:0.0:1762167027.880016:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1847765454569088:0@lo:400:kworker.0 00000004:00080000:1.0:1762167027.880150:0:30841:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648672386281ns, next at 649672385103ns, rc = 0 00000100:00100000:2.0:1762167027.880216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167027.880217:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167027.880272:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1762167027.880283:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454569344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762167027.880284:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454568832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762167027.880349:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167027.880386:0:34176:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454569344 00000100:00100000:2.0:1762167027.880387:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1762167027.880395:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765454568960:0@lo:400:kworker.0 00000100:00100000:0.0:1762167027.880414:0:34176:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454569344 00000100:00100000:2.0:1762167027.880426:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167027.880481:0:34176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1762167027.880493:0:34176:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765454569344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1762167027.880529:0:34176:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 347930624 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1762167027.880581:0:34176:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765454569344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.880590:0:34176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1762167027.880646:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454569344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762167027.880675:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167027.880743:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454568704 00000100:00100000:1.0:1762167027.880748:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454568704 00000100:00100000:1.0:1762167027.880802:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1762167027.880811:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765454568704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762167027.880852:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765454568704:12345-0@lo:400:kworker.0 Request processed in 44us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167027.880859:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1762167027.880899:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454569088 00000100:00100000:1.0:1762167027.880911:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454569088 00000100:00100000:1.0:1762167027.880951:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454568960 00000100:00100000:1.0:1762167027.880954:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454568960 00000100:00100000:1.0:1762167027.880972:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1762167027.880977:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1847765454569088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762167027.881011:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1847765454569088:12345-0@lo:400:kworker.0 Request processed in 33us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167027.881017:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1762167027.881027:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1762167027.881033:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765454568960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762167027.881057:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765454568960:12345-0@lo:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167027.881061:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1762167027.881086:0:34176:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454568832 00000100:00100000:1.0:1762167027.881090:0:34176:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454568832 00000100:00100000:1.0:1762167027.881116:0:34176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1762167027.881129:0:34176:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765454568832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762167027.881148:0:34176:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 226820096 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1762167027.881182:0:34176:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765454568832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167027.881188:0:34176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1762167027.881196:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765454568960:0@lo:400:kworker.0 00000100:00100000:1.0:1762167027.881216:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1847765454569216:0@lo:400:kworker.0 00000100:00100000:0.0:1762167027.881218:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765454568704:0@lo:400:kworker.0 00000100:00080000:2.0:1762167027.881249:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762167027.881259:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167027.881277:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454569216 00000100:00100000:2.0:1762167027.881282:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454569216 00000100:00100000:1.0:1762167027.881295:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1847765454569088:0@lo:400:kworker.0 00000100:00100000:2.0:1762167027.881318:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1762167027.881322:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454568832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762167027.881325:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1847765454569216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762167027.881366:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1847765454569216:12345-0@lo:400:kworker.0 Request processed in 42us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167027.881384:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1762167027.881562:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1847765454569216:0@lo:400:kworker.0 00000001:00080000:0.0:1762167027.899039:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876169 is committed 00000001:00080000:0.0:1762167027.899064:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876170 is committed 00000001:00080000:0.0:1762167027.903359:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843749 is committed 00000100:00100000:2.0:1762167027.906999:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.907076:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452078592 00000100:00100000:0.0:1762167027.907098:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452078592 00000100:00100000:0.0:1762167027.907152:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17643 00000100:00100000:0.0:1762167027.907163:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765452078592:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762167027.907209:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.907227:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45bd expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.907235:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167027.907261:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167027.907265:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.907302:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45bd expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.907315:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45bd expref: 21 pid: 12402 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.907330:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454569472:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167027.907410:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.908926:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454569472:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.908949:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167027.909419:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.909516:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452078720 00000100:00100000:0.0:1762167027.909524:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452078720 00010000:00010000:0.0:1762167027.909571:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45bd expref: 22 pid: 12402 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.909611:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7727 00000100:00100000:0.0:1762167027.909620:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765452078720:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167027.909635:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167027.909657:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45bd expref: 22 pid: 12402 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.909689:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45bd expref: 22 pid: 12402 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.909712:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0cb90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45bd expref: 22 pid: 12402 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.909727:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.909730:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.909734:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.909742:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.909813:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167027.909865:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765452078720:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 246us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.909873:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7727 00010000:00010000:3.0:1762167027.909944:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.909963:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.909985:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.909993:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.910001:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.910007:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372a2de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167027.910011:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.910019:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.910030:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.910037:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0cc54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167027.910138:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452078592:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2977us (3162us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167027.910153:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17643 00000100:00100000:2.0:1762167027.911534:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167027.911589:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452078848 00000100:00100000:3.0:1762167027.911597:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452078848 00000100:00100000:3.0:1762167027.911646:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17644 00000100:00100000:3.0:1762167027.911656:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765452078848:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167027.911692:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x827:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.911709:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e7 expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167027.911717:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167027.911719:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167027.911723:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.911755:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e7 expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167027.911811:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e7 expref: 20 pid: 12402 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1762167027.911826:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454569600:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167027.911895:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242737000 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.914720:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454569600:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.914749:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167027.914962:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.915007:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452078976 00000100:00100000:0.0:1762167027.915014:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452078976 00010000:00010000:0.0:1762167027.915045:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e7 expref: 21 pid: 12402 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1762167027.915098:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7728 00000100:00100000:0.0:1762167027.915106:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765452078976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167027.915120:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167027.915140:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x827:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e7 expref: 21 pid: 12402 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1762167027.915153:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x827:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e7 expref: 21 pid: 12402 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1762167027.915325:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0cc38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x827:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e7 expref: 21 pid: 12402 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1762167027.915339:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.915341:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167027.915345:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.915353:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.915383:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167027.915405:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.915427:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167027.915441:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765452078976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 335us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.915450:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7728 00010000:00010000:3.0:1762167027.915452:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.915460:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.915467:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.915474:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167027.915478:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.915485:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.915497:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167027.915503:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cc5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167027.915554:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765452078848:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3900us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167027.915567:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17644 00000100:00100000:1.0:1762167027.917163:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.917280:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452079232 00000100:00100000:0.0:1762167027.917290:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452079232 00000100:00100000:0.0:1762167027.917358:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20202 00000100:00100000:0.0:1762167027.917368:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:58845:x1847765452079232:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167027.917423:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167027.917448:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc07 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45d9 expref: 918 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.917473:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167027.917478:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.917522:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.917536:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.917546:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762167027.917672:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eefaad61 reply state 000000004014e35f transno 8589953281 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167027.917680:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167027.917806:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:58845:x1847765452079232:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 439us (650us total) trans 8589953281 rc 0/0 00000100:00100000:0.0:1762167027.917815:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20202 00010000:00010000:0.0:1762167027.919510:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.919526:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.919535:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.919555:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b0200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.919560:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.919569:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.919585:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167027.919588:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.919593:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.919600:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc62 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167027.919693:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167027.919899:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452079360 00000100:00100000:3.0:1762167027.919907:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452079360 00000100:00100000:3.0:1762167027.919956:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17645 00000100:00100000:3.0:1762167027.919967:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:58845:x1847765452079360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167027.919985:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167027.920074:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45f5 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167027.920098:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x826:0x0] initial LVB size: 0, mtime: 0x690888f3, atime: 0x690888f3, ctime: 0x690888f4, blocks: 0x1 00010000:00010000:2.0:1762167027.920117:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167027.920119:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167027.920128:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45f5 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.920142:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45f5 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.920152:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167027.920203:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:58845:x1847765452079360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 238us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167027.920210:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17645 00000100:00100000:2.0:1762167027.921461:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.921512:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452079488 00000100:00100000:0.0:1762167027.921519:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452079488 00000100:00100000:0.0:1762167027.921565:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17646 00000100:00100000:0.0:1762167027.921575:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452079488:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762167027.921809:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167027.921814:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb mtime from disk: 1762167027 -> 1762167027 00002000:00010000:0.0:1762167027.921817:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb atime from disk: 1762167027 -> 1762167027 00002000:00010000:0.0:1762167027.921820:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb ctime from disk: 1762167028 -> 1762167028 00002000:00010000:0.0:1762167027.921822:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167027.921877:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765452079488:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 302us (419us total) trans 17179876171 rc 0/0 00000100:00100000:0.0:1762167027.921884:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17646 00000100:00100000:3.0:1762167027.923349:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167027.923433:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452079744 00000100:00100000:2.0:1762167027.923441:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452079744 00000100:00100000:2.0:1762167027.923500:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7435 00000100:00100000:2.0:1762167027.923509:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:58845:x1847765452079744:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167027.923582:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x652:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0cc46 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45ee expref: 918 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.923635:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167027.923648:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45c4 expref: 918 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.923656:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167027.923690:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45c4 expref: 918 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.923703:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45c4 expref: 918 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1762167027.923718:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454569728:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167027.923808:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167027.925533:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454569728:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167027.925558:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167027.926265:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.926331:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452079872 00000100:00100000:0.0:1762167027.926349:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452079872 00010000:00010000:0.0:1762167027.926385:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45c4 expref: 919 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.926428:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7729 00000100:00100000:0.0:1762167027.926437:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:2361:x1847765452079872:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167027.926451:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167027.926457:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45c4 expref: 919 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.926469:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45c4 expref: 919 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.926491:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0cba5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45c4 expref: 919 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.926507:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167027.926511:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.926520:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.926527:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.926557:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167027.926598:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167027.926601:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:2361:x1847765452079872:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 164us (337us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167027.926616:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167027.926618:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7729 00010000:00010000:2.0:1762167027.926640:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167027.926662:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e0 expref: 917 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.926670:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167027.926700:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e0 expref: 917 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167027.926711:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e0 expref: 917 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1762167027.926721:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454569856:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167027.926790:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.927822:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454569856:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167027.927843:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167027.927963:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.928042:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452080000 00000100:00100000:0.0:1762167027.928047:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452080000 00010000:00010000:0.0:1762167027.928065:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e0 expref: 918 pid: 30817 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1762167027.928099:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7730 00000100:00100000:0.0:1762167027.928108:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:2360:x1847765452080000:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167027.928118:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167027.928124:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e0 expref: 918 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.928134:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e0 expref: 918 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.928153:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0cc2a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45e0 expref: 918 pid: 30817 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1762167027.928166:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:0.0:1762167027.928170:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.928178:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.928184:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167027.928223:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167027.928270:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167027.928279:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167027.928284:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:2360:x1847765452080000:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.928294:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7730 00000100:00100000:2.0:1762167027.928730:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454569984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167027.928794:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167027.928818:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.928926:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454569984 00000100:00100000:0.0:1762167027.928932:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454569984 00000100:00100000:0.0:1762167027.928969:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1762167027.928976:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454569984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167027.929039:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454569984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.929044:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:2.0:1762167027.929070:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876170 gen 2 00000004:00080000:2.0:1762167027.929077:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37ff80e00, transno 17179876168 00000004:00080000:2.0:1762167027.929097:0:30820:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876170 committed transno 17179876170 00000100:00100000:2.0:1762167027.929113:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454569984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167027.929159:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454570112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167027.929194:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167027.929212:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.929227:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454570112 00000100:00100000:0.0:1762167027.929231:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454570112 00000100:00100000:0.0:1762167027.929271:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:0.0:1762167027.929278:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454570112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167027.929329:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454570112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.929336:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1762167027.929337:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843749 gen 2 00000004:00080000:2.0:1762167027.929342:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b04e00, transno 21474843749 00000100:00100000:2.0:1762167027.929361:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454570112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167027.929383:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454570240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167027.929401:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167027.929426:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167027.929469:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454570240 00000100:00100000:0.0:1762167027.929475:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454570240 00000100:00100000:0.0:1762167027.929505:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:0.0:1762167027.929515:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454570240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167027.929576:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454570240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.929582:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1762167027.929655:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454570240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762167027.929698:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953282 00000001:00080000:1.0:1762167027.929783:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953283 00010000:00010000:1.0:1762167027.929829:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929839:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929846:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929853:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167027.929857:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929864:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929878:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:1.0:1762167027.929888:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167027.929892:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929898:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cc77 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929916:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929922:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929936:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929941:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167027.929944:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929950:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929957:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:1.0:1762167027.929960:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167027.929963:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929968:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0cc70 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167027.929979:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:1.0:1762167027.929982:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167027.929988:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0cc46 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x652:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45ee expref: 919 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167027.930075:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:58845:x1847765452079744:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6566us (6731us total) trans 8589953284 rc 0/0 00000100:00100000:1.0:1762167027.930083:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7435 00000020:00080000:1.0:1762167027.930087:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762167027.931654:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.931734:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452080128 00000100:00100000:0.0:1762167027.931757:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452080128 00000100:00100000:0.0:1762167027.931862:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20203 00000100:00100000:0.0:1762167027.931872:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:58845:x1847765452080128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.931900:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.931924:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb45fc expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.932005:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45fc expref: 919 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.932025:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45fc expref: 919 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.932047:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167027.932050:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167027.932052:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b0200, rc 0) 00000100:00100000:0.0:1762167027.932100:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:58845:x1847765452080128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 229us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.932106:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20203 00000100:00100000:2.0:1762167027.934434:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167027.934489:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452080384 00000100:00100000:1.0:1762167027.934497:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452080384 00000100:00100000:1.0:1762167027.934561:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7436 00000100:00100000:1.0:1762167027.934571:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:58845:x1847765452080384:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167027.934808:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:58845:x1847765452080384:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 238us (426us total) trans 8589953285 rc 0/0 00000100:00100000:1.0:1762167027.934816:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7436 00000100:00100000:3.0:1762167027.936606:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167027.936651:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452080640 00000100:00100000:1.0:1762167027.936658:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452080640 00000100:00100000:1.0:1762167027.936696:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7437 00000100:00100000:1.0:1762167027.936703:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:58845:x1847765452080640:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167027.936909:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:58845:x1847765452080640:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 206us (309us total) trans 8589953286 rc 0/0 00000100:00100000:1.0:1762167027.936917:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7437 00000100:00100000:2.0:1762167027.942324:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.942400:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452080768 00000100:00100000:0.0:1762167027.942410:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452080768 00000100:00100000:0.0:1762167027.942467:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20204 00000100:00100000:0.0:1762167027.942477:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:58845:x1847765452080768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167027.942503:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167027.942521:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4603 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.942600:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942628:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942650:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942668:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942674:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942680:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942814:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cc9a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x654:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942823:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cc9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942830:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cc9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167027.942860:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x654:0x0]: returning size 0 00000004:00200000:0.0:1762167027.942863:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167027.942878:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cc9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942887:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cc9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942894:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942911:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942917:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942922:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b1800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.942926:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942933:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942944:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762167027.942948:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.942952:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942957:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0cc8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942969:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942975:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942980:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.942985:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee348228400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.942988:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.943002:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.943010:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbdcc6f6 (ffff9ee348244a00) 00010000:00010000:0.0:1762167027.943013:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.943016:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.943022:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0cc93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.943056:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0cc85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4603 expref: 923 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.943070:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cc9a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4603 expref: 922 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.943077:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:0.0:1762167027.943079:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167027.943082:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2431a1000, rc 0) 00000100:00100000:0.0:1762167027.943143:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:58845:x1847765452080768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 666us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167027.943150:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20204 00000100:00100000:2.0:1762167027.945252:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167027.945328:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452081024 00000100:00100000:0.0:1762167027.945335:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452081024 00000100:00100000:0.0:1762167027.945528:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20205 00000100:00100000:0.0:1762167027.945538:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:58845:x1847765452081024:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167027.945585:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167027.945623:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cc9a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x654:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4603 expref: 922 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.945639:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:0.0:1762167027.945651:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cbeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45d2 expref: 921 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167027.945658:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762167027.945664:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167027.945686:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.945696:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.945704:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.945714:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.945720:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.945726:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.945853:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.945861:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.945867:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946130:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x654:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946139:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946146:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946152:0:30817:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946158:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946163:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946192:0:30817:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762167027.946208:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946213:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946219:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946224:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f78aa00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.946228:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946235:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x654:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946259:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee242bbad00) 00010000:00010000:0.0:1762167027.946262:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1762167027.946266:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 2/0,0 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946272:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ccaf lrc: 0/0,0 mode: --/EX res: [0x200000404:0x654:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946303:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946309:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946314:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946319:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480efc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.946322:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946328:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946334:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167027.946337:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.946339:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.946345:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cca1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762167027.946354:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002a812544 reply state 00000000048704ae transno 8589953287 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167027.946367:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167027.946441:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:58845:x1847765452081024:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 904us (1210us total) trans 8589953287 rc 0/0 00000100:00100000:0.0:1762167027.946448:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20205 00010000:00010000:2.0:1762167027.946516:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167027.946522:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167027.946528:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36f1ee800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167027.946531:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167027.946536:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167027.946545:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x654:0x0].0x0 (ffff9ee242bbad00) 00010000:00010000:2.0:1762167027.946547:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762167027.946550:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167027.946554:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d0ccb6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x654:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167027.946575:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167027.946577:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167027.946578:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167027.947674:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.947687:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.947693:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.947698:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee349126a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167027.947702:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.947708:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.947718:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbdcc6f6 (ffff9ee242bbaf00) 00010000:00010000:0.0:1762167027.947721:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167027.947724:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167027.947739:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0cca8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfbdcc6f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167028.013004:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.013063:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452081152 00000100:00100000:1.0:1762167028.013077:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452081152 00000100:00100000:1.0:1762167028.013124:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 153 00000100:00100000:1.0:1762167028.013133:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:58856:x1847765452081152:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1762167028.013148:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.013165:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee3819b9800/0xf915a5bdf3d0ccbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb460a expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.013192:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee3819b9800/0xf915a5bdf3d0ccbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb460a expref: 10 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.013201:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee3819b9800/0xf915a5bdf3d0ccbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb460a expref: 10 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.013209:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9800, rc 0) 00000100:00100000:1.0:1762167028.013296:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58856:x1847765452081152:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 164us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.013304:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 153 00000100:00100000:3.0:1762167028.017446:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.017525:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452081280 00000100:00100000:0.0:1762167028.017538:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452081280 00000100:00100000:0.0:1762167028.017597:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 154 00000100:00100000:0.0:1762167028.017625:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58856:x1847765452081280:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1762167028.017804:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58856:x1847765452081280:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 185us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.017812:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 154 00000100:00100000:2.0:1762167028.022001:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.022076:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452081408 00000100:00100000:0.0:1762167028.022086:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452081408 00000100:00100000:0.0:1762167028.022146:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 155 00000100:00100000:0.0:1762167028.022156:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58856:x1847765452081408:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:0.0:1762167028.022389:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58856:x1847765452081408:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 233us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.022398:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 155 00000100:00100000:2.0:1762167028.027614:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.027684:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452081536 00000100:00100000:0.0:1762167028.027694:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452081536 00000100:00100000:0.0:1762167028.027758:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 156 00000100:00100000:0.0:1762167028.027785:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58860:x1847765452081536:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762167028.028047:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58860:x1847765452081536:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 264us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.028056:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 156 00000100:00100000:3.0:1762167028.036031:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.036156:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452081664 00000100:00100000:1.0:1762167028.036167:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452081664 00000100:00100000:1.0:1762167028.036222:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 157 00000100:00100000:1.0:1762167028.036232:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58860:x1847765452081664:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1762167028.036676:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58860:x1847765452081664:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 442us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.036685:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 157 00000100:00100000:2.0:1762167028.039050:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.039264:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452081792 00000100:00100000:1.0:1762167028.039273:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452081792 00000100:00100000:1.0:1762167028.039331:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 158 00000100:00100000:1.0:1762167028.039341:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:58856:x1847765452081792:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1762167028.039511:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.039529:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee3819b8200/0xf915a5bdf3d0ccc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4634 expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.039558:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee3819b8200/0xf915a5bdf3d0ccc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4634 expref: 11 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.039568:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee3819b8200/0xf915a5bdf3d0ccc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4634 expref: 11 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.039688:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:1.0:1762167028.039745:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:58856:x1847765452081792:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 405us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.039752:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 158 00000100:00100000:2.0:1762167028.046802:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.046909:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452081920 00000100:00100000:1.0:1762167028.046919:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452081920 00000100:00100000:1.0:1762167028.046980:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 159 00000100:00100000:1.0:1762167028.046991:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:58856:x1847765452081920:12345-192.168.203.35@tcp:256:mount.lustre.0 20000000:01000000:1.0:1762167028.047020:0:30815:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1762167028.047043:0:30815:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1762167028.047046:0:30815:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1762167028.048885:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:58856:x1847765452081920:12345-192.168.203.35@tcp:256:mount.lustre.0 Request processed in 1887us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.048900:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 159 00000100:00100000:2.0:1762167028.051142:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.051793:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452082048 00000100:00100000:1.0:1762167028.051805:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452082048 00000100:00100000:1.0:1762167028.051867:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 160 00000100:00100000:1.0:1762167028.051878:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:58856:x1847765452082048:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1762167028.051894:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.051912:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee3819b9400/0xf915a5bdf3d0cccb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb463b expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.051941:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee3819b9400/0xf915a5bdf3d0cccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb463b expref: 12 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.051951:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee3819b9400/0xf915a5bdf3d0cccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb463b expref: 12 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.051961:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00000100:00100000:1.0:1762167028.052025:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58856:x1847765452082048:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 149us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.052032:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 160 00000100:00100000:2.0:1762167028.054445:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.054535:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452082176 00000100:00100000:1.0:1762167028.054544:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452082176 00000100:00100000:1.0:1762167028.054607:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 161 00000100:00100000:1.0:1762167028.054618:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58856:x1847765452082176:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1762167028.055297:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58856:x1847765452082176:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 679us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.055307:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 161 00000100:00100000:3.0:1762167028.056827:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.057265:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452082304 00000100:00100000:1.0:1762167028.057274:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452082304 00000100:00100000:1.0:1762167028.057332:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 162 00000100:00100000:1.0:1762167028.057354:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58856:x1847765452082304:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1762167028.057580:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58856:x1847765452082304:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 239us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.057587:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 162 00000100:00100000:2.0:1762167028.061521:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.061617:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452082432 00000100:00100000:1.0:1762167028.061627:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452082432 00000100:00100000:1.0:1762167028.061683:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 163 00000100:00100000:1.0:1762167028.061693:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58867:x1847765452082432:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1762167028.061949:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58867:x1847765452082432:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 256us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.061957:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 163 00000100:00100000:2.0:1762167028.064696:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.064791:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452082560 00000100:00100000:0.0:1762167028.064800:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452082560 00000100:00100000:0.0:1762167028.064848:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 164 00000100:00100000:0.0:1762167028.064857:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58867:x1847765452082560:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762167028.065140:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58867:x1847765452082560:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 282us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.065160:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 164 00000100:00100000:2.0:1762167028.067867:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.069138:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452082688 00000100:00100000:0.0:1762167028.069150:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452082688 00000100:00100000:0.0:1762167028.069209:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20206 00000100:00100000:0.0:1762167028.069217:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1847765452082688:12345-192.168.203.35@tcp:38:mount.lustre.0 00010000:00080000:0.0:1762167028.069257:0:30817:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from 9203c8dd-0e8f-410c-932b-b91553d6070a@192.168.203.35@tcp t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:0.0:1762167028.069297:0:30817:0:(genops.c:1402:class_connect()) connect: client 9203c8dd-0e8f-410c-932b-b91553d6070a, cookie 0xf915a5bdf3d0ccd2 00000004:00100000:0.0:1762167028.069326:0:30817:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:01000000:0.0:1762167028.069551:0:30817:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34aa0e300 00000100:00080000:0.0:1762167028.069591:0:30817:0:(import.c:65:import_set_state_nolock()) ffff9ee37f991000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1762167028.069679:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+6:2357:x1847765452082688:12345-192.168.203.35@tcp:38:mount.lustre.0 Request processed in 460us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.069687:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20206 00000100:00100000:1.0:1762167028.072088:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.072181:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.072506:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452082816 00000100:00100000:0.0:1762167028.072516:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452082816 00000100:00100000:2.0:1762167028.072595:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452082944 00000100:00100000:2.0:1762167028.072600:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452082944 00000100:00100000:2.0:1762167028.072654:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20207 00000100:00100000:2.0:1762167028.072665:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9203c8dd-0e8f-410c-932b-b91553d6070a+7:58856:x1847765452082944:12345-192.168.203.35@tcp:41:mount.lustre.0 00000100:00080000:1.0:1762167028.072734:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762167028.072923:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20208 00000100:00100000:0.0:1762167028.072932:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+7:0:x1847765452082816:12345-192.168.203.35@tcp:41:mount.lustre.0 00000004:00000024:0.0:1762167028.072967:0:30817:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 5505024 pending 0 free 2258632704 avail 2256535552 00000004:00000024:2.0:1762167028.073126:0:32138:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 5505024 pending 0 free 2258632704 avail 2256535552 00000100:00100000:0.0:1762167028.073549:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+7:0:x1847765452082816:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 617us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.073555:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9203c8dd-0e8f-410c-932b-b91553d6070a+7:58856:x1847765452082944:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 889us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.073563:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20208 00000100:00100000:2.0:1762167028.073572:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20207 00000100:00100000:3.0:1762167028.075832:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.075932:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452083072 00000100:00100000:2.0:1762167028.075944:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452083072 00000100:00100000:2.0:1762167028.075997:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20209 00000100:00100000:2.0:1762167028.076007:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9203c8dd-0e8f-410c-932b-b91553d6070a+6:58856:x1847765452083072:12345-192.168.203.35@tcp:40:mount.lustre.0 00000100:00100000:2.0:1762167028.076096:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9203c8dd-0e8f-410c-932b-b91553d6070a+6:58856:x1847765452083072:12345-192.168.203.35@tcp:40:mount.lustre.0 Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.076120:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20209 00000100:00100000:1.0:1762167028.078482:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.078522:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.078575:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.078638:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452083456 00000100:00100000:2.0:1762167028.078648:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452083456 00000100:00100000:2.0:1762167028.078707:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7438 00000100:00100000:3.0:1762167028.078715:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452083200 00000100:00100000:2.0:1762167028.078720:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+6:58856:x1847765452083456:12345-192.168.203.35@tcp:33:mount.lustre.0 00000100:00100000:3.0:1762167028.078722:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452083200 00000100:00100000:0.0:1762167028.078736:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452083328 00000100:00100000:0.0:1762167028.078742:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452083328 00000100:00100000:3.0:1762167028.078797:0:34501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17647 00000100:00100000:3.0:1762167028.078805:0:34501:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2357:x1847765452083200:12345-192.168.203.35@tcp:8:mount.lustre.0 00000100:00100000:0.0:1762167028.078810:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17648 00000100:00100000:0.0:1762167028.078818:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2357:x1847765452083328:12345-192.168.203.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1762167028.078841:0:34501:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from 9203c8dd-0e8f-410c-932b-b91553d6070a@192.168.203.35@tcp t0 exp 0000000000000000 cur 648 last 0 00010000:00080000:0.0:1762167028.078846:0:12402:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from 9203c8dd-0e8f-410c-932b-b91553d6070a@192.168.203.35@tcp t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:3.0:1762167028.078879:0:34501:0:(genops.c:1402:class_connect()) connect: client 9203c8dd-0e8f-410c-932b-b91553d6070a, cookie 0xf915a5bdf3d0ccd9 00000020:00000080:0.0:1762167028.078885:0:12402:0:(genops.c:1402:class_connect()) connect: client 9203c8dd-0e8f-410c-932b-b91553d6070a, cookie 0xf915a5bdf3d0cce0 00002000:00100000:3.0:1762167028.078893:0:34501:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli 9203c8dd-0e8f-410c-932b-b91553d6070a/ffff9ee2448d9800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1762167028.078899:0:12402:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli 9203c8dd-0e8f-410c-932b-b91553d6070a/ffff9ee3431bc000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1762167028.078905:0:34501:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1762167028.078912:0:12402:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00200000:2.0:1762167028.078979:0:30820:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000020:01000000:0.0:1762167028.079022:0:12402:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee36f323700 00002000:00080000:0.0:1762167028.079033:0:12402:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1762167028.079066:0:12402:0:(import.c:65:import_set_state_nolock()) ffff9ee3431ba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1762167028.079084:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+6:58856:x1847765452083456:12345-192.168.203.35@tcp:33:mount.lustre.0 Request processed in 365us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.079093:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7438 00000100:00100000:0.0:1762167028.079122:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+6:2357:x1847765452083328:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 302us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.079129:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17648 00000020:01000000:3.0:1762167028.079274:0:34501:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee247a17800 00002000:00080000:3.0:1762167028.079283:0:34501:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1762167028.079299:0:34501:0:(import.c:65:import_set_state_nolock()) ffff9ee2448d8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762167028.079341:0:34501:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:9203c8dd-0e8f-410c-932b-b91553d6070a+6:2357:x1847765452083200:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 535us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.079358:0:34501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17647 00010000:00010000:2.0:1762167028.136180:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167028.217073:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.217353:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452083584 00000100:00100000:0.0:1762167028.217364:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452083584 00000100:00100000:0.0:1762167028.217419:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 165 00000100:00100000:0.0:1762167028.217430:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:58893:x1847765452083584:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762167028.217446:0:30813:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167028.217463:0:30813:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee36f1ee800/0xf915a5bdf3d0cce7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4665 expref: -99 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.217490:0:30813:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee36f1ee800/0xf915a5bdf3d0cce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4665 expref: 13 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.217501:0:30813:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee36f1ee800/0xf915a5bdf3d0cce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4665 expref: 13 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.217510:0:30813:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36f1ee800, rc 0) 00000100:00100000:0.0:1762167028.217572:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58893:x1847765452083584:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 144us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.217596:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 165 00000100:00100000:1.0:1762167028.219039:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.219095:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452083712 00000100:00100000:2.0:1762167028.219103:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452083712 00000100:00100000:2.0:1762167028.219153:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 166 00000100:00100000:2.0:1762167028.219162:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58893:x1847765452083712:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1762167028.219328:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58893:x1847765452083712:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 167us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.219337:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 166 00000100:00100000:3.0:1762167028.220452:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.221412:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452083840 00000100:00100000:2.0:1762167028.221420:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452083840 00000100:00100000:2.0:1762167028.221475:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 167 00000100:00100000:2.0:1762167028.221484:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58893:x1847765452083840:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1762167028.221694:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58893:x1847765452083840:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 210us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.221703:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 167 00000100:00100000:1.0:1762167028.223922:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.224127:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452083968 00000100:00100000:2.0:1762167028.224147:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452083968 00000100:00100000:2.0:1762167028.224986:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 168 00000100:00100000:2.0:1762167028.225001:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58897:x1847765452083968:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1762167028.225268:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58897:x1847765452083968:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 270us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.225276:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 168 00000100:00100000:1.0:1762167028.232312:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.232436:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452084096 00000100:00100000:0.0:1762167028.232447:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452084096 00000100:00100000:0.0:1762167028.232503:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 169 00000100:00100000:0.0:1762167028.232512:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58897:x1847765452084096:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762167028.232832:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58897:x1847765452084096:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 320us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.232840:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 169 00000100:00100000:3.0:1762167028.236293:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.237218:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452084224 00000100:00100000:0.0:1762167028.237230:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452084224 00000100:00100000:0.0:1762167028.237299:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 170 00000100:00100000:0.0:1762167028.237308:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:58893:x1847765452084224:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762167028.237324:0:30813:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167028.237340:0:30813:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee349126a00/0xf915a5bdf3d0ccee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb468f expref: -99 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.237379:0:30813:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee349126a00/0xf915a5bdf3d0ccee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb468f expref: 14 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.237390:0:30813:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee349126a00/0xf915a5bdf3d0ccee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb468f expref: 14 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.237398:0:30813:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee349126a00, rc 0) 00000100:00100000:0.0:1762167028.237461:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:58893:x1847765452084224:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 154us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.237469:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 170 00000100:00100000:1.0:1762167028.241581:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.241645:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452084352 00000100:00100000:2.0:1762167028.241655:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452084352 00000100:00100000:2.0:1762167028.241707:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 171 00000100:00100000:2.0:1762167028.241715:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:58893:x1847765452084352:12345-192.168.203.35@tcp:256:mount.lustre.0 20000000:01000000:2.0:1762167028.241742:0:30815:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1762167028.241782:0:30815:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1762167028.241784:0:30815:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1762167028.242944:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:58893:x1847765452084352:12345-192.168.203.35@tcp:256:mount.lustre.0 Request processed in 1225us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.242953:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 171 00000100:00100000:3.0:1762167028.244924:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.245067:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452084480 00000100:00100000:2.0:1762167028.245077:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452084480 00000100:00100000:2.0:1762167028.245133:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 172 00000100:00100000:2.0:1762167028.245143:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:58893:x1847765452084480:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1762167028.245159:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167028.245178:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee381f1c600/0xf915a5bdf3d0ccf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4696 expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.245205:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee381f1c600/0xf915a5bdf3d0ccf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4696 expref: 15 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.245215:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee381f1c600/0xf915a5bdf3d0ccf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4696 expref: 15 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.245248:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167028.245303:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:58893:x1847765452084480:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 161us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.245317:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 172 00000100:00100000:1.0:1762167028.246535:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.246614:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452084608 00000100:00100000:2.0:1762167028.246621:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452084608 00000100:00100000:2.0:1762167028.246663:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 173 00000100:00100000:2.0:1762167028.246672:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:58893:x1847765452084608:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1762167028.246832:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:58893:x1847765452084608:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 161us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.246840:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 173 00000100:00100000:1.0:1762167028.248324:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.248379:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452084736 00000100:00100000:2.0:1762167028.248388:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452084736 00000100:00100000:2.0:1762167028.248435:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 174 00000100:00100000:2.0:1762167028.248443:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:58893:x1847765452084736:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1762167028.248640:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:58893:x1847765452084736:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 197us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.248647:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 174 00000100:00100000:3.0:1762167028.250478:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.250559:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452084864 00000100:00100000:0.0:1762167028.250567:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452084864 00000100:00100000:0.0:1762167028.250618:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 175 00000100:00100000:0.0:1762167028.250628:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:58901:x1847765452084864:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762167028.251152:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:58901:x1847765452084864:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 523us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.251161:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 175 00000100:00100000:1.0:1762167028.254878:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.254989:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452084992 00000100:00100000:0.0:1762167028.254999:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452084992 00000100:00100000:0.0:1762167028.255059:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 176 00000100:00100000:0.0:1762167028.255194:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242b1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:58901:x1847765452084992:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762167028.256822:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242b1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:58901:x1847765452084992:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 1747us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.256833:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 176 00000100:00100000:1.0:1762167028.260438:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.260635:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452085120 00000100:00100000:0.0:1762167028.260646:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452085120 00000100:00100000:0.0:1762167028.260693:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20210 00000100:00100000:0.0:1762167028.260701:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1847765452085120:12345-192.168.203.35@tcp:38:mount.lustre.0 00010000:00080000:0.0:1762167028.260728:0:30817:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from 659da189-2af3-497b-b5f5-3b42241f6905@192.168.203.35@tcp t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:0.0:1762167028.260788:0:30817:0:(genops.c:1402:class_connect()) connect: client 659da189-2af3-497b-b5f5-3b42241f6905, cookie 0xf915a5bdf3d0ccfc 00000004:00100000:0.0:1762167028.260805:0:30817:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:01000000:0.0:1762167028.260893:0:30817:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34aa0e300 00000100:00080000:0.0:1762167028.260926:0:30817:0:(import.c:65:import_set_state_nolock()) ffff9ee243bc6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1762167028.260999:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659da189-2af3-497b-b5f5-3b42241f6905+6:2357:x1847765452085120:12345-192.168.203.35@tcp:38:mount.lustre.0 Request processed in 297us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.261007:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20210 00000100:00100000:3.0:1762167028.262197:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.262234:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.262315:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452085248 00000100:00100000:0.0:1762167028.262321:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452085248 00000100:00080000:1.0:1762167028.262548:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762167028.262645:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452085376 00000100:00100000:3.0:1762167028.262650:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20211 00000100:00100000:2.0:1762167028.262651:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452085376 00000100:00100000:3.0:1762167028.262660:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659da189-2af3-497b-b5f5-3b42241f6905+7:0:x1847765452085248:12345-192.168.203.35@tcp:41:mount.lustre.0 00000100:00100000:2.0:1762167028.262695:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20212 00000004:00000024:3.0:1762167028.262698:0:30819:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 8912896 pending 0 free 2258632704 avail 2256535552 00000100:00100000:2.0:1762167028.262702:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659da189-2af3-497b-b5f5-3b42241f6905+7:58893:x1847765452085376:12345-192.168.203.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1762167028.262712:0:32138:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 8912896 pending 0 free 2258632704 avail 2256535552 00000100:00100000:3.0:1762167028.262748:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659da189-2af3-497b-b5f5-3b42241f6905+7:0:x1847765452085248:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 91us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.262748:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659da189-2af3-497b-b5f5-3b42241f6905+7:58893:x1847765452085376:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 47us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.262755:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20211 00000100:00100000:2.0:1762167028.262791:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20212 00000100:00100000:1.0:1762167028.265119:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.265212:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452085504 00000100:00100000:3.0:1762167028.265231:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452085504 00000100:00100000:3.0:1762167028.265289:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20213 00000100:00100000:3.0:1762167028.265298:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659da189-2af3-497b-b5f5-3b42241f6905+6:58893:x1847765452085504:12345-192.168.203.35@tcp:40:mount.lustre.0 00000100:00100000:3.0:1762167028.266062:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659da189-2af3-497b-b5f5-3b42241f6905+6:58893:x1847765452085504:12345-192.168.203.35@tcp:40:mount.lustre.0 Request processed in 761us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.266071:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20213 00000100:00100000:1.0:1762167028.268170:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.268208:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.268295:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452085632 00000100:00100000:0.0:1762167028.268307:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452085632 00000100:00100000:3.0:1762167028.268315:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452085760 00000100:00100000:3.0:1762167028.268322:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452085760 00000100:00100000:0.0:1762167028.268378:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17649 00000100:00100000:0.0:1762167028.268387:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2357:x1847765452085632:12345-192.168.203.35@tcp:8:mount.lustre.0 00010000:00080000:0.0:1762167028.268421:0:12402:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from 659da189-2af3-497b-b5f5-3b42241f6905@192.168.203.35@tcp t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:0.0:1762167028.268451:0:12402:0:(genops.c:1402:class_connect()) connect: client 659da189-2af3-497b-b5f5-3b42241f6905, cookie 0xf915a5bdf3d0cd03 00002000:00100000:0.0:1762167028.268469:0:12402:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli 659da189-2af3-497b-b5f5-3b42241f6905/ffff9ee243bc0800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1762167028.268480:0:12402:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1762167028.268542:0:34501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17650 00000100:00100000:3.0:1762167028.268550:0:34501:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2357:x1847765452085760:12345-192.168.203.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1762167028.268570:0:34501:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from 659da189-2af3-497b-b5f5-3b42241f6905@192.168.203.35@tcp t0 exp 0000000000000000 cur 649 last 0 00000020:01000000:0.0:1762167028.268581:0:12402:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee247a17800 00002000:00080000:0.0:1762167028.268594:0:12402:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:3.0:1762167028.268606:0:34501:0:(genops.c:1402:class_connect()) connect: client 659da189-2af3-497b-b5f5-3b42241f6905, cookie 0xf915a5bdf3d0cd0a 00002000:00100000:3.0:1762167028.268614:0:34501:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli 659da189-2af3-497b-b5f5-3b42241f6905/ffff9ee2448da000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1762167028.268622:0:34501:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1762167028.268633:0:12402:0:(import.c:65:import_set_state_nolock()) ffff9ee243bc4000 : changing import state from RECOVER to FULL 00000020:01000000:3.0:1762167028.268679:0:34501:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee36f323700 00002000:00080000:3.0:1762167028.268686:0:34501:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1762167028.268703:0:34501:0:(import.c:65:import_set_state_nolock()) ffff9ee2448df000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762167028.269299:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.269324:0:34501:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:659da189-2af3-497b-b5f5-3b42241f6905+6:2357:x1847765452085760:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 773us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.269330:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:659da189-2af3-497b-b5f5-3b42241f6905+6:2357:x1847765452085632:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 939us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.269339:0:34501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17650 00000100:00100000:0.0:1762167028.269346:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17649 00000100:00100000:2.0:1762167028.269350:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452085888 00000100:00100000:2.0:1762167028.269356:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452085888 00000100:00100000:2.0:1762167028.269400:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7439 00000100:00100000:2.0:1762167028.269409:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659da189-2af3-497b-b5f5-3b42241f6905+6:58893:x1847765452085888:12345-192.168.203.35@tcp:33:mount.lustre.0 00000004:00200000:2.0:1762167028.269492:0:30821:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000100:00100000:2.0:1762167028.269740:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659da189-2af3-497b-b5f5-3b42241f6905+6:58893:x1847765452085888:12345-192.168.203.35@tcp:33:mount.lustre.0 Request processed in 331us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.269748:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7439 00000100:00100000:1.0:1762167028.337130:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.337331:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452086016 00000100:00100000:3.0:1762167028.337342:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452086016 00000100:00100000:3.0:1762167028.337407:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20214 00000100:00100000:3.0:1762167028.337418:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659da189-2af3-497b-b5f5-3b42241f6905+6:58918:x1847765452086016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167028.337442:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167028.337467:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46c0 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.337536:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0cd18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.337558:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0cd18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.337572:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0cd18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167028.337633:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:3.0:1762167028.337637:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167028.337674:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0cd18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.337717:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46c0 expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.337735:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0cd18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46c0 expref: 7 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.337743:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167028.337746:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762167028.337750:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167028.337862:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659da189-2af3-497b-b5f5-3b42241f6905+7:58918:x1847765452086016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 446us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.337870:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20214 00000100:00100000:1.0:1762167028.339897:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.340030:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452086272 00000100:00100000:3.0:1762167028.340040:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452086272 00000100:00100000:3.0:1762167028.340102:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20215 00000100:00100000:3.0:1762167028.340112:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659da189-2af3-497b-b5f5-3b42241f6905+7:58918:x1847765452086272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167028.340130:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167028.340148:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46c7 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.340216:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340230:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340267:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340300:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340307:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340314:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340419:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340426:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340432:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340438:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.340441:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340448:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340459:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167028.340462:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.340466:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340472:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340486:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340498:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340503:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340509:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.340512:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340518:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340527:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee345a77200) 00010000:00010000:3.0:1762167028.340529:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.340532:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340538:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.340573:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46c7 expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.340583:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167028.340585:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762167028.340589:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46c7 expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.340598:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167028.340663:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659da189-2af3-497b-b5f5-3b42241f6905+7:58918:x1847765452086272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 545us (767us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167028.340676:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20215 00000100:00100000:0.0:1762167028.342447:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.342695:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452086400 00000100:00100000:3.0:1762167028.342704:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452086400 00000100:00100000:3.0:1762167028.342873:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20216 00000100:00100000:3.0:1762167028.342886:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659da189-2af3-497b-b5f5-3b42241f6905+7:58918:x1847765452086400:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762167028.342953:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.342969:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.342980:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.342996:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343003:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343009:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343104:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343112:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343119:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167028.343151:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00000004:00200000:3.0:1762167028.343167:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167028.343180:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343194:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343200:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343207:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343214:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.343217:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343224:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343252:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167028.343255:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.343259:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343266:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343278:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343283:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343289:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343298:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.343302:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343308:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343316:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee345a77d00) 00010000:00010000:3.0:1762167028.343318:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.343320:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343326:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343345:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343350:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343356:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343360:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.343363:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343368:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343375:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:3.0:1762167028.343381:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.343385:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.343391:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd42 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000100:00100000:3.0:1762167028.343467:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659da189-2af3-497b-b5f5-3b42241f6905+7:58918:x1847765452086400:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 584us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.343475:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20216 00000100:00100000:1.0:1762167028.367401:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.367494:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452086528 00000100:00100000:3.0:1762167028.367504:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452086528 00000100:00100000:3.0:1762167028.367566:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20217 00000100:00100000:3.0:1762167028.367576:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:58923:x1847765452086528:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762167028.367601:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167028.367621:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46ce expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.367687:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.367701:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.367711:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167028.367798:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:3.0:1762167028.367802:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167028.367829:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.367870:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ce expref: 923 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.367887:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0cd50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ce expref: 922 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.367895:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167028.367898:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762167028.367902:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167028.367969:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:58923:x1847765452086528:12345-192.168.203.35@tcp:101:stat.0 Request processed in 394us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.367976:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20217 00000100:00100000:1.0:1762167028.370922:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.371005:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452086656 00000100:00100000:3.0:1762167028.371015:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452086656 00000100:00100000:3.0:1762167028.371068:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20218 00000100:00100000:3.0:1762167028.371077:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:58923:x1847765452086656:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762167028.371094:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167028.371110:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46d5 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.371164:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371178:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371190:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371223:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371230:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371246:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371348:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371356:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371362:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167028.371395:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00000004:00200000:3.0:1762167028.371399:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167028.371416:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371426:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371433:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371438:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371443:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371458:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.371462:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371469:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371480:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167028.371483:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.371487:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371493:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0cd5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371509:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371514:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371519:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371523:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.371525:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371530:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371536:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee345a77d00) 00010000:00010000:3.0:1762167028.371538:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.371546:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371552:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0cd65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.371585:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0cd57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46d5 expref: 924 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.371597:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46d5 expref: 923 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.371605:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:3.0:1762167028.371607:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167028.371609:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167028.371673:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:58923:x1847765452086656:12345-192.168.203.35@tcp:101:stat.0 Request processed in 596us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.371681:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20218 00000100:00100000:0.0:1762167028.373425:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.373723:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452086784 00000100:00100000:1.0:1762167028.373733:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452086784 00000100:00100000:1.0:1762167028.373817:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20219 00000100:00100000:1.0:1762167028.373830:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+6:58927:x1847765452086784:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:1.0:1762167028.373864:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.373886:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0cd73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46dc expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.373951:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0cd7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.373981:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0cd7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.373992:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0cd7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167028.374065:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1762167028.374069:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167028.374092:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0cd7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.374118:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0cd73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46dc expref: 8 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.374137:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0cd7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46dc expref: 7 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.374146:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:1.0:1762167028.374149:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762167028.374153:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:1.0:1762167028.374221:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+7:58927:x1847765452086784:12345-192.168.203.35@tcp:101:stat.0 Request processed in 395us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.374229:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20219 00000100:00100000:2.0:1762167028.378531:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.378619:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452086912 00000100:00100000:3.0:1762167028.378639:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452086912 00000100:00100000:3.0:1762167028.378895:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20220 00000100:00100000:3.0:1762167028.378907:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9203c8dd-0e8f-410c-932b-b91553d6070a+7:58927:x1847765452086912:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:3.0:1762167028.378934:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167028.378959:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46e3 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167028.379033:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167028.379039:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379056:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379090:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379106:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379112:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379119:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000100:00100000:1.0:1762167028.379127:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452087040 00000100:00100000:1.0:1762167028.379134:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452087040 00000100:00100000:1.0:1762167028.379190:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20221 00000100:00100000:1.0:1762167028.379202:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659da189-2af3-497b-b5f5-3b42241f6905+7:58931:x1847765452087040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167028.379213:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.379226:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0cd96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46ea expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.379231:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379261:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379271:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167028.379307:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:1.0:1762167028.379308:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167028.379317:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1762167028.379320:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379331:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379343:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00000004:00010000:3.0:1762167028.379344:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167028.379358:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167028.379365:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167028.379368:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167028.379377:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379385:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379407:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379415:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.379420:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379429:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167028.379430:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379447:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379455:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167028.379462:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167028.379467:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.379473:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379480:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0cd88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000004:00200000:1.0:1762167028.379487:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00000004:00200000:1.0:1762167028.379492:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1762167028.379494:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379502:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00000004:00010000:1.0:1762167028.379505:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167028.379509:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379522:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167028.379523:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167028.379526:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167028.379534:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167028.379544:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379558:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379564:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379568:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167028.379571:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379577:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379584:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:1.0:1762167028.379587:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167028.379590:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379596:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0cda4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379606:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379612:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379617:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379622:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167028.379632:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379639:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379648:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee345a77200) 00010000:00010000:1.0:1762167028.379651:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167028.379654:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167028.379660:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0cdab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167028.379678:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee345a77200) 00010000:00010000:3.0:1762167028.379681:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.379686:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167028.379691:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0cd96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ea expref: 9 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.379695:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0cd8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:1.0:1762167028.379715:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ea expref: 8 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.379725:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00000100:00100000:2.0:1762167028.379726:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167028.379730:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167028.379734:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8600, rc 0) 00000100:00100000:0.0:1762167028.379804:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452087296 00010000:00010000:3.0:1762167028.379809:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0cd81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46e3 expref: 9 pid: 31205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167028.379811:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452087296 00000100:00100000:1.0:1762167028.379825:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659da189-2af3-497b-b5f5-3b42241f6905+8:58931:x1847765452087040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 625us (792us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167028.379831:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46e3 expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167028.379839:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20221 00010000:00010000:3.0:1762167028.379843:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:3.0:1762167028.379847:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1762167028.379849:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20222 00010000:00010000:3.0:1762167028.379851:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:0.0:1762167028.379861:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:58933:x1847765452087296:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167028.379870:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167028.379881:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cdb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46f1 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167028.379918:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9203c8dd-0e8f-410c-932b-b91553d6070a+8:58927:x1847765452086912:12345-192.168.203.35@tcp:101:stat.0 Request processed in 1011us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.379926:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20220 00010000:00010000:0.0:1762167028.379946:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cdc0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.379956:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.379964:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167028.379972:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:0.0:1762167028.380079:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0cdb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46f1 expref: 926 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.380093:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46f1 expref: 925 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.380100:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.380103:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167028.380106:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f78aa00, rc 0) 00000100:00100000:0.0:1762167028.380146:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:58933:x1847765452087296:12345-192.168.203.35@tcp:101:cat.0 Request processed in 288us (423us total) trans 8589953288 rc 0/0 00000100:00100000:0.0:1762167028.380152:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20222 00000100:00100000:3.0:1762167028.384935:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.384939:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.384980:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452087424 00000100:00100000:0.0:1762167028.384993:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452087424 00000100:00100000:3.0:1762167028.385027:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.385035:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452087680 00000100:00100000:1.0:1762167028.385040:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452087680 00000100:00100000:0.0:1762167028.385063:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 673 00000100:00100000:0.0:1762167028.385075:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:2361:x1847765452087424:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762167028.385082:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20223 00010000:00010000:0.0:1762167028.385093:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167028.385118:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0cdc0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46f1 expref: 925 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.385153:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.385171:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167028.385200:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659da189-2af3-497b-b5f5-3b42241f6905+8:58931:x1847765452087680:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:2.0:1762167028.385206:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452087808 00000100:00100000:2.0:1762167028.385210:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452087808 00010000:00010000:1.0:1762167028.385226:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167028.385227:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+924:2361:x1847765452087424:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.385247:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 673 00002000:00100000:2.0:1762167028.385254:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x826:0x0] (0->4095) req@ffff9ee359065f80 x1847765452087808/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:59/0 lens 488/0 e 0 to 0 dl 1762167039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1762167028.385257:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0cdce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46f8 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1762167028.385266:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065f80 with x1847765452087808 ext(0->4095) 00002000:00010000:2.0:1762167028.385272:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359065f80 00000100:00100000:2.0:1762167028.385308:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3278 00000100:00100000:2.0:1762167028.385315:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765452087808:12345-192.168.203.35@tcp:3:cat.0 00010000:00010000:1.0:1762167028.385346:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0cdd5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167028.385359:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0cdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167028.385369:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0cdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167028.385379:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:1.0:1762167028.385500:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0cdce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46f8 expref: 11 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.385516:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0cdd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46f8 expref: 10 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.385517:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765452087808:12345-192.168.203.35@tcp:3:cat.0 Request processed in 203us (490us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167028.385524:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00000100:00100000:2.0:1762167028.385525:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3278 00010000:00010000:1.0:1762167028.385527:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167028.385530:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8800, rc 0) 00002000:00100000:2.0:1762167028.385531:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x826:0x0] (0->4095) req@ffff9ee359065f80 x1847765452087808/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:59/0 lens 488/440 e 0 to 0 dl 1762167039 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167028.385551:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065f80 with x1847765452087808 ext(0->4095) 00002000:00010000:2.0:1762167028.385555:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359065f80 00000100:00100000:1.0:1762167028.385566:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659da189-2af3-497b-b5f5-3b42241f6905+10:58931:x1847765452087680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 476us (640us total) trans 8589953289 rc 0/0 00000100:00100000:1.0:1762167028.385573:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20223 00000100:00100000:3.0:1762167028.387644:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.387684:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.387720:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452088064 00000100:00100000:2.0:1762167028.387729:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452088064 00000100:00100000:3.0:1762167028.387741:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.387798:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452088320 00000100:00100000:2.0:1762167028.387802:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452088320 00000100:00100000:2.0:1762167028.387844:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7440 00000100:00100000:2.0:1762167028.387855:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342febc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+924:58933:x1847765452088064:12345-192.168.203.35@tcp:35:cat.0 00000100:00100000:1.0:1762167028.387863:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7441 00000100:00100000:1.0:1762167028.387876:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659da189-2af3-497b-b5f5-3b42241f6905+10:58931:x1847765452088320:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167028.388201:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452088448 00000100:00100000:0.0:1762167028.388207:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452088448 00000100:00100000:0.0:1762167028.388256:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 674 00000100:00100000:0.0:1762167028.388264:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:659da189-2af3-497b-b5f5-3b42241f6905+12:2361:x1847765452088448:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167028.388276:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167028.388301:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0cdd5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46f8 expref: 12 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.388320:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.388325:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167028.389284:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342febc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:58933:x1847765452088064:12345-192.168.203.35@tcp:35:cat.0 Request processed in 1424us (1647us total) trans 8589953291 rc 0/0 00000100:00100000:1.0:1762167028.389284:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659da189-2af3-497b-b5f5-3b42241f6905+11:58931:x1847765452088320:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 1405us (1591us total) trans 8589953290 rc 0/0 00000100:00100000:0.0:1762167028.389284:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:659da189-2af3-497b-b5f5-3b42241f6905+11:2361:x1847765452088448:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1013us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.389297:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7440 00000100:00100000:0.0:1762167028.389297:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 674 00000100:00100000:1.0:1762167028.389312:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7441 00000100:00100000:2.0:1762167028.390703:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.390785:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452088704 00000100:00100000:1.0:1762167028.390794:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452088704 00000100:00100000:1.0:1762167028.390842:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20224 00000100:00100000:1.0:1762167028.390852:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9203c8dd-0e8f-410c-932b-b91553d6070a+8:58938:x1847765452088704:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:1.0:1762167028.390882:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.390903:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0cde3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb46ff expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.391015:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0cdea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167028.391029:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0cdea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167028.391039:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0cdea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167028.391050:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:1.0:1762167028.391181:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0cde3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ff expref: 11 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.391202:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0cdea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ff expref: 10 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.391211:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:1.0:1762167028.391214:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167028.391217:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9000, rc 0) 00000100:00100000:1.0:1762167028.391284:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9203c8dd-0e8f-410c-932b-b91553d6070a+10:58938:x1847765452088704:12345-192.168.203.35@tcp:101:cat.0 Request processed in 433us (586us total) trans 8589953292 rc 0/0 00000100:00100000:1.0:1762167028.391304:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20224 00000100:00100000:2.0:1762167028.395019:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.395069:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.395094:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452088832 00000100:00100000:0.0:1762167028.395124:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452088832 00000100:00100000:0.0:1762167028.395251:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17651 00000100:00100000:0.0:1762167028.395267:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+6:58938:x1847765452088832:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167028.395292:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167028.395302:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452088960 00000100:00100000:3.0:1762167028.395315:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452088960 00010000:00010000:0.0:1762167028.395319:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cdf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4706 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167028.395384:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 675 00010000:00010000:0.0:1762167028.395392:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45f5 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167028.395405:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+10:2359:x1847765452088960:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167028.395410:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167028.395414:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167028.395420:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cdf8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4706 expref: 7 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.395452:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1762167028.395461:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1762167028.395483:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0cdea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ff expref: 10 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.395499:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45f5 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.395509:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:3.0:1762167028.395517:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167028.395525:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45f5 expref: 20 pid: 12402 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1762167028.395546:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454570368:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167028.395584:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+9:2359:x1847765452088960:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 188us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.395595:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 675 00000100:00100000:0.0:1762167028.395676:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167028.396850:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454570368:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167028.396904:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cdf8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4706 expref: 7 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.396928:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2431a1000, rc 0) 00000100:00100000:0.0:1762167028.397104:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+7:58938:x1847765452088832:12345-192.168.203.35@tcp:101:cat.0 Request processed in 1841us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.397115:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17651 00000100:00100000:1.0:1762167028.397646:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.397666:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.397753:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452089344 00000100:00100000:2.0:1762167028.397792:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452089344 00010000:00010000:2.0:1762167028.397827:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45f5 expref: 21 pid: 12402 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.397863:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7731 00000100:00100000:2.0:1762167028.397873:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765452089344:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167028.397891:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167028.397917:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45f5 expref: 21 pid: 12402 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.397955:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45f5 expref: 21 pid: 12402 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.397978:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0cc69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45f5 expref: 21 pid: 12402 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.397993:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167028.397995:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167028.398002:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cdf8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4706 expref: 6 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.398012:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cdf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4706 expref: 6 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.398056:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0cdf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4706 expref: 6 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.398071:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454570496:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167028.398156:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167028.398221:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452089216 00000100:00100000:0.0:1762167028.398254:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452089216 00000100:00100000:0.0:1762167028.398322:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20225 00000100:00100000:0.0:1762167028.398331:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:58936:x1847765452089216:12345-192.168.203.35@tcp:101:multiop.0 00010000:00010000:0.0:1762167028.398358:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167028.398384:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cdff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb470d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.398515:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.398532:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46d5 expref: 926 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.398542:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46e3 expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.398550:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ea expref: 9 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.398559:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.398591:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ea expref: 9 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.398607:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ea expref: 9 pid: 30817 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1762167028.398620:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454570624:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167028.398714:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46e3 expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.398732:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46e3 expref: 8 pid: 31205 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1762167028.398742:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454570752:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167028.398819:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46d5 expref: 926 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.398828:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46d5 expref: 926 pid: 31205 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1762167028.398837:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454570880:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167028.398862:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167028.401518:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454570624:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167028.401519:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454570496:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167028.401547:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454570752:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167028.401556:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167028.401562:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454570880:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167028.401597:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167028.401617:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.401879:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452089728 00000100:00100000:0.0:1762167028.401889:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452089728 00010000:00010000:0.0:1762167028.401933:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46d5 expref: 927 pid: 31205 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1762167028.401973:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7732 00000100:00100000:0.0:1762167028.401984:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:2358:x1847765452089728:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167028.402021:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167028.402029:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46d5 expref: 927 pid: 31205 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.402042:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46d5 expref: 927 pid: 31205 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.402070:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0cd6c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46d5 expref: 927 pid: 31205 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.402105:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.402111:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.402123:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.402129:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167028.402388:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452089344:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 4512us (4720us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.402399:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7731 00000100:00100000:2.0:1762167028.402856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.402914:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.402945:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.402974:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452089472 00000100:00100000:2.0:1762167028.403041:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452089472 00000100:00100000:0.0:1762167028.403109:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:2358:x1847765452089728:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1121us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.403121:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7732 00000100:00100000:3.0:1762167028.403129:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452089600 00000100:00100000:3.0:1762167028.403137:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452089600 00010000:00010000:3.0:1762167028.403166:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46e3 expref: 9 pid: 31205 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1762167028.403189:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452089856 00000100:00100000:0.0:1762167028.403196:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452089856 00000100:00100000:0.0:1762167028.403264:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20226 00000100:00100000:0.0:1762167028.403274:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9203c8dd-0e8f-410c-932b-b91553d6070a+10:58938:x1847765452089856:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167028.403297:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167028.403319:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ce0d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4714 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167028.403359:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7733 00000100:00100000:3.0:1762167028.403381:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+11:2361:x1847765452089600:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167028.403401:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167028.403409:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46e3 expref: 11 pid: 31205 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.403420:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ce0d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4714 expref: 11 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.403447:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ea expref: 10 pid: 30817 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.403590:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7734 00000100:00100000:2.0:1762167028.403600:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:659da189-2af3-497b-b5f5-3b42241f6905+10:2361:x1847765452089472:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167028.403610:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167028.403616:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ea expref: 10 pid: 30817 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1762167028.403895:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46e3 expref: 11 pid: 31205 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1762167028.403920:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0cd9d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46e3 expref: 11 pid: 31205 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1762167028.403950:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:3.0:1762167028.403955:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167028.403964:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167028.403971:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167028.404015:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ce0d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4714 expref: 10 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167028.404034:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+10:2361:x1847765452089600:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 660us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167028.404046:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7733 00010000:00010000:0.0:1762167028.404047:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.404054:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762167028.404059:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167028.404060:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f78aa00, rc 0) 00000100:00100000:1.0:1762167028.404117:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452090112 00000100:00100000:1.0:1762167028.404124:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452090112 00000100:00100000:0.0:1762167028.404127:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9203c8dd-0e8f-410c-932b-b91553d6070a+9:58938:x1847765452089856:12345-192.168.203.35@tcp:101:cat.0 Request processed in 853us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.404136:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20226 00000100:00100000:0.0:1762167028.404169:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20227 00000100:00100000:0.0:1762167028.404184:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9203c8dd-0e8f-410c-932b-b91553d6070a+9:58939:x1847765452090112:12345-192.168.203.35@tcp:101:multiop.0 00010000:00010000:0.0:1762167028.404196:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167028.404211:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0ce14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb471b expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.404313:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404325:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404335:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404351:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404364:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404371:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167028.404465:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ea expref: 10 pid: 30817 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.404489:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0cdb2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb46ea expref: 10 pid: 30817 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.404503:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:2.0:1762167028.404507:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167028.404515:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167028.404523:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.404539:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d94a00/0xf915a5bdf3d0ce29 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404552:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d94a00/0xf915a5bdf3d0ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404561:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d94a00/0xf915a5bdf3d0ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167028.404565:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1762167028.404573:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00000100:00100000:2.0:1762167028.404617:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:659da189-2af3-497b-b5f5-3b42241f6905+9:2361:x1847765452089472:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1015us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.404627:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7734 00010000:00010000:0.0:1762167028.404711:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404721:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404727:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404733:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b0000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167028.404737:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404745:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404756:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:0.0:1762167028.404788:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167028.404793:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404800:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404819:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404826:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404832:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404838:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b1800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167028.404840:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.404843:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167028.404866:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.404872:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404885:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee242bbaf00) 00010000:00010000:0.0:1762167028.404890:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:1.0:1762167028.404891:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 0 00010000:00010000:0.0:1762167028.404902:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404911:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167028.404969:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0ce14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb471b expref: 12 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.405008:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d94a00/0xf915a5bdf3d0ce29 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb471b expref: 11 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.405017:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.405020:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762167028.405024:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381d94a00, rc 0) 00010000:00010000:1.0:1762167028.405049:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cdff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb470d expref: 927 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.405066:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb470d expref: 926 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.405072:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:1.0:1762167028.405074:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762167028.405076:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3480efc00, rc 0) 00000100:00100000:0.0:1762167028.405648:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9203c8dd-0e8f-410c-932b-b91553d6070a+11:58939:x1847765452090112:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 1466us (1591us total) trans 8589953293 rc 0/0 00000100:00100000:0.0:1762167028.405659:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20227 00000100:00100000:1.0:1762167028.406105:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:58936:x1847765452089216:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 7766us (8457us total) trans 8589953294 rc 0/0 00000100:00100000:1.0:1762167028.406121:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20225 00000100:00100000:3.0:1762167028.410690:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.411068:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452090240 00000100:00100000:0.0:1762167028.411079:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452090240 00000100:00100000:0.0:1762167028.411162:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17652 00000100:00100000:0.0:1762167028.411173:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+6:58938:x1847765452090240:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167028.411191:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167028.411215:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0ce3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4722 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167028.411256:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x823:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167028.411279:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167028.411282:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167028.411291:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0ce3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4722 expref: 7 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.411317:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0ce3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4722 expref: 7 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.411363:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228400, rc 0) 00000100:00100000:0.0:1762167028.411436:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+7:58938:x1847765452090240:12345-192.168.203.35@tcp:101:cat.0 Request processed in 265us (760us total) trans 0 rc 0/0 00000100:00080000:1.0:1762167028.411444:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762167028.411445:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17652 00000100:00100000:3.0:1762167028.413752:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.414161:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452090368 00000100:00100000:2.0:1762167028.414172:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452090368 00002000:00100000:2.0:1762167028.414218:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x823:0x0] (0->4095) req@ffff9ee24240c700 x1847765452090368/t0(0) o3->9203c8dd-0e8f-410c-932b-b91553d6070a@192.168.203.35@tcp:59/0 lens 488/0 e 0 to 0 dl 1762167039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167028.414230:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240c700 with x1847765452090368 ext(0->4095) 00002000:00010000:2.0:1762167028.414244:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240c700 00000100:00100000:2.0:1762167028.414329:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3279 00000100:00100000:2.0:1762167028.414374:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9203c8dd-0e8f-410c-932b-b91553d6070a+7:2359:x1847765452090368:12345-192.168.203.35@tcp:3:cat.0 00000100:00100000:2.0:1762167028.414593:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9203c8dd-0e8f-410c-932b-b91553d6070a+7:2359:x1847765452090368:12345-192.168.203.35@tcp:3:cat.0 Request processed in 254us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.414601:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3279 00002000:00100000:2.0:1762167028.414608:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x823:0x0] (0->4095) req@ffff9ee24240c700 x1847765452090368/t0(0) o3->9203c8dd-0e8f-410c-932b-b91553d6070a@192.168.203.35@tcp:59/0 lens 488/440 e 0 to 0 dl 1762167039 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167028.414617:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240c700 with x1847765452090368 ext(0->4095) 00002000:00010000:2.0:1762167028.414620:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240c700 00000100:00100000:3.0:1762167028.417020:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.417124:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452090624 00000100:00100000:2.0:1762167028.417132:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452090624 00000100:00100000:2.0:1762167028.417187:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7442 00000100:00100000:2.0:1762167028.417197:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9203c8dd-0e8f-410c-932b-b91553d6070a+11:58938:x1847765452090624:12345-192.168.203.35@tcp:35:cat.0 00000100:00100000:2.0:1762167028.417589:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9203c8dd-0e8f-410c-932b-b91553d6070a+12:58938:x1847765452090624:12345-192.168.203.35@tcp:35:cat.0 Request processed in 393us (576us total) trans 8589953295 rc 0/0 00000100:00100000:2.0:1762167028.417597:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7442 00000100:00100000:3.0:1762167028.496397:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.496539:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452090880 00000100:00100000:1.0:1762167028.496549:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452090880 00000100:00100000:1.0:1762167028.496672:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20228 00000100:00100000:1.0:1762167028.496698:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9203c8dd-0e8f-410c-932b-b91553d6070a+12:58939:x1847765452090880:12345-192.168.203.35@tcp:101:multiop.0 00010000:00010000:1.0:1762167028.496724:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.496728:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762167028.496754:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d94a00/0xf915a5bdf3d0ce29 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb471b expref: 12 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.496820:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f78aa00/0xf915a5bdf3d0ce0d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4714 expref: 11 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.496832:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:1.0:1762167028.496836:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167028.496851:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ce45 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4729 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.496907:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167028.496920:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45fc expref: 925 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.496928:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167028.496961:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45fc expref: 925 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.496973:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45fc expref: 925 pid: 30817 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1762167028.497104:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454571008:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167028.497194:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2433596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167028.500892:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454571008:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167028.500923:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167028.501549:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.503184:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452091008 00000100:00100000:2.0:1762167028.503201:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452091008 00010000:00010000:2.0:1762167028.503265:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45fc expref: 926 pid: 30817 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.503317:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7735 00000100:00100000:2.0:1762167028.503332:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:2361:x1847765452091008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167028.503353:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167028.503363:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45fc expref: 926 pid: 30817 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.503378:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45fc expref: 926 pid: 30817 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.503405:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0cc7e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb45fc expref: 926 pid: 30817 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.503426:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:2.0:1762167028.503433:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167028.503444:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167028.503452:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167028.503506:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167028.503575:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:2361:x1847765452091008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 248us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.503600:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7735 00010000:00010000:0.0:1762167028.504187:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167028.504197:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00080000:0.0:1762167028.504703:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x824:0x0], index 0: 0 00000004:00080000:0.0:1762167028.504719:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x825:0x0], index 0: 0 00000004:00080000:0.0:1762167028.504730:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x828:0x0], index 1: 0 00000040:00080000:0.0:1762167028.504937:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5710, 88 off462728 00000004:00080000:0.0:1762167028.504953:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649297189408ns, next at 649672216544ns, rc = 0 00000040:00080000:0.0:1762167028.505043:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5702, 88 off461672 00000004:00080000:0.0:1762167028.505055:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649297292274ns, next at 649672385103ns, rc = 0 00000040:00080000:0.0:1762167028.505111:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5703, 88 off461760 00000004:00080000:0.0:1762167028.505120:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649297356758ns, next at 649672385103ns, rc = 0 00000040:00080000:0.0:1762167028.505149:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5711, 88 off462816 00000004:00080000:0.0:1762167028.505156:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649297393328ns, next at 649672216544ns, rc = 0 00000040:00080000:0.0:1762167028.505184:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5704, 88 off461848 00000004:00080000:0.0:1762167028.505191:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 649297428142ns, next at 649672385103ns, rc = 0 00000040:00080000:0.0:1762167028.505219:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5712, 88 off462904 00000004:00080000:0.0:1762167028.505226:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649297462932ns, next at 649672216544ns, rc = 0 00000100:00100000:3.0:1762167028.514173:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.514259:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452091264 00000100:00100000:3.0:1762167028.514270:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452091264 00000100:00100000:3.0:1762167028.514333:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20229 00000100:00100000:3.0:1762167028.514348:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:58945:x1847765452091264:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:3.0:1762167028.514377:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167028.514400:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0ce53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4730 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.514490:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.514530:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.514545:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.514564:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.514574:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.514581:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.514853:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.514867:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.514875:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167028.514888:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 2991457 00010000:00010000:3.0:1762167028.515052:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515062:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515069:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515090:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.515096:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515104:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515120:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:3.0:1762167028.515124:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1762167028.515130:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515137:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ce68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515157:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515164:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515169:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515174:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.515177:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515183:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515191:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167028.515194:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.515209:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515215:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0ce5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515227:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515247:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515254:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515259:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167028.515261:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515267:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515276:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee345a77200) 00010000:00010000:3.0:1762167028.515278:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167028.515281:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515287:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ce61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167028.515344:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0ce53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4730 expref: 927 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.515357:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167028.515370:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762167028.515377:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0ce53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4730 expref: 927 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167028.515392:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167028.515469:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:58945:x1847765452091264:12345-192.168.203.35@tcp:101:cat.0 Request processed in 1123us (1307us total) trans 8589953297 rc 301/301 00000100:00100000:3.0:1762167028.515479:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20229 00000100:00100000:0.0:1762167028.521619:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.522299:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452091392 00000100:00100000:2.0:1762167028.522321:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452091392 00000100:00100000:2.0:1762167028.522382:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20230 00000100:00100000:2.0:1762167028.522396:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:58945:x1847765452091392:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:2.0:1762167028.522419:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167028.522438:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ce76 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4737 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.522520:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167028.522536:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb470d expref: 927 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.522546:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167028.522553:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 5/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167028.522572:0:30817:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167028.522599:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb470d expref: 927 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.522612:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb470d expref: 927 pid: 32138 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.522640:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454571136:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167028.522737:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243596e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167028.529260:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454571136:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167028.529267:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167028.529296:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167028.529357:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452091520 00000100:00100000:2.0:1762167028.529365:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452091520 00010000:00010000:2.0:1762167028.529396:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb470d expref: 928 pid: 32138 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.529436:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7736 00000100:00100000:2.0:1762167028.529443:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:2358:x1847765452091520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167028.529459:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167028.529472:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb470d expref: 928 pid: 32138 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.529486:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb470d expref: 928 pid: 32138 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.529506:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0ce06 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x652:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb470d expref: 928 pid: 32138 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.529523:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:2.0:1762167028.529527:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167028.529553:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167028.529561:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167028.529565:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167028.529621:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:2358:x1847765452091520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 179us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.529626:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7736 00000100:00100000:1.0:1762167028.540012:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.540066:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.540097:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452091648 00000100:00100000:1.0:1762167028.540112:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452091648 00000100:00100000:0.0:1762167028.540174:0:33893:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452091904 00000100:00100000:0.0:1762167028.540179:0:33893:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452091904 00000100:00100000:1.0:1762167028.540183:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20231 00000100:00100000:1.0:1762167028.540195:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:58936:x1847765452091648:12345-192.168.203.35@tcp:101:multiop.0 00010000:00010000:1.0:1762167028.540214:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167028.540219:0:33893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20232 00000100:00100000:2.0:1762167028.540229:0:30818:0:(service.c:3434:ptlrpc_start_thread()) mdt[0] started 6 min 3 max 116 00000100:00100000:0.0:1762167028.540229:0:33893:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+13:58948:x1847765452091904:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167028.540256:0:33893:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762167028.540258:0:30818:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt00_006' 00010000:00010000:1.0:1762167028.540259:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ce84 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb473e expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.540270:0:33893:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4745 expref: -99 pid: 33893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.540329:0:31205:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ce84 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb473e expref: 928 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.540336:0:33893:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33893 initiator: MDT0 00010000:00010000:1.0:1762167028.540346:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ce84 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb473e expref: 928 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.540350:0:33893:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33893 initiator: MDT0 00010000:00010000:1.0:1762167028.540367:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.540368:0:33893:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00010000:00010000:1.0:1762167028.540374:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167028.540382:0:31205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ce84 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb473e expref: 928 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.540390:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ef3600, rc 0) 00010000:00010000:0.0:1762167028.540391:0:33893:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540399:0:33893:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540405:0:33893:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00000100:00100000:1.0:1762167028.540458:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:58936:x1847765452091648:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 252us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.540476:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20231 00010000:00010000:0.0:1762167028.540643:0:33893:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540652:0:33893:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540670:0:33893:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00000004:00200000:0.0:1762167028.540679:0:33893:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 2991457 00010000:00010000:0.0:1762167028.540756:0:33893:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540791:0:33893:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540798:0:33893:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540804:0:33893:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3729ef200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167028.540808:0:33893:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540815:0:33893:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540825:0:33893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.540827:0:33893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1762167028.540830:0:33893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167028.540837:0:33893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167028.540843:0:33893:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540849:0:33893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3729ef200/0xf915a5bdf3d0cea0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540871:0:33893:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540877:0:33893:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540883:0:33893:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540887:0:33893:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b1800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167028.540890:0:33893:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540895:0:33893:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540901:0:33893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:0.0:1762167028.540903:0:33893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167028.540906:0:33893:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540911:0:33893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ce92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540918:0:33893:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540923:0:33893:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540928:0:33893:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540933:0:33893:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b0200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167028.540940:0:33893:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540946:0:33893:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540953:0:33893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ffdc7bb (ffff9ee242bba100) 00010000:00010000:0.0:1762167028.540956:0:33893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167028.540959:0:33893:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.540965:0:33893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ce99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ffdc7bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.541001:0:33893:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4745 expref: 15 pid: 33893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.541012:0:33893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:0.0:1762167028.541015:0:33893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762167028.541019:0:33893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ce8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4745 expref: 15 pid: 33893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.541029:0:33893:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b0000, rc 0) 00000100:00100000:0.0:1762167028.541068:0:33893:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+14:58948:x1847765452091904:12345-192.168.203.35@tcp:101:cat.0 Request processed in 841us (1004us total) trans 8589953298 rc 301/301 00000100:00100000:0.0:1762167028.541075:0:33893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20232 00000100:00100000:0.0:1762167028.544051:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.544104:0:33893:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452092032 00000100:00100000:2.0:1762167028.544115:0:33893:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452092032 00000100:00100000:2.0:1762167028.544170:0:33893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20233 00000100:00100000:2.0:1762167028.544181:0:33893:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+14:58948:x1847765452092032:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:2.0:1762167028.544200:0:33893:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167028.544218:0:33893:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0ceae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb474c expref: -99 pid: 33893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.544323:0:33893:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33893 initiator: MDT0 00010000:00010000:2.0:1762167028.544336:0:33893:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33893 initiator: MDT0 00010000:00010000:2.0:1762167028.544357:0:33893:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00000001:00080000:1.0:1762167028.545161:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953296 is committed 00000004:00080000:1.0:1762167028.545168:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3812 committed 00010000:00010000:0.0:1762167028.545174:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4729 expref: 15 pid: 32138 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167028.545182:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3799 committed 00010000:00010000:0.0:1762167028.545186:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00000004:00080000:1.0:1762167028.545195:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3811 committed 00000004:00080000:1.0:1762167028.545197:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3798 committed 00010000:00010000:0.0:1762167028.545197:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1762167028.545200:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3797 committed 00010000:00010000:0.0:1762167028.545201:0:32138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00080000:1.0:1762167028.545202:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3810 committed 00010000:00010000:0.0:1762167028.545209:0:32138:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167028.545214:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953288 is committed 00010000:00010000:0.0:1762167028.545216:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00000001:00100000:1.0:1762167028.545220:0:30849:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 659da189-2af3-497b-b5f5-3b42241f6905 00010000:00010000:0.0:1762167028.545222:0:32138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00000001:00100000:1.0:1762167028.545225:0:30849:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9203c8dd-0e8f-410c-932b-b91553d6070a 00010000:00010000:0.0:1762167028.545228:0:32138:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.545242:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 33893 initiator: MDT0 00000004:00080000:1.0:1762167028.545244:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3809 committed 00010000:00010000:0.0:1762167028.545251:0:32138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ce84 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb473e expref: 922 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.545259:0:32138:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ce84 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb473e expref: 917 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.545265:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ce84 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb473e expref: 914 pid: 31205 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167028.545281:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953294 is committed 00000001:00080000:1.0:1762167028.545287:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953290 is committed 00010000:00010000:0.0:1762167028.545296:0:32138:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ce84 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb473e expref: 904 pid: 31205 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167028.545298:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3796 committed 00000100:00100000:0.0:1762167028.545309:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454571264:192.168.203.35@tcp:105: 00000020:00080000:1.0:1762167028.545329:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee37fca8f00 refcount 2 committed 0 result 0 batchid 4294969188 00000020:00080000:1.0:1762167028.545333:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee243949e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37fca83c0 00000020:00080000:1.0:1762167028.545336:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee243949300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee24baae800 00000100:00100000:0.0:1762167028.545391:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c540 going to sleep for 11 seconds 00000020:00080000:0.0:1762167028.545409:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969188 committed batchid 4294969187 00000020:00080000:0.0:1762167028.545581:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969187 00010000:00010000:0.0:1762167028.545594:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167028.545600:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167028.545633:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 2991457 00000004:00200000:0.0:1762167028.545638:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1762167028.545651:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454571648:0@lo:6:osp-syn-0-0.0 00000004:00010000:0.0:1762167028.545655:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167028.545681:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ce76 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4737 expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.545695:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167028.545696:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0ce7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4737 expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.545703:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.545705:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762167028.545708:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167028.545718:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1762167028.545723:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454571520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167028.545740:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167028.545741:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58945:x1847765452091392:12345-192.168.203.35@tcp:101:cat.0 Request processed in 23350us (24134us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.545749:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20230 00000100:00100000:2.0:1762167028.545753:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454572032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167028.545801:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167028.545803:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454571776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167028.545824:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454571648 00000100:00100000:0.0:1762167028.545825:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167028.545829:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454571648 00000100:00100000:0.0:1762167028.545849:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1762167028.545854:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454571392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167028.545856:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454571520 00000100:00100000:2.0:1762167028.545859:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454571520 00000100:00100000:2.0:1762167028.545875:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454572032 00000100:00100000:0.0:1762167028.545875:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167028.545877:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454572032 00000100:00100000:2.0:1762167028.545892:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454571776 00000100:00100000:2.0:1762167028.545894:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454571776 00000100:00100000:0.0:1762167028.545897:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454571904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167028.545907:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454571392 00000100:00100000:2.0:1762167028.545909:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454571392 00000100:00100000:0.0:1762167028.545915:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167028.545923:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454571904 00000100:00100000:2.0:1762167028.545925:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454571904 00000100:00100000:2.0:1762167028.545941:0:34501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17653 00000100:00100000:2.0:1762167028.545948:0:34501:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454571648:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762167028.546186:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454572416:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762167028.546247:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167028.546252:0:34499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454572416 00000100:00100000:3.0:1762167028.546256:0:34499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454572416 00000100:00100000:1.0:1762167028.546263:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1762167028.546268:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454572288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762167028.546293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167028.546302:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454572800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167028.546315:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1762167028.546352:0:34501:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2080 count 1 00000100:00100000:1.0:1762167028.546381:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454572288 00000100:00100000:1.0:1762167028.546384:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454572288 00010000:00010000:2.0:1762167028.546419:0:34501:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.546434:0:34501:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44eb expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.546441:0:34501:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167028.546443:0:34501:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167028.546446:0:34501:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.546471:0:34501:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000080010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44eb expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.546482:0:34501:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44eb expref: 12 pid: 26444 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.546500:0:34501:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:34501:1847765454572928:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167028.546534:0:34501:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee346b14840 going to sleep for 11 seconds 00000100:00100000:2.0:1762167028.546755:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454572800 00000100:00100000:2.0:1762167028.546758:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454572800 00000100:00100000:0.0:1762167028.546849:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17654 00000100:00100000:0.0:1762167028.546857:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454571520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1762167028.546872:0:12402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2082 count 1 00010000:00010000:0.0:1762167028.546882:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167028.546908:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17655 00000100:00100000:3.0:1762167028.546916:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454572032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167028.546950:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17656 00010000:00010000:0.0:1762167028.546952:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44d6 expref: 12 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167028.546956:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454571776:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762167028.546959:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167028.546961:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167028.546963:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.546980:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000080010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44d6 expref: 12 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.546989:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44d6 expref: 12 pid: 33892 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1762167028.546998:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454573056:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167028.547028:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167028.547045:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17657 00000100:00100000:0.0:1762167028.547052:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454571392:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167028.547060:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17658 00002000:00080000:0.0:1762167028.547065:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2081 count 1 00000100:00100000:2.0:1762167028.547066:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454571904:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762167028.547082:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.547093:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.547099:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167028.547100:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167028.547103:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 4/0,1 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.547108:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17659 00000100:00100000:2.0:1762167028.547114:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765454572416:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762167028.547120:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 12 pid: 26444 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1762167028.547125:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2085 count 1 00010000:00010000:0.0:1762167028.547128:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 12 pid: 26444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.547135:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167028.547137:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454573184:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167028.547146:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44dd expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.547152:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167028.547153:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167028.547156:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167028.547158:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1762167028.547175:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17660 00000100:00100000:0.0:1762167028.547181:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765454572288:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762167028.547184:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000080010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44dd expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1762167028.547191:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2082 count 1 00010000:00010000:2.0:1762167028.547193:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x70000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44dd expref: 19 pid: 33892 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.547201:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.547202:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454573312:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167028.547211:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44cf expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.547224:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1762167028.547228:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167028.547229:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167028.547232:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.547249:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454572160:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762167028.547261:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44cf expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.547269:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44cf expref: 19 pid: 33892 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.547278:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167028.547278:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454573440:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167028.547292:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454572672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167028.547299:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167028.547306:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167028.547319:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762167028.547324:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454572544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167028.547342:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167028.547506:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454571776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 550us (1679us total) trans 21474843750 rc 0/0 00000100:00100000:1.0:1762167028.547512:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17656 00002000:00010000:3.0:1762167028.547646:0:34499:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x823:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167028.547653:0:34499:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x823:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1762167028.547655:0:34499:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x823:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762167028.547660:0:34499:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x823:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1762167028.547662:0:34499:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x823:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167028.547706:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454572032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 789us (1901us total) trans 21474843751 rc 0/0 00000100:00100000:3.0:1762167028.547715:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17655 00000004:00080000:2.0:1762167028.548248:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550e680/2, rc 0, transno 21474843751 00000100:00100000:2.0:1762167028.548256:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454572032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167028.548473:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454572160 00000100:00100000:1.0:1762167028.548482:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454572160 00000100:00100000:3.0:1762167028.548490:0:34499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454572672 00000100:00100000:3.0:1762167028.548494:0:34499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454572672 00000100:00100000:1.0:1762167028.548502:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454572544 00000100:00100000:1.0:1762167028.548504:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454572544 00000100:00100000:3.0:1762167028.548510:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17661 00000100:00100000:3.0:1762167028.548516:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454572800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167028.548660:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454572800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (2343us total) trans 17179876172 rc 0/0 00000100:00100000:2.0:1762167028.548783:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454571904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1715us (2865us total) trans 21474843752 rc 0/0 00000100:00100000:1.0:1762167028.548858:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17662 00000100:00100000:1.0:1762167028.548866:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454572160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1762167028.548877:0:12400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2084 count 1 00010000:00010000:1.0:1762167028.548890:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.548903:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.548911:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167028.548912:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167028.548915:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.548937:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 19 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.548946:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 19 pid: 26444 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1762167028.548967:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454573568:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167028.549007:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167028.549438:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17661 00000100:00100000:1.0:1762167028.549466:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167028.549467:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17663 00000100:00100000:3.0:1762167028.549474:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454572672:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167028.549579:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aaa680/2, rc 0, transno 17179876172 00000100:00100000:1.0:1762167028.549585:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454572800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167028.549609:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454572672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (2300us total) trans 17179876173 rc 0/0 00000100:00100000:3.0:1762167028.549615:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17663 00000004:00080000:1.0:1762167028.549617:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aaaa00/2, rc 0, transno 17179876173 00000100:00100000:1.0:1762167028.549621:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454572672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167028.549627:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17664 00000100:00100000:3.0:1762167028.549633:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454572544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167028.549708:0:34499:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167028.549712:0:34499:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb mtime from disk: 1762167027 -> 1762167027 00002000:00010000:3.0:1762167028.549714:0:34499:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb atime from disk: 1762167027 -> 1762167027 00002000:00010000:3.0:1762167028.549716:0:34499:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb ctime from disk: 1762167028 -> 1762167028 00002000:00010000:3.0:1762167028.549719:0:34499:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x826:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167028.549746:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17658 00000100:00100000:2.0:1762167028.549794:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452092160 00000100:00100000:2.0:1762167028.549799:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452092160 00000004:00080000:0.0:1762167028.549808:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcce300/2, rc 0, transno 21474843752 00000100:00100000:0.0:1762167028.549813:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454571904:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167028.549823:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccc380/2, rc 0, transno 21474843750 00000100:00100000:2.0:1762167028.549824:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7443 00000100:00100000:0.0:1762167028.549826:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454571776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167028.549830:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58936:x1847765452092160:12345-192.168.203.35@tcp:49:multiop.0 00000100:00100000:0.0:1762167028.549850:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454571264:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762167028.549878:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ce45 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x652:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4729 expref: 11 pid: 32138 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1762167028.549897:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ce4c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x652:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4729 expref: 10 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.549911:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58936:x1847765452092160:12345-192.168.203.35@tcp:49:multiop.0 Request processed in 81us (445us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167028.549915:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ef2800, rc 0) 00000100:00100000:2.0:1762167028.549917:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7443 00000100:00100000:0.0:1762167028.549942:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9203c8dd-0e8f-410c-932b-b91553d6070a+10:58939:x1847765452090880:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 53247us (53558us total) trans 8589953296 rc 0/0 00000100:00100000:0.0:1762167028.549949:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20228 00010000:00010000:0.0:1762167028.549996:0:33893:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.550004:0:33893:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00000004:00200000:0.0:1762167028.550031:0:33893:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x652:0x0]: returning size 2991457 00000004:00200000:0.0:1762167028.550035:0:33893:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167028.550049:0:33893:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167028.550072:0:33893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0ceae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x652:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb474c expref: 10 pid: 33893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.550084:0:33893:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ceb5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x652:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb474c expref: 9 pid: 33893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.550092:0:33893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x652:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167028.550095:0:33893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762167028.550097:0:33893:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:0.0:1762167028.550135:0:33893:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9203c8dd-0e8f-410c-932b-b91553d6070a+9:58948:x1847765452092032:12345-192.168.203.35@tcp:101:cat.0 Request processed in 5955us (6092us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.550141:0:33893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20233 00000100:00100000:3.0:1762167028.550287:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454572544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 653us (2942us total) trans 17179876174 rc 0/0 00000100:00100000:3.0:1762167028.550294:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17664 00000004:00080000:0.0:1762167028.550374:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aaa300/2, rc 0, transno 17179876174 00000100:00100000:0.0:1762167028.550378:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454572544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167028.551350:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.551479:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452092288 00000100:00100000:1.0:1762167028.551487:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452092288 00000100:00100000:1.0:1762167028.551536:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7444 00000100:00100000:1.0:1762167028.551546:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58945:x1847765452092288:12345-192.168.203.35@tcp:49:cat.0 00000100:00100000:1.0:1762167028.551643:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58945:x1847765452092288:12345-192.168.203.35@tcp:49:cat.0 Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.551650:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7444 00000100:00100000:0.0:1762167028.552647:0:34501:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:34501:1847765454572928:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167028.552679:0:34501:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167028.553327:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454573184:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167028.553343:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167028.553907:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454573312:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167028.553924:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.554948:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.554979:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.555004:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.555792:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452092416 00000100:00100000:0.0:1762167028.555801:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452092416 00010000:00010000:0.0:1762167028.555842:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44eb expref: 13 pid: 26444 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.555859:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.555879:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452092672 00000100:00100000:0.0:1762167028.555884:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452092672 00010000:00010000:0.0:1762167028.555903:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44dd expref: 20 pid: 33892 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.555910:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.555933:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452092544 00000100:00100000:2.0:1762167028.555936:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.555939:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452092544 00000100:00100000:2.0:1762167028.555954:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167028.555962:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 14 pid: 26444 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.555972:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.555979:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452092800 00000100:00100000:0.0:1762167028.555984:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452092800 00000100:00100000:2.0:1762167028.555994:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167028.556001:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44cf expref: 21 pid: 33892 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.556014:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.556017:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452092928 00000100:00100000:2.0:1762167028.556032:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.556034:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452092928 00000100:00100000:2.0:1762167028.556055:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167028.556056:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44d6 expref: 15 pid: 33892 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.556073:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.556075:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452093312 00000100:00100000:0.0:1762167028.556080:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452093312 00010000:00010000:0.0:1762167028.556096:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 22 pid: 26444 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.556109:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.556116:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7737 00000100:00100000:0.0:1762167028.556127:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2359:x1847765452092416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167028.556133:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7738 00010000:00010000:0.0:1762167028.556143:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762167028.556144:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765452092672:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167028.556153:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44eb expref: 15 pid: 26444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.556158:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167028.556168:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44dd expref: 22 pid: 33892 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.556172:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44eb expref: 15 pid: 26444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.556190:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44dd expref: 22 pid: 33892 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.556207:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee38216cc00/0xf915a5bdf3d0c8fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44eb expref: 15 pid: 26444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.556225:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c8e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44dd expref: 22 pid: 33892 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.556227:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167028.556232:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167028.556250:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167028.556250:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.556254:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167028.556260:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.556264:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.556303:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167028.556323:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.556345:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167028.556355:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2359:x1847765452092416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 230us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.556365:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7737 00000100:00100000:2.0:1762167028.556372:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765452092672:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 230us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.556381:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7738 00000100:00100000:0.0:1762167028.556387:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7739 00000100:00100000:0.0:1762167028.556397:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2359:x1847765452092544:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167028.556404:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7740 00010000:00010000:0.0:1762167028.556406:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167028.556412:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 13 pid: 26444 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.556418:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765452092800:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167028.556428:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 13 pid: 26444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.556431:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167028.556440:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44cf expref: 20 pid: 33892 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.556448:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4507 expref: 13 pid: 26444 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1762167028.556455:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44cf expref: 20 pid: 33892 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.556463:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167028.556466:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167028.556470:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.556472:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167028.556477:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167028.556480:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.556489:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.556499:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.556501:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167028.556518:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167028.556523:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2359:x1847765452092544:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 127us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.556537:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7739 00000100:00100000:2.0:1762167028.556547:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765452092800:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 132us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167028.556554:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7741 00000100:00100000:0.0:1762167028.557149:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765452092928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167028.557164:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167028.557170:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44d6 expref: 11 pid: 33892 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.557182:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x50000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44d6 expref: 11 pid: 33892 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1762167028.557197:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167028.557199:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167028.557207:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.557215:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.557229:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167028.557263:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765452092928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 701us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.557932:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7740 00000100:00100000:1.0:1762167028.558075:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7742 00000100:00100000:1.0:1762167028.558100:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452093312:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167028.558112:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167028.558119:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 20 pid: 26444 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1762167028.558143:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 20 pid: 26444 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1762167028.558160:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167028.558161:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167028.558164:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.558171:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.558185:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167028.558210:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452093312:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 118us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.558217:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7742 00000100:00100000:1.0:1762167028.558293:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452093440 00000100:00100000:1.0:1762167028.558299:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452093440 00000100:00100000:1.0:1762167028.558326:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452093568 00000100:00100000:1.0:1762167028.558329:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452093568 00000100:00100000:1.0:1762167028.558346:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452093824 00000100:00100000:1.0:1762167028.558349:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452093824 00000100:00100000:2.0:1762167028.558359:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452093696 00000100:00100000:1.0:1762167028.558364:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452094080 00000100:00100000:2.0:1762167028.558366:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452093696 00000100:00100000:1.0:1762167028.558368:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452094080 00000100:00100000:1.0:1762167028.558393:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452093952 00000100:00100000:2.0:1762167028.558396:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452094208 00000100:00100000:1.0:1762167028.558397:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452093952 00000100:00100000:2.0:1762167028.558403:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452094208 00000100:00100000:1.0:1762167028.558418:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17665 00000100:00100000:1.0:1762167028.558427:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9203c8dd-0e8f-410c-932b-b91553d6070a+8:2361:x1847765452093440:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:1.0:1762167028.558439:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.558461:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0cee6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4753 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167028.558483:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x824:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167028.558495:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167028.558497:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167028.558504:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0cee6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4753 expref: 9 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167028.558518:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0cee6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4753 expref: 9 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167028.558530:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:1.0:1762167028.558552:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9203c8dd-0e8f-410c-932b-b91553d6070a+9:2361:x1847765452093440:12345-192.168.203.35@tcp:101:cat.0 Request processed in 127us (2581us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.558585:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17665 00000100:00100000:2.0:1762167028.558596:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17666 00000100:00100000:1.0:1762167028.558606:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17667 00000100:00100000:2.0:1762167028.558609:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765452093568:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:2.0:1762167028.558619:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167028.558619:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2358:x1847765452093824:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:1.0:1762167028.558630:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167028.558632:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ceed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb475a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.558640:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0cef4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb476f expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.558649:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167028.558652:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1762167028.558656:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x825:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762167028.558659:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ceed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb475a expref: 21 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167028.558667:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167028.558671:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167028.558675:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ceed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb475a expref: 21 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167028.558680:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0cef4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb476f expref: 14 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167028.558692:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167028.558725:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765452093568:12345-192.168.203.35@tcp:101:cat.0 Request processed in 121us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.558732:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17666 00000100:00100000:2.0:1762167028.558748:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17668 00010000:00010000:1.0:1762167028.558752:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0cef4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb476f expref: 14 pid: 33892 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762167028.558787:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2358:x1847765452093696:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:1.0:1762167028.558789:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8800, rc 0) 00010000:00010000:2.0:1762167028.558799:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167028.558807:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2358:x1847765452093824:12345-192.168.203.35@tcp:101:cat.0 Request processed in 193us (2794us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167028.558810:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0cefb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4761 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167028.558813:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17667 00000100:00100000:1.0:1762167028.558827:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17669 00010000:00010000:2.0:1762167028.558829:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167028.558832:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762167028.558835:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765452094080:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:2.0:1762167028.558841:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0cefb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4761 expref: 14 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167028.558842:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.558850:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0cf02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x828:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4776 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.558857:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0cefb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4761 expref: 14 pid: 6532 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1762167028.558863:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x828:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762167028.558871:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00010000:00010000:1.0:1762167028.558873:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167028.558876:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167028.558880:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0cf02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4776 expref: 21 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167028.558889:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0cf02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4776 expref: 21 pid: 33892 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762167028.558896:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2358:x1847765452093696:12345-192.168.203.35@tcp:101:cat.0 Request processed in 136us (2861us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167028.558898:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:2.0:1762167028.558907:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17668 00000100:00100000:1.0:1762167028.558913:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765452094080:12345-192.168.203.35@tcp:101:cat.0 Request processed in 80us (2860us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.558925:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17669 00000100:00100000:2.0:1762167028.558930:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17670 00000100:00100000:1.0:1762167028.558941:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17671 00000100:00100000:2.0:1762167028.558944:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+8:2360:x1847765452093952:12345-192.168.203.35@tcp:101:cat.0 00000100:00100000:1.0:1762167028.558951:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9203c8dd-0e8f-410c-932b-b91553d6070a+7:2361:x1847765452094208:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:2.0:1762167028.558954:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167028.558957:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167028.558965:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cf09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4768 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.558965:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0cf10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x828:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb477d expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.558985:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167028.558987:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167028.558990:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0cf10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb477d expref: 8 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167028.559008:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0cf10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb477d expref: 8 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167028.559015:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9e00, rc 0) 00010000:00010000:2.0:1762167028.559019:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167028.559022:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762167028.559026:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9203c8dd-0e8f-410c-932b-b91553d6070a+8:2361:x1847765452094208:12345-192.168.203.35@tcp:101:cat.0 Request processed in 78us (2920us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167028.559030:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cf09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4768 expref: 9 pid: 6532 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167028.559034:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17671 00010000:00010000:2.0:1762167028.559049:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0cf09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4768 expref: 9 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167028.559059:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d000, rc 0) 00000100:00100000:2.0:1762167028.559080:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9203c8dd-0e8f-410c-932b-b91553d6070a+9:2360:x1847765452093952:12345-192.168.203.35@tcp:101:cat.0 Request processed in 141us (3008us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167028.559084:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0c8d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44cf expref: 20 pid: 33892 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.559091:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17670 00000100:00100000:1.0:1762167028.559107:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454573440:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167028.559130:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.559135:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452093184 00000100:00100000:2.0:1762167028.559141:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452093184 00010000:00010000:1.0:1762167028.559154:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.559161:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.559170:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.559176:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7445 00010000:00010000:1.0:1762167028.559184:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167028.559190:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342feac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9203c8dd-0e8f-410c-932b-b91553d6070a+9:58939:x1847765452093184:12345-192.168.203.35@tcp:35:multiop.0 00010000:00010000:1.0:1762167028.559210:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762167028.559383:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342feac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9203c8dd-0e8f-410c-932b-b91553d6070a+10:58939:x1847765452093184:12345-192.168.203.35@tcp:35:multiop.0 Request processed in 196us (3525us total) trans 8589953299 rc 0/0 00000100:00100000:2.0:1762167028.559391:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7445 00010000:00010000:2.0:1762167028.559438:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.559448:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.559468:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.559476:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167028.559490:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454572288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12307us (13193us total) trans 17179876175 rc 0/0 00010000:00010000:2.0:1762167028.559494:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1762167028.559500:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17660 00000004:00080000:1.0:1762167028.559547:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240d180/2, rc 0, transno 17179876175 00000100:00100000:1.0:1762167028.559554:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454572288:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762167028.559580:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c8db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb44d6 expref: 13 pid: 33892 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1762167028.559590:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454573056:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167028.559601:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.559620:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.559627:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.559636:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.559643:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.559666:0:12402:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1762167028.559883:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454572416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12767us (13646us total) trans 17179876176 rc 0/0 00000100:00100000:2.0:1762167028.559891:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17659 00010000:00010000:2.0:1762167028.559914:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1762167028.559920:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.559927:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3456a4c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167028.559932:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.559942:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.559956:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.559963:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3456a4c00/0xf915a5bdf3d0ced8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.559992:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762167028.559995:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560001:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167028.560005:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560013:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560023:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560030:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0ced1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167028.560036:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454571520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13178us (14293us total) trans 21474843753 rc 0/0 00010000:00010000:2.0:1762167028.560044:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1762167028.560045:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17654 00010000:00010000:2.0:1762167028.560049:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560056:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3729ee800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167028.560059:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560066:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.560069:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167028.560083:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560089:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3729ee800/0xf915a5bdf3d0cec3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.560099:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560102:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167028.560104:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167028.560107:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167028.560113:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.560122:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762167028.560135:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aa9880/2, rc 0, transno 17179876176 00000100:00100000:2.0:1762167028.560140:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454572416:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762167028.560167:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0c91a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4500 expref: 19 pid: 26444 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1762167028.560178:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454573568:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167028.560188:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560195:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560201:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560208:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560220:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560245:0:12400:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167028.560292:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.560303:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1762167028.560425:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454572160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11558us (13144us total) trans 17179876177 rc 0/0 00000100:00100000:2.0:1762167028.560432:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17662 00010000:00010000:2.0:1762167028.560450:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762167028.560460:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560467:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2431a1e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167028.560471:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560479:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560491:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560498:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0cedf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167028.560507:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454571392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13453us (14629us total) trans 21474843754 rc 0/0 00010000:00010000:2.0:1762167028.560514:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1762167028.560515:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17657 00010000:00010000:2.0:1762167028.560519:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560532:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3456a5000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167028.560536:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167028.560537:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560546:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.560551:0:34501:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560557:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167028.560558:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7741 00010000:00010000:1.0:1762167028.560571:0:34501:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560573:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3456a5000/0xf915a5bdf3d0ceca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167028.560584:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167028.560589:0:34501:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167028.560599:0:34501:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560600:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167028.560603:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167028.560607:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762167028.560615:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff80e00/2, rc 0, transno 21474843754 00010000:00010000:1.0:1762167028.560619:0:34501:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762167028.560622:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1762167028.560624:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454571392:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762167028.560628:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560636:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167028.560639:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560645:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560664:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560670:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0cebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167028.560682:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167028.560683:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167028.560685:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1762167028.560715:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240e300/2, rc 0, transno 17179876177 00000100:00100000:3.0:1762167028.560722:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454572160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762167028.560942:0:34501:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454571648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14994us (15246us total) trans 21474843755 rc 0/0 00000100:00100000:1.0:1762167028.560949:0:34501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17653 00000004:00080000:2.0:1762167028.561061:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345733480/2, rc 0, transno 21474843753 00000100:00100000:2.0:1762167028.561066:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454571520:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1762167028.561077:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccf800/2, rc 0, transno 21474843755 00000100:00100000:2.0:1762167028.561081:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454571648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167028.561320:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167028.561405:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452094464 00000100:00100000:2.0:1762167028.561411:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452094464 00000100:00100000:2.0:1762167028.561586:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7446 00000100:00100000:2.0:1762167028.561595:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:58936:x1847765452094464:12345-192.168.203.35@tcp:35:multiop.0 00000100:00100000:2.0:1762167028.561756:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58936:x1847765452094464:12345-192.168.203.35@tcp:35:multiop.0 Request processed in 162us (435us total) trans 8589953300 rc 0/0 00000100:00100000:2.0:1762167028.561789:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7446 00000100:00100000:1.0:1762167028.565476:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.565526:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.565590:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452094592 00000100:00100000:0.0:1762167028.565600:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452094592 00000100:00100000:2.0:1762167028.565617:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452094720 00000100:00100000:2.0:1762167028.565624:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452094720 00002000:00100000:0.0:1762167028.565650:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x826:0x0] (0->4095) req@ffff9ee2477d3b80 x1847765452094592/t0(0) o3->9203c8dd-0e8f-410c-932b-b91553d6070a@192.168.203.35@tcp:59/0 lens 488/0 e 0 to 0 dl 1762167039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167028.565652:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x826:0x0] (0->4095) req@ffff9ee2477d1f80 x1847765452094720/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:59/0 lens 488/0 e 0 to 0 dl 1762167039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167028.565676:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d3b80 with x1847765452094592 ext(0->4095) 00002000:00100000:2.0:1762167028.565679:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1f80 with x1847765452094720 ext(0->4095) 00002000:00010000:0.0:1762167028.565684:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2477d3b80 00002000:00010000:2.0:1762167028.565693:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2477d1f80 00000100:00100000:2.0:1762167028.565737:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3280 00000100:00100000:2.0:1762167028.565750:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9203c8dd-0e8f-410c-932b-b91553d6070a+8:2360:x1847765452094592:12345-192.168.203.35@tcp:3:cat.0 00000100:00100000:1.0:1762167028.565757:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3281 00000100:00100000:1.0:1762167028.565793:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765452094720:12345-192.168.203.35@tcp:3:cat.0 00000100:00100000:1.0:1762167028.566003:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765452094720:12345-192.168.203.35@tcp:3:cat.0 Request processed in 210us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167028.566004:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9203c8dd-0e8f-410c-932b-b91553d6070a+8:2360:x1847765452094592:12345-192.168.203.35@tcp:3:cat.0 Request processed in 255us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167028.566017:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3281 00000100:00100000:2.0:1762167028.566025:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3280 00002000:00100000:1.0:1762167028.566027:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x826:0x0] (0->4095) req@ffff9ee2477d1f80 x1847765452094720/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:59/0 lens 488/440 e 0 to 0 dl 1762167039 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167028.566037:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x826:0x0] (0->4095) req@ffff9ee2477d3b80 x1847765452094592/t0(0) o3->9203c8dd-0e8f-410c-932b-b91553d6070a@192.168.203.35@tcp:59/0 lens 488/440 e 0 to 0 dl 1762167039 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167028.566040:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1f80 with x1847765452094720 ext(0->4095) 00002000:00010000:1.0:1762167028.566048:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2477d1f80 00002000:00100000:2.0:1762167028.566055:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d3b80 with x1847765452094592 ext(0->4095) 00002000:00010000:2.0:1762167028.566060:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2477d3b80 00000100:00100000:1.0:1762167028.568991:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167028.569029:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167028.569057:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452094976 00000100:00100000:0.0:1762167028.569067:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452094976 00000100:00100000:0.0:1762167028.569123:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452095232 00000100:00100000:0.0:1762167028.569131:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452095232 00000100:00100000:2.0:1762167028.569136:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7447 00000100:00100000:2.0:1762167028.569151:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:58945:x1847765452094976:12345-192.168.203.35@tcp:35:cat.0 00000100:00100000:0.0:1762167028.569160:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7448 00000100:00100000:0.0:1762167028.569172:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9203c8dd-0e8f-410c-932b-b91553d6070a+10:58948:x1847765452095232:12345-192.168.203.35@tcp:35:cat.0 00000100:00100000:2.0:1762167028.569489:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:58945:x1847765452094976:12345-192.168.203.35@tcp:35:cat.0 Request processed in 339us (501us total) trans 8589953301 rc 0/0 00000100:00100000:0.0:1762167028.569489:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9203c8dd-0e8f-410c-932b-b91553d6070a+11:58948:x1847765452095232:12345-192.168.203.35@tcp:35:cat.0 Request processed in 317us (456us total) trans 8589953302 rc 0/0 00000100:00100000:2.0:1762167028.569507:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7447 00000100:00100000:0.0:1762167028.569515:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7448 00010000:00010000:1.0:1762167029.161605:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762167029.351919:0:35675:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: failed writing to 2174976:816480 00000001:02000400:0.0:1762167029.352473:0:35676:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: failed writing to 1910528:1021024 Debug log: 5626 lines, 5626 kept, 0 dropped, 0 bad.