Git Product home page Git Product logo

Comments (8)

miroslavKovacPantheon avatar miroslavKovacPantheon commented on September 23, 2024 1

100 pods and no problem I ll be checking this out as we move on but it seems that this patch helped. What s more, it looks like it even helped with this problem...

time="2019-06-04T14:14:14Z" level=warning msg="Unable to deliver the notification, reciever end not ready." msg_id=83 msg_name=sw_interface_event msg_size=17

I was seeing this warn from time to time on many pods even though they were configured just fine.. Right now not even one pod contains this.
Thank you

from vpp-agent.

ondrej-fabry avatar ondrej-fabry commented on September 23, 2024

@milanlenco most likely related to the way notifications are handled:


2019-06-04 08:04:01,108 DEBG 'agent' stdout output:
time="2019-06-04 08:04:01.10817" level=debug msg="Interface state notification for memif181 (idx: 2): &{SwIfIndex:2 AdminState:0 LinkState:0 Deleted:false}" loc="ifplugin/interface_state.go(345)" logger=vpp-ifplugin.if-state
time="2019-06-04 08:04:01.10825" level=debug msg="Interface state notification for memif180 (idx: 1): &{SwIfIndex:1 AdminState:0 LinkState:0 Deleted:false}" loc="ifplugin/interface_state.go(345)" logger=vpp-ifplugin.if-state
+======================================================================================================================+
| Transaction #18                                                                                      SB Notification |
+======================================================================================================================+
  * transaction arguments:
      - seq-num: 18
      - type: SB Notification
      - values:
          - key: vpp/interface/memif181/link-state/DOWN
            val: <EMPTY>
          - key: vpp/interface/memif181/link-state/UP
            val: <NIL>


2019-06-04 08:04:01,140 DEBG 'vpp' stdout output:
/usr/bin/vpp[11]: set_hw_interface_rx_mode: invalid interface

2019-06-04 08:04:01,140 DEBG 'agent' stdout output:
time="2019-06-04 08:04:01.13947" level=warning msg="failed to un-configure Rx-mode (VPPApiError: Unimplemented (-9)) - most likely the interface is already without a link" loc="descriptor/rx_mode.go(214)" logger=vpp-ifplugin.rx-mode-descriptor
o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2019-06-04 08:04:01.108 +0000 UTC -> 2019-06-04 08:04:01.14 +0000 UTC, dur: 31ms):
      1. DELETE [DERIVED IS-PENDING]:
          - key: vpp/interface/memif181/rx-modes
          - value: { name:"memif181" type:MEMIF rx_modes:<mode:ADAPTIVE default_mode:true >  } 
      2. DELETE [WAS-OBTAINED]:
          - key: vpp/interface/memif181/link-state/UP
          - value: <EMPTY> 
      3. CREATE [OBTAINED]:
          - key: vpp/interface/memif181/link-state/DOWN
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #18                                                                                                      took 31.2ms |
x----------------------------------------------------------------------------------------------------------------------x

It seems like the VPP sends notifications about UP and immediately another with DOWN after?

from vpp-agent.

miroslavKovacPantheon avatar miroslavKovacPantheon commented on September 23, 2024

Update.. As I found out this one was not actually the problematic one. The rx-mode is set up correctly to adaptive as I didn t know to check it like this

vpp# sh inter rx-placement 
Thread 1 (vpp_wk_0):
  node memif-input:
    memif1/0 queue 0 (adaptive)
    memif1/1 queue 0 (adaptive)

but the other one is polling and has the same set up

vpp# sh inter rx-placement 
Thread 1 (vpp_wk_0):
  node memif-input:
    memif1/0 queue 0 (polling)
    memif1/1 queue 0 (polling)

here is the log of that vpp (2).txt

from vpp-agent.

milanlenco avatar milanlenco commented on September 23, 2024

The first log is OK - the memif has re-connected and the rx-placement was re-created - you can ignore the warning. The second one is strange, seems that all notifications are lost somewhere along the way. I have added some temporary logs in PR #1367 as I cannot figure out what is going on from the existing logs...

from vpp-agent.

miroslavKovacPantheon avatar miroslavKovacPantheon commented on September 23, 2024

Adding updated logs with the PR #1367 changes vpp (2).txt

from vpp-agent.

miroslavKovacPantheon avatar miroslavKovacPantheon commented on September 23, 2024

Adding logs after kill vpp (2).txt

from vpp-agent.

ondrej-fabry avatar ondrej-fabry commented on September 23, 2024

Potential fix was merged into dev: #1369

from vpp-agent.

ondrej-fabry avatar ondrej-fabry commented on September 23, 2024

I will close this issue. Please open new one if you find more problems.

from vpp-agent.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.