Git Product home page Git Product logo

Comments (3)

DanieleParravicini avatar DanieleParravicini commented on August 10, 2024

image

As the image here shows the rx datapath provide a notification AXIS.
This is how it works

  1. when some bytes arrives at the stack and they are stored in the buffer (window) ready to be read by the application (in our case the CCLO). the stack sends a session ID and the amount of bytes ready.
  2. the user kernel (CCLO in this case) replies providing the session id and the number of bytes that he wants to read.
    As a side note, the high level message that we have now carries at bits 32-63 the total number of bytes of the message.
    What I propose to get past the RX FAN IN =1 is the following in the easy case.
    The depacketizer waits for notifications from the stack.
    When the first arrives the depacketizer gets the first bytes (which includes the header) and discovers the amount of bytes to be read.
    It dequeue stack notifications to understand when new data have been received.
    All data coming from different sessions are kept aside and they wait.
    All data from the first active session are consumed up until last byte.
    Then we move to next session.

We need to:

  1. avoid that we run out of memory in the network stack. Is data saved in DDR/HBM at the moment?
  2. (related to previous) avoid limiting number of ranks we can support
  3. avoid that this approach does leads to a deadlock (imagine you have to sum 2 buffers of 32 MB each coming from two external FPGAs. You can receive 1 MB each and sum them to create the resulting 32 MB result. If we receive 32MB from one and 32 from the other we may run out of space in the CCLO staging area (spare buffer))
  4. ensure that we handle properly the end of the message. (e.g. message of 5 MB. The stack notifies each time that 4MB arrives. The depacketizer needs to respect the boundaries and fetch only missing 1MB after first 4MB read. this because:
    a. we need to be fair and serve other sessions
    b. avoid mixing data coming from different sessions

from accl.

DanieleParravicini avatar DanieleParravicini commented on August 10, 2024

I can think of a FSM for that if you want

from accl.

quetric avatar quetric commented on August 10, 2024

Cloding, feature implemented in dev

from accl.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.