Git Product home page Git Product logo

gose's Introduction

Hi there 👋

chexn2020's github stats

nothing

gose's People

Contributors

cancanneedhomework avatar chenxn2020 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

Forkers

yuni1314

gose's Issues

可用模型

您好,能否开源已训练好模型用于测试指标和可视化效果?

Your code does not seem to be runnable for the moment

(1) In your RE module in file "RE.py" line 349, the variable "logits" is not defined.
(2) In the same function (i.e., forward()), the following functions are not defined:

self.get_multi_loss()
self.get_single_loss()

(3) In addition, function self.get_type_loss() seems to be incomplete (as shown below):

def get_type_loss(self,type_logits,key_mask,entities,relations):
        # logits 2,64,65,3
        logits = self.softmax(type_logits[:,:,0])
        B = logits.shape[0]
        device = logits.device
        key_mask = key_mask.bool()
        loss_fcn = CrossEntropyLoss()

        for b in range(B):
            logit = logits[b][key_mask[b]]

            from IPython import embed;embed()
        relations 

I have another question here for you as well:
In the RE module in file "RE.py", the maximum number of keys and values are predefined:

self.max_key = 64 (line 158)
self.max_value = 64 (line 159)

I anticipate that your implementation will use more VRAM compared to the original RE decoder in unilm implementation for LayoutXLM, and also, it will be slower as you even performed iterative learning. Have you benchmarked how much more VRAM is needed and how much slower your decoder is compared to the original RE decoder in unilm?
These are important considerations as it may mean that your approach cannot be effectively applied when the number of relations are many, which significantly limit its application to real-life problems.

Thanks so much for the attention.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.