Git Product home page Git Product logo

Comments (3)

linspermen avatar linspermen commented on July 22, 2024

找到原因了,是因为在训练那个逻辑回归模型时采用的特征不是Bert特征,是feature的第三的特征feature[2],这个特征是通过那个SogouLabDic.dic提取的entity mention词频,这个特征作用不大,而Bert特征是feature的最后一个,应该是feature[-1],还有一个点是训练集的负例样本应该按0.05比例来取,但是代码中好像为0.5,所以我将其改为了0.05

所以总该改了两个地方
1.GetData和GetData_train函数的feature[2]改为feature[-1]
2.GetData_train函数的if prop<0.5改为if prop<0.05
但还是发现一个问题,就是训练集对逻辑回归模型的训练似乎不起什么作用,因为我试着只改了GetData,即只改了验证集部分的特征,而GetData_train没有变,即训练集特征仍然是错误的特征,但是效果没有区别,不知道是什么原因

但是好在结果算是正常了,在这里也希望作者能够看到并更正一下,谢谢了!
图片1

from ccks2019-ckbqa-4th-codes.

callmeivy avatar callmeivy commented on July 22, 2024

您好,遇到与您一样的问题,也按照您上面建议的改了,验证集机上逻辑回归筛选后的top10召回率只有微弱提升,为0.34,其他结果都正常,如下:
image
tuple_filter.py代码其他地方无变动,不知是什么原因。

from ccks2019-ckbqa-4th-codes.

cheng940929 avatar cheng940929 commented on July 22, 2024

您好,遇到与您一样的问题,也按照您上面建议的改了,验证集机上逻辑回归筛选后的top10召回率只有微弱提升,为0.34,其他结果都正常,如下: image tuple_filter.py代码其他地方无变动,不知是什么原因。

一共有四处feature[2]需要更改,盲猜你是忘记改验证集那里了吧

from ccks2019-ckbqa-4th-codes.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.