Git Product home page Git Product logo

Comments (2)

yufan-aslp avatar yufan-aslp commented on May 28, 2024

1.您理解的没有问题,不过那个值因为之前经过mask,有值也是一个极小值,对模型结果基本没有影响。当然您也可以做一下mask,让他确保是padding的0特征。
2.具体代码没法开源,涉及内部代码。主要思路就是模拟一个房间的长宽高,然后随机麦克风的位置和人的位置,然后模拟8通道的重叠音频,重叠率10~40%之间。原始单通道近场数据用于训练了,可以看最后一个结果对比的实验结果表格。Beamformer生成的是单通道数据。CDDMA Beamformer是内部的代码,目前可能还没开源。
3.这个是可以处理的,可以看源代码task/abs_task.py内,构建batch的时候有个utt2category的文件,你可以处理一个这样的文件对自己的音频进行分类,他会让相同类别的音频分配到同一个batch内。

from funasr.

yjiangling avatar yjiangling commented on May 28, 2024

1.您理解的没有问题,不过那个值因为之前经过mask,有值也是一个极小值,对模型结果基本没有影响。当然您也可以做一下mask,让他确保是padding的0特征。 2.具体代码没法开源,涉及内部代码。主要思路就是模拟一个房间的长宽高,然后随机麦克风的位置和人的位置,然后模拟8通道的重叠音频,重叠率10~40%之间。原始单通道近场数据用于训练了,可以看最后一个结果对比的实验结果表格。Beamformer生成的是单通道数据。CDDMA Beamformer是内部的代码,目前可能还没开源。 3.这个是可以处理的,可以看源代码task/abs_task.py内,构建batch的时候有个utt2category的文件,你可以处理一个这样的文件对自己的音频进行分类,他会让相同类别的音频分配到同一个batch内。

噢噢,明白了,非常感谢你的耐心解答,感谢!!!

from funasr.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.