Comments (6)
When I tried to reproduce the results you provide in BEIR, I encountered the same error mentioned above.
Specific scripts are below:
python -m pyserini.search.faiss \
--threads 16 --batch-size 512 \
--encoder-class contriever --encoder facebook/contriever-msmarco \
--index beir-v1.0.0-climate-fever.contriever-msmarco \
--topics beir-v1.0.0-climate-fever-test \
--output run.beir.contriever-msmarco.climate-fever.txt \
--hits 1000 --remove-query
python -m pyserini.eval.trec_eval \
-c -m ndcg_cut.10 beir-v1.0.0-climate-fever-test \
run.beir.contriever-msmarco.climate-fever.txt
from pyserini.
Hi @BeastyZ,
What is your pandas version? mine is pandas 2.1.1
from pyserini.
I changed the pandas version to 2.1.1, but it didn't work.
from pyserini.
I just found a relevant issue here #1658
are you using latest pyserini code?
from pyserini.
Now, my pandas version is 2.1.1 and pyserini version is 0.22.1 which is the latest one, I still got the same error.
from pyserini.
Hi @MXueguang
You are right! I re-examined the contents to be evaluated, and found that there were something irrelevant in it, which should be caused by my improper operation before. Now commas don't interfere with normal evaluation. Thank you for your timely help.
from pyserini.
Related Issues (20)
- merge a large index with small index \ adding small collection of docs to a large index
- Pyserini download index doesn't actually appear to check tarball size
- Install Failed building wheel for nmslib with pybind11-2.6.1
- How are you handling duplicate entries for the corpus and qrels? HOT 1
- mContriever pre-built index for Mr.TyDi datasets
- Support for jsonl.gz input in pyserini.encode
- Optimizations when building a dense index
- Improper Contriever encoding with the current pyserini.encode class
- Error When Setting Up Pyserini: python -m spacy download en_core_web_sm
- Issue with fetching raw documents
- Create a `Rerank` module in Pyserini
- Contriever training script & hyper-parameter values
- Trying to index own corpus
- Lucene query runtime
- Exception: Unable to find javac HOT 1
- NEED HELP: How to get original documents from Faiss index?
- Enhance Onboarding Documentation: Highlight Existing Embedded Indexes
- Update docs about fetching doc text given docid for dense indexes HOT 1
- Missing module 'jnius_config'
- List of encoder supported
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pyserini.