Comments (2)
carlos-lassance
commented on May 26, 2024
Hey Joel,
So at the time I think I basically tokenized everything (without taking the time into account) and then ran it a query at the time with a single CPU core (set with SLURM). I can try spinning a similar pipeline, but would love to hear your thoughts.
For later papers I started using a benchmarker from huggingface, but I cannot find it right now. I can try digging deeper if needed.
from splade.
JMMackenzie
commented on May 26, 2024
Thanks Carlos! I was looking for the test setup for measuring inference latency for queries so I could replicate your numbers, but I think I can manage without it if you don't have it. I'll have a dig on HF and see if I can find anything. Thanks again!
from splade.
Related Issues (20)
- Chunk token limit for SPLADE sparse embeddings? HOT 4
- Indexing a document corpus with Efficient SPLADE HOT 4
- [Bug] Get PyTorch version HOT 2
- Can SPLADE adapt to Chinese language ? HOT 10
- Proposed Dockerfile
- Tutorial to export a SPLADE model to ONNX HOT 6
- Whether the SPLADE model supports the distinction of 'is_q'? HOT 1
- SPLADE representations on BEIR dataset HOT 1
- Quick Start Problem: an unexpected keyword argument 'version_base' HOT 1
- Is it possible to get a commercial license? HOT 5
- Installation error - splade with tokenisers v0.12.1 – Compatibility issue with Python 3.11.1 and Rust (v. 1.72, 1.76, 1.69, 1.62)
- PyTorch version checking
- Inquiry about Configuration Details for "ecir23-scratch-tydi-japanese-splade" Model HOT 4
- TypeError: main() got an unexpected keyword argument 'version_base' HOT 1
- How to install the ENV correctly?
- Change default to splade-v3
- Seeking Assistance with SPLADE Model for Chinese Text
- bug: TREC 2020 qrel_binary.json, score 1 should be treated as negative instead of positive
- Hybrid search & normalization
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from splade.