biocompute-objects / bco-rag Goto Github PK
View Code? Open in Web Editor NEWBioCompute Object Retrieval-Augmented Generation Tool
BioCompute Object Retrieval-Augmented Generation Tool
Thinking about creating separate scripts solely for identifying potentially erroneous evals saves and then separately building the evaluations file on "high quality reviews" only (will have to determine that criteria).
handle the logging directly in the objects rather than in the main.py entrypoint.
The standardized queries contain two parts:
The first part of the query is obviously important for the semantic retrieval process but I have a hunch that including the second part of the query for the semantic retrieval is polluting the retrieval. Going to try splitting the query and re-injecting the data schema part before the data is sent to the llm.
Some domains are dependent on other domains. The big one is the parametric domain has to be generated after the description domain as the step numbers have to match up.
Will have to hold the description domain in memory and pass it in as part of the query for the parametric domain.
Llamaindex's SemanticSplitterNodeParser
can sometimes produce chunks that are too large for the embedding model. Unfortunately there is no max length option for the semantic chunking to avoid this issue.
Will have to eventually subclass the SemanticSplitterNodeParser
and create a two level safety net that will naively split large chunks into sub-chunks in order to stay under the embedding model input token limits.
Reference:
run-llama/llama_index#12270
Right now the default score check prevents erroneously saving default evaluations. Should re-work the logic to exclude some fields such as:
Need to update some documentation for the migration and new features that have been added.
Should probably remove the local evaluation data. That was meant for the proof of concept and a true backend should probably be setup, potentially in the form of MongoDB and a simple Flask API. The domain generations (for now) can probably be kept in the repository.
Should store the score along with the score eval. Because the scoring will iterate/change, need to keep track of which score the score eval was submitted against.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.