Hi, this is Samirit Saha. Here is a Python file for my work done so far in creating a validation interface using Argilla UI with Python on Google Colab, so far I have been able to open the Argilla UI on Google Colab and have been able to download the all_combined_odia_171k dataset on Colab from Hugging Face. The code is divided into two sections, one containing the code that works so far, and one containing the code that doesn't.

Currently, the code does not include the functionality to save the extracted data as a text file. After performing the extraction process, the code lacks the capability of storing the extracted content in a structured format, such as a .txt file

Build a Translation model for translation from English to Indic Languages.

1. extract pair datasets from hugging face, and other different sources and push data to central repo.
2. Buid a translation model using English to XX using LLM. (R&D on T5, NLLB, others).
3. XX - Odia or any other Indic languages.

I have included the source files for our web scraping web application using Streamlit and Python. These files contain all the necessary code to scrape data from websites and present it in a user-friendly and interactive manner.

1. T1_ST1 - Translating instruction set from English - XX using the existing translation app available in the OdiaGenAI Github.
2. T1_ST3 - Validation of instruction set (please refer to the https://drive.google.com/drive/u/0/folders/16GUxTEbcvE-RL-JNrTOtGliaPBDZawso).
3. T1_ST4 - Generate instructions manually in Odia considering the local context in mind.
4. T1_ST6 - Prepare an evaluation test set in Odia/Indic languages for evaluating pre-trained model performance.

Unable to retrieve data from sitemaps. When attempting to extract data from sitemaps using the tool, it fails to fetch any information and returns empty results.