Git Product home page Git Product logo

torchutility's Introduction

TorchUtility

TorchUtility: A Utility Toolkit for PyTorch, as the name suggests, this is a toolset that helps make better use of the pyTorch framework, it aims to be a comprehensive collection of tools and utilities designed to complement the pyTorch framework.

Project Status

Under development, not yet released!

Features

  1. Utility: A Comprehensive Toolkit for Developers, includes Advanced Data Operations,... etc.

  2. Security: Unique utilities for encrypting data and models, ensuring secure model training and deployment in sensitive applications.

  3. llm_lighting: A streamlined module dedicated to simplifying the complexities of Large Language Model (LLM) integration, focusing on efficient training, fine-tuning, and inference with minimal code. This component utilizes a one-file approach for core functionalities, enhancing the project's utility with lightweight processes and seamless interaction with leading open-source libraries like Hugging Face. causallm_lora_train.py: causallm_lora_inference.py: This script offers a straightforward and minimalistic approach to performing inference with LoRA-optimized Causal Language Models, ensuring high efficiency with lean code.

Disclaimer

Usage Disclaimer: This project is for educational and research purposes only. You are responsible for any risks associated with using this project. The author shall not be liable for any direct or indirect losses caused by the use of this project. Please make sure you understand and agree to these terms before using this project.

Contribution Disclaimer: The author welcomes any form of contribution, but shall not be responsible for any direct or indirect losses caused by submitting contributions. Please ensure you understand and agree to these terms before submitting any contributions. Contributors must ensure that their contributions comply with relevant laws and regulations and respect the intellectual property rights of others.

License

This project is licensed under the BSD 3-clause License. See the LICENSE file for more details.

Note:

Contain codes written with the assistance of LLM (such as GPT) assistants

torchutility's People

Contributors

chenq100 avatar

Watchers

Kostas Georgiou avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.