English | 简体中文

Datastore is a project developed to accelerate local storage hwameistor to load data. It can help hwameistor to be well applied in AI scenarios and other scenarios that require fast data loading for training.

See current releases.

Datastore contains several modules:

• dataset-manager
• dataload-manager

The Dataset Manager (DSM) is designed to manage datasets and allocate local acceleration cache volumes for datasets. Other modules (such as DLM) can use the cache volumes provided by DSM to load datasets. Learn more

Dataload-manager (DLM) provides a service for loading data sets for local cache volumes. It aims to quickly pull data sets for application programs for training in AI training environments. Learn more

Learn more

For full documentation, please see our website hwameistor.io.

For detailed adopters that have HwameiStor deployed in a production environment or a user acceptance testing environment, please check the adopters list.

We welcome contributions of any kind. If you have any questions about contributing, please consult the contributing documentation.

Please follow our weekly blogs.

If you want to join the hwameistor channel on CNCF slack, please get invite to CNCF slack and then join the #hwameistor channel.

HwameiStor tech-talk group:

Welcome to follow our roadmap discussions here

Please feel free to raise requests on chats or by a PR.

We will try our best to respond to every issue reported on community channels, but the issues reported here on this repo will be addressed first.

Copyright (c) 2014-2023 The HwameiStor Authors.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0.