StreamNative Hub is an online service for finding, reviewing, and downloading extensions for the Apache Pulsar ecosystem. It highlights features, richer component descriptions, links to external resources for the components, and installation and support information.
The StreamNative Hub currently hosts the following extensions for Pulsar ecosystem.
- Connectors (source & sink)
- Offloaders
- Protocol handlers
- Authentication plugins
- Integrations with data processing engines
- Interceptors
- ... and more
If a new plugin is introduced, you should upload the plugin to the target category. Currently, the StreamNative supports the following categories for the plugin.
- Authentication
- Connector
- Data processing
- Deployment
- Handler
- Logging
- Monitoring
- Offloader
If a new category is required, you can create it. For details about how to create a new category, see create new category.
This section describes operations to be performed before creating a PR (Pull Request) for a plugin.
- Clone the pulsar-hub repository to the local.
- Create a sub-folder under the cloned pulsar-hub repository and put the document in this sub-folder. The sub-folder name is set to the version of the plugin to be submitted, such as
2.5.1. - Put the plugin image in the
imagefolder under the cloned pulsar-hub repository.
To create a new category, follow these steps:
- Create a branch based on the latest pulsar-hub master repository.
- Create a sub-folder under the
pulsar-hubfolder in the local. Set the name of the sub-folder to the category name with lower cases. If the category name consists of multiple words, use the hyphen (-) between these words, such asdata-processing.
To create a document for a new plugin, follow these steps:
- Create a branch based on the latest pulsar-hub master repository.
- Create a document in the target folder for the plugin. For the document template about the plugin, see plugin document template.
- Commit your updates, create a PR, and then publish the PR to the pulsar-hub master repository.
- Update comments, if any.
- If no more comment, ask reviewers to approve the PR and merge the PR to the master.
This section describes a plugin document structure, including the following two parts:
- Metadata
- Body text
The metadata of a plugin consists of the following fields:
description:
author:
contributors:
language:
document:
source:
license:
tags:
alias:
features:
license_link:
icon:
download:
support:
support_link:
support_image:
dockerfile:
owner_name:
owner_img:
id: The following table describes tags covered in the metadata of a plugin.
| Item | Description |
|---|---|
| description | It is a short description about the plugin. |
| author | Set the name of the author for the plugin. |
| contributors | Set the name of the contributor for the plugin. |
| language | Set the language used by the plugin. |
| document | At present, leave this blank. |
| source | Set the source link address for the plugin. It is the root directory of the source code of the plugin. Use double quotation marks ("") to wrap the link address of the source, such as "https://github.com/apache/pulsar/tree/v2.3.2/pulsar-io/hdfs3". |
| license | By default, it is set to Apache License 2.0. |
| tags | Set keywords for this document. |
| alias | It is the name displayed on the StreamNative website. The alias is case sensitive. |
| features | Describe what the plugin is used to do. Use double quotation marks ("") to wrap the download link of the NAR package of the plugin. |
| license_link | Set the license link of the plugin. Use double quotation marks ("") to wrap the license link of the plugin. |
| icon | Set the image link for the plugin. If there is no image available, leave this blank. |
| download | Set the download link for a NAR package of the plugin. Use double quotation marks ("") to wrap the download link of the NAR package of the plugin. |
| support | Set the support organization of the plugin. |
| support_link | Set the link of the support organization. |
| support_image | Set the image logo of support organization. |
| dockerfile | At present, leave this blank. |
| owner_name | Set the owner of the component. This is optional. By default, it is set to Apache Software Foundation. |
| owner_img | Set the picture of the component owner, this is optional, default /images/apache-powered-by.svg |
| id | By default, it is set to the file name of the plugin (without extension). |
In general, the body text of a plugin document includes the following sections:
- Overview
- Installation
- Prerequisites
- Procedures
- Configuration
- XXX configuration (XXX refers to the plugin name.)
- Configure XXX (XXX refers to the plugin name.)
- Usage
- Monitoring (Optional)
- Security (Optional)
- Metrics (Optional)
- How it works (Optional)
- Reference (Optional)
- Troubleshooting (Optional)
- Tutorial (Optional)
### Overview
> Describe what the plugin is used for.
### Installation
> Describe how to install or load the plugin.
#### Prerequisites
> List prerequisite used for installing the plugin, if any.
#### Procedures
> Lists how to instal the plugin.
### Configuration
> List some configuration examples to describe what the plugin can be used to do.
#### XXX configuration
> List configuration items available for the plugin. XXX refers to the plugin name.
#### Configure XXX
> How to configure the plugin through Json or Yaml file. XXX refers to the plugin name.
### Usage
> Provide an example to describe what the connector can be used to do.
### Monitoring (Optional)
> Describe how to monitor the plugin.
### Security (Optional)
> List security configurations required to be configured and how to configure it.
### Metrics (Optional)
> List metrics available for the plugin.
### How it works (Optional)
> List basic principles for the plugin to work.
### Reference (Optional)
> List additional external references, if any.
### Troubleshooting (Optional)
> List FAQs and how to troubleshoot the bugs, if any.
### Tutorial (Optional)
> List a step-by-step for the whole process.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot]")
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent