EventStream provides API endpoints for your Django application that can push data to connected clients. Data is sent using the Server-Sent Events protocol (SSE), in which data is streamed over a never-ending HTTP response.
For example, you could create an endpoint, /events/, that a client could connect to with a GET request:
GET /events/ HTTP/1.1
Host: api.example.com
Accept: text/event-streamThe client would receive a streaming HTTP response with content looking like this:
HTTP/1.1 200 OK
Transfer-Encoding: chunked
Connection: Transfer-Encoding
Content-Type: text/event-stream
event: message
data: {"foo": "bar"}
event: message
data: {"bar": "baz"}
...Features:
- Easy to consume from browsers or native applications.
- Reliable delivery. Events can be persisted to your database, so clients can recover if they get disconnected.
- Per-user channel permissions.
- Django
>=5 - PyJWT
>=1.5, <3 - gripcontrol
>=4.0, <5 - django_grip
>=3.0, <4 - six
>=1.10, <2
If your using the Django Rest Framework version of the module.
- Django Rest Framework
==3.15(for using theViewSetandrouter.register).
Those dependecies will be install automatically when you install this package.
First, install this module and the daphne module:
pip install django-eventstream daphneAdd the daphne and django_eventstream apps to settings.py:
INSTALLED_APPS = [
...
"daphne",
"django_eventstream",
]Add an endpoint in urls.py:
from django.urls import path, include
import django_eventstream
urlpatterns = [
...
path("events/", include(django_eventstream.urls), {"channels": ["test"]}),
]That's it! If you run python manage.py runserver, clients will be able to connect to the /events/ endpoint and get a stream.
First, install this module with REST dependencies and the daphne module:
pip install django-eventstream[DRF] daphneNote: The [DRF] is a optional dependency that will install the Django Rest Framework module.
Add the daphne and django_eventstream apps to settings.py:
INSTALLED_APPS = [
...
"daphne",
"django_eventstream",
]Add an endpoint in urls.py:
from django.urls import path, include
from django_eventstream.views import EventsViewSet, configure_events_view_set
router = DefaultRouter()
# In theses examples, we are using the `configure_events_view_set` function to create a view set with the channels and messages_types that we want to use.
router.register('events1', configure_events_view_set(channels=["channel1", "channel2",...], messages_types=["message","info",...]), basename='events1')
# Or you can create a view set and directly pass it to the router. You will be able to set the channels by URL or by query parameters. For messages_types you can set it by query parameters or use the default value "message".
router.register('events2', EventsViewSet, basename='events2')
urlpatterns = [
...
path("", include(router.urls)), # Here we register the router urls
]Note: These configurations are only applicable when using the Django Rest Framework version of the module (i.e., when the Django Rest Framework is installed).
To send data to clients, call send_event:
from django_eventstream import send_event
#send_event(<channel>, <event_type>, <event_data>)
send_event("test", "message", {"text": "hello world"})The first argument is the channel to send on, the second is the event type, and the third is the event data. The data will be JSON-encoded using DjangoJSONEncoder.
Note: In a basic setup, send_event must be called from within the server process (e.g. called from a view). It won't work if called from a separate process, such as from the shell or a management command, you could use Redis or another message queue to communicate between processes and after send your event.
Be aware tha if you send message a message type error (or any type that used for the SSE protocol, like open, error, close...), the message maybe interpreted as a error message by the client.
To disable the Browsable API view SSE for production, you can modify the settings.py of the project by adding the following lines as recommended by Django REST Framework:
REST_FRAMEWORK = {
'DEFAULT_RENDERER_CLASSES': (
# Add here the renderer classes you want to use
),
}Next, manage the renderers you want to use with DEFAULT_RENDERER_CLASSES. In this example, you will need to use django_eventstream.renderers.SSEEventRenderer to enable SSE functionality. If you also want to use the Browsable API view, add django_eventstream.renderers.BrowsableAPIEventStreamRenderer if not do not add it :
/!\ And be careful to don't add the eventstream renderers before the JSONRenderer and BrowsableAPIRenderer (or other Renderer), otherwise the API will probably not work as expected.
REST_FRAMEWORK = {
'DEFAULT_RENDERER_CLASSES': [
'rest_framework.renderers.JSONRenderer',
'rest_framework.renderers.BrowsableAPIRenderer',
'django_eventstream.renderers.SSEEventRenderer',
'django_eventstream.renderers.BrowsableAPIEventStreamRenderer'
# Add other renderers as needed
]
}After following the instructions in the previous section, you'll be able to develop and run locally using runserver. However, you should not use runserver when deploying, and instead launch an ASGI server such as Daphne, e.g.:
daphne your_project.asgi:applicationWSGI mode can work too, but only in combination with a GRIP proxy. See Multiple instances and scaling.
If you need to run multiple instances of your Django app for high availability or scalability, or need to send events from management commands, then you can introduce a GRIP proxy such as Pushpin or Fastly Fanout into your architecture. Otherwise, events originating from an instance will only be delivered to clients connected to that instance.
For example, to use Pushpin with your app, you need to do three things:
- In your
settings.py, add theGripMiddlewareand setGRIP_URLto reference Pushpin's private control port:
MIDDLEWARE = [
"django_grip.GripMiddleware",
...
]GRIP_URL = 'http://localhost:5561'The middleware is part of django-grip, which should have been pulled in automatically as a dependency of this module.
- Configure Pushpin to route requests to your app, by adding something like this to Pushpin's
routesfile (usually/etc/pushpin/routes):
* localhost:8000 # Replace `localhost:8000` with your app's URL and port
- Configure your consuming clients to connect to the Pushpin port (by default this is port 7999). Pushpin will forward requests to your app and handle streaming connections on its behalf.
If you would normally use a load balancer in front of your app, it should be configured to forward requests to Pushpin instead of your app. For example, if you are using Nginx you could have configuration similar to:
location /api/ {
proxy_pass http://localhost:7999
}
The location block above will pass all requests coming on /api/ to Pushpin.
By default, events aren't persisted anywhere, so if clients get disconnected or if your server fails to send data, then clients can miss messages. For reliable delivery, you'll want to enable event storage.
First, set up the database tables:
python manage.py migrateThen, set a storage class in settings.py:
EVENTSTREAM_STORAGE_CLASS = 'django_eventstream.storage.DjangoModelStorage'That's all you need to do. When storage is enabled, events are written to the database before they are published, and they persist for 24 hours. If clients get disconnected, intermediate proxies go down, or your own server goes down or crashes at any time, even mid-publish, the stream will automatically be repaired.
To enable storage selectively by channel, implement a channel manager and override is_channel_reliable.
Include client libraries on the frontend:
<script src="{% static 'django_eventstream/eventsource.min.js' %}"></script>
<script src="{% static 'django_eventstream/reconnecting-eventsource.js' %}"></script>Listen for data:
var es = new ReconnectingEventSource('/events/');
es.addEventListener('message', function (e) {
console.log(e.data);
}, false);
es.addEventListener('stream-reset', function (e) {
// ... client fell behind, reinitialize ...
}, false);Declare a channel manager class with your authorization logic:
from django_eventstream.channelmanager import DefaultChannelManager
class MyChannelManager(DefaultChannelManager):
def can_read_channel(self, user, channel):
# require auth for prefixed channels
if channel.startswith('_') and user is None:
return False
return TrueConfigure settings.py to use it:
EVENTSTREAM_CHANNELMANAGER_CLASS = 'myapp.channelmanager.MyChannelManager'Whenever permissions change, call channel_permission_changed. This will cause clients to be disconnected if they lost permission to the channel.
from django_eventstream import channel_permission_changed
channel_permission_changed(user, '_mychannel')Note: OAuth may not work with the AuthMiddlewareStack from Django Channels. See this token middleware.
The channels the client listens to are specified using Django view keyword arguments on the routes. Alternatively, if no keyword arguments are specified, then the client can select the channels on its own by providing one or more channel query parameters in the HTTP request.
Examples:
# specify fixed list of channels
path('foo/events/', include(django_eventstream.urls), {'channels': ['foo']})
# specify a list of dynamic channels using formatting based on view keywords
path('objects/<obj_id>/events/', include(django_eventstream.urls),
{'format-channels': ['object-{obj_id}']})
# client selects a single channel using a path component
path('events/<channel>/', include(django_eventstream.urls))
# client selects one or more channels using query parameters
path('events/', include(django_eventstream.urls))Note that if view keywords or a channel path component are used, the client cannot use query parameters to select channels.
If even more advanced channel mapping is needed, implement a channel manager and override get_channels_for_request.
There are settings available to set response headers Access-Control-Allow-Origin, Access-Control-Allow-Credentials, and Access-Control-Allow-Headers, which are EVENTSTREAM_ALLOW_ORIGINS, EVENTSTREAM_ALLOW_CREDENTIALS, and EVENTSTREAM_ALLOW_HEADERS, respectively.
Examples:
EVENTSTREAM_ALLOW_ORIGINS = ['http://example.com', 'https://example.com']
EVENTSTREAM_ALLOW_CREDENTIALS = True
EVENTSTREAM_ALLOW_HEADERS = 'Authorization'Note that EVENTSTREAM_ALLOW_HEADERS only takes a single string value and does not process a list.
If more advanced CORS capabilities are needed, see django-cors-headers.
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot]")
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent