Git Product home page Git Product logo

durable-limiter's Introduction

Rate Limiter - built for Cloudflare Workers, using Durable Objects

Features

  • Supports fixed or sliding window algorithms
  • Scoped rate-limiting
  • Caching
  • Cleanup of stale DO data using alarm
  • Responses provide all information needed to take actions (or not)
  • Tested in production (well, not actually)

FAQ

How to use

You can use it as a subworker as described here.

Deploy to Cloudflare Workers

But it doesn't rate limit anything

Yeah, that's the sad truth. The code is there to decide whether or not a request should be rate-limited, but currently, it just outputs the results in a JSON response. The reason is that this is how it's being used as part of another project I'm working on. That said, I think it's a good starting point as it would require minimal changes from you to send the right responses back.

What about pricing? How does it compare with CF's own rate-limiter?

Well, it all depends on the use case. You can check out the cost calculator.

Description of JSON Body (usage)

  • type: type can be one of sliding or fixed and describes the algorithm that will be used.
  • scope: the value of this header is used as the rate-limit scope.
  • key: the key is the client information, which can be an IP (most of the time), a network, a username, or even a user-agent. In general, feel free to use whatever you like.
  • limit: the value of this header provides the request limit (e.g. 10).
  • interval: the interval (in seconds) upon which all calculations are based.

Responses

Response status will be one of:

  • 200, meaning that the request was processed without problems
  • 400, JSON input error
  • 500, any other error, info can be found in the response body

Response body on successful requests depends on the type of algorithm used and the outcome.

If the request should be rate-limited, you would find an error property, with a value of rate-limited, if not, depending on the algorithm used, you will find quota information:

  • The sliding type might return one of the two following bodies:
{
    "rate": "number, rate of the incoming requests"
}

or

{
    "rate": "number, rate of the incoming requests",
    "error": "rate-limited"
}
  • The fixed type might return one of the following bodies:
{ 
    "resets": "number, seconds since epoch",
    "remaining": "number, remaining requests until rate-limiting"
}

or

{
    "resets": "number, seconds since epoch",
    "error": "rate-limited"
}

durable-limiter's People

Contributors

dependabot[bot] avatar honzabit avatar lauragift21 avatar mrbbot avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

durable-limiter's Issues

For your durable object alarm are you calculating ts_less_than correctly?

I maybe completely misunderstanding this so forgive me if this is the case, but say we take:

ts_less_than: Math.floor(now / 1000 / parseInt(interval)) - parseInt(interval) * 2

This is number of intervals - the interval seconds * 2.

Shouldn't you be doing number of intervals -2 intervals aka:

Math.floor(now / 1000 / parseInt(interval)) - 2

cost effectiveness

There are scenarios where this code is more cost-effective than CF's rate limiter and other scenarios where it could kill your budget.

Maybe using some on-the-fly calculations (like the cost calculator) on the traffic patterns, we could identify these scenarios effectively and integrate with the CF API to push the rate-limit rule closer to the edge. An alarm also could be used to trigger the rule's deletion every 1h, as if needed it would be automatically re-provisioned.

cleanup old keys from DO storage

Old keys need to be cleaned up to avoid unneeded storage charges.

The keys need to be restructured to also include the interval, and together with the window, stale keys can be identified and removed.

Caching breaks the rate limiting

I'm pretty sure the caching expiration logic used is incorrect and causes requests to not be counted or rate limited

I had to remove the caching for it to actually work once deployed. I don't see how you can cache anything and count responses to be rate limited at the same time but I could be misunderstanding it ๐Ÿค”

cache rate-limited responses from DO

Responses can be stored/returned from the cache when the fixed window algorithm is used. Any rate-limited response can be safely stored in and returned from the cache, until the timestamp returned in the resets property.

On the other hand, the sliding window algorithm is not so cache-friendly, but I guess an approximation of cache time can possibly be computed here too using the distance of rate from limit and the interval.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.