Git Product home page Git Product logo

npm-high-impact's Introduction

npm-high-impact

Build Coverage Downloads Size

The high-impact (popular) packages of npm.

Contents

What is this?

This package exposes the names of popular packages on the public npm registry. The definition of the term popular here is the same as what npm itself calls high-impact. They classify packages as having a high impact on the ecosystem when a package meets one or more of the following conditions:

  • download count of 1 000 000 or more per week
  • depended on by 500 or more other packages

When should I use this?

Please use this for fun experiments when researching the npm registry.

Install

This package is ESM only. In Node.js (version 16+), install with npm:

npm install npm-high-impact

In Deno with esm.sh:

import {npmHighImpact} from 'https://esm.sh/npm-high-impact@1'

In browsers with esm.sh:

<script type="module">
  import {npmHighImpact} from 'https://esm.sh/npm-high-impact@1?bundle'
</script>

Use

import {npmHighImpact} from 'npm-high-impact'

console.log(npmHighImpact.length)
console.log(npmHighImpact)
7204
[
  'ansi-styles',
  'supports-color',
  'semver',
  'chalk',
  'tslib',
  'debug',
  'has-flag',
  'ms',
  'color-convert',
  // …
]

API

This package exports the identifiers npmHighImpact, npmTopDependents, and npmTopDownloads. There is no default export.

npmHighImpact

List of top package names (Array<string>).

Sorted by most downloaded first. Includes (unique) packages from npmTopDependents and npmTopDownloads.

npmTopDependents

List of package names that are depended on a lot (Array<string>).

Sorted by most dependents first.

npmTopDownloads

List of package names that are downloaded a lot (Array<string>).

Sorted by most downloaded first.

Data

👉 Note: not all of these packages are popular. There are some false-positives, such that download counts can be gamed, and that libraries.io sometimes thinks that a fork of webpack or so is actually webpack.

Scripts

This repo includes several scripts to crawl different services.

Top dependents

script/crawl-top-dependent.js looks for packages that are depended on by 500 or more other packages. The script takes like 30 minutes to run and currently gets about 3 000 packages.

It crawls the libraries.io project search API, whose results can also be browsed on the web. Crawling stops paginating when a package is seen that is depended on by less than 500 other packages.

You need an API key for libraries.io, see their API docs for more info.

All packages

script/crawl-packages.js follows an append-only database to find all the changes to things in the npm registry. We filter duplicates out, but still end up with ±2.5m “things”, which aren’t all proper packages. Later scripts will have to deal with them being missing.

The script takes like 12-18 hours to run (it finished somewhere at night). But the good news is that it’s additive: so the next time you run it, it’ll only pull in everything that changed since you last ran in.

It crawls replicate.npmjs.com.

Top downloads

script/crawl-top-download-unscoped.js and script/crawl-top-download-scoped.js look for download counts of all ±4.1m packages on the registry. Later scripts can filter the complete list to get the top packages. The script takes like 30 hours to run. About 10 hours is spent on ±3.2m unscoped packages. Another 8 or so on ±900k scoped packages (yes, sad). After filtering, the interesting data would result in about 6k packages.

It crawls the npm package download count API. Unscoped packages are crawled using the batch API to get 128 per request. Scoped packages are crawled with 20 HTTP requests at a time, as there is no batch API, and higher rates are limited by npm.

Types

This package is fully typed with TypeScript. It exports no additional types.

Compatibility

This package is at least compatible with all maintained versions of Node.js. As of now, that is Node.js 16+. It also works in Deno and modern browsers.

Related

Contribute

Yes please! See How to Contribute to Open Source.

Security

This package is safe.

License

MIT © Titus Wormer

npm-high-impact's People

Contributors

wooorm avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.