Git Product home page Git Product logo

power-grid-frequency's Introduction

Power-Grid Frequency

This repository is the front-end of the data repository in the Open Science Framework Open Access Power-Grid Frequency Database. The website Power-Grid Frequency Database contains all the relevant information on the content of this database. Thus, you will not find the data in this GitHub repository. Visit the website of the OSF to access the data.

This database of power-grid frequency is comprised of open data existent across three dimensions:

  • TSO data: Transmission System's Operator (TSO) recordings made public;
  • Research projects: Open-data database research projects;
  • Independent Gatherings: Industrial, private, or personal recordings that were made publicly available.

The data found here is always free for usage. It is processed, using a set of scripts found here, for research usage.

Currently the following recordings are available, under the three major categories described above:

TSO data

European Grids

The available recordings from Europe are of the following synchronous regions

Synchronous Area Location Provider Resolution Date range
Continental Europe Germany TransnetBW 1 sec 2011-2019
France RTE 10 sec 2014-2020
Nordic Grid Finland FinGrid 0.1 sec 2015-2019
National Grid (GB) England NationalGrid ESO 1 sec 2015-2019

Independent recording

European Grid: Győr and Békéscsaba, Hungary and Central Jutland, Denmark

An independent recording by the Hungarian TSO MAVIR provided a week-long recording from Békéscsaba and Győr, Hungary, in the Continental European Grid. An independent recording by the ACES project in Central Jutland, Denmark for the year of 2019.

Nordic Grid: Zealand, Denmark

Two independent recordings by the ACES project in Zealand, Denmark, in the Nordic grid, for the years of 2018 and 2019.

Research Projects

Projects:

Power grid frequency data base

This is a set of 19 recordings in 12 synchronous regions, spanning from 1 day to ~1 month in length, over 2017 to 2019, stored in the Open Science Framework Power grid frequency data base from 2020.

It contains recordings from Reykjavík, Iceland, Vestmanna, Faroe Islands, Las Palmas de Gran Canaria, Canary Islands, Spain, Palma de Mallorca, Balearic Islands, Spain, Karlsruhe, Germany, Oldenburg, Germany, Istanbul, Turkey, Lisbon, Portugal, Lauris, France, Split, Croatia, Krakau, Poland, Erice, Sicily, Italy, London, United Kingdom, Tallin, Estonia, Stockholm, Sweden, Salt Lake City, Utah, USA, College Station, Texas, USA, Cape Town, South Africa, and St. Petersburg, Russia.

Changelog

  • Version 1.0 - Website online since July. Several contributions from other projects.
  • Version 0.4 - Building first structure of the website.
  • Version 0.3 - Moving to Github to produce a long-term repository.
  • Version 0.2 - Moved to JuGit server
  • Version 0.1 - Initial construction based files on a Sciebo folder

Contributions

If you have open data from power-grid system, be it frequency, voltages, load, consumption, models, we will welcome all contributions to enhance this database. Our main concern at this point is power-grid frequency, but we are interested in all power-systems related data.

Affiliated institutions and collaborators

This project came to life by Leonardo Rydin Gorjão in 2018 on a GitHub repository. Benjamin Schäfer and Mehrnaz Anvari contributed over the past two years. Galib Hassan and Leonardo Rydin Gorjão designed the website. Johannes Kruse helped with the data and scripts. Benjamin Schäfer and Leonardo Rydin Gorjão have built up the collaboration that brought about part of the data. We are thankful for all the collaborations, with data and comments, from across the globe.

Funding

Helmholtz Association Initiative Energy System 2050 - A Contribution of the Research Field Energy and the grant No. VH-NG-1025.

power-grid-frequency's People

Contributors

etienne69 avatar galibhassan avatar lrydin avatar schaefer-benjamin avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

power-grid-frequency's Issues

[New Data] WETI Grid Frequency Measurement Data

Dear community,

I would kindly ask to incorporate our grid frequency data from our measurement campaign into your website.

The data is already published on osf.io (https://osf.io/jbk82/) and the measurement campaign is described in the wiki section.

Our measurement computer is connected to a regular power socket, i.e. measurement is conducted at the low-voltage level. Location of the measurement computer is: Nordstraße 2, 24937 Flensburg (Latitude: 54.791521 | Longitude: 9.438984).

Thanks everyone,
Henning

[Enhancement] Include links to TSO's and generation data

For the coming update and further on, I was thinking we could add a link to each country/region wherein one can get access to more related data, especially generation. Most of the data should be available in the ENTSO-E transparency platform, but that does not cover it all.

We could add links to, e.g., TransNetBW in Germany, RTE in France, and also maybe a short description on how to get genration data from the ENTSOE Transparency platform for first-time users.

@schaefer-benjamin

Incorrect Data

Hi LRydin, I am working on a project and I find your data to be very useful. However, if I see the frequency data, I see weird values like 25, -7 etc and nothing is around 50.

Am I missing something? Please guide. Thank you.

[New Data] Zeeland, Denmark (Nordic Grid), 2018 - ACES project

As part of the ACES project, we have contacted Andreas Thingvad and Mattia Marinelli to request adding their dataset to our database.

This includes an (almost) full year of 2018 taken in Zealand, Denmark, part of the Nordic Grid.
This needs to be added to:

  • Map
  • Database

and we need to ensure

  • links to the project are detailed
  • links to the authors are detailed
  • licensing and referencing are detailed correctly

The details are found here.

[Table] Issues with json generated table

We still have to attend to a few things, regarding the tables:

  • the years are not sorted
  • the last month is always Oct, not Dec.
  • (not yet ready) leave one last column left to include a "whole year download" [I will generate the data soon]
  • place the JSON tables on the repo
  • separate the table into three tables: Continental Europe, National Grid, Nordic Grid.

The last point being, to really have three files, so we can include text between the tables. These have different properties, the data, and it would be better to have the separated.

[ToDo] Add interactivity to playground

Data loading

  • let the user choose from few different sample data

Statistics

  • Mark the mean frequency
  • Present standard deviation

@LRydin you said something about RMS and maxima-minima. Could you please elaborate here?

what else?

[General] Licensing

Add licensing for:

  • TSOs measurements
  • Research project measurements
  • Independent measurements

and ensure they are in

  • Database

[New Data] 7-location PMU data from the Nordic Grid, 2013

Adding 7 synchronous recordings from the Nordic Grid from 2013, provided by Luigi Vanfretti, Professor at RPI and head of @ALSETLab (@lvanfretti), stemming for the discontinued project STRONg²rid. The data are synchronous and over a period of ~3 days.

This needs to be added to:

  • Map
  • Database

and we need to ensure

  • links to the project are detailed
  • links to the authors are detailed
  • licensing and referencing are detailed correctly

M. S. Almas, M. Baudette, L. Vanfretti, S. Løvlund,and J. O. Gjerde, Synchrophasor network, laboratory and software applications developed in the STRONg2rid project, in 2014 IEEE PES General Meeting | ConferenceExposition (2014) pp. 1–5.

New Ideas of Improving Website

These ideas will be discussed in the meeting on 08.12.2023. After that, we will filter out the important ideas from where we can start the work.

  • Registry of new website and database (if we go for internal DB of KIT)
  • Do we want to keep data internally or can we use LSDF?
  • Having an API that can be integrated with the code (Jupyter, Python) to access the dataset. It can be filtered out based on the country, and date. (We can add more points)
  • Updating data: making the process of uploading and updating data dynamic.
  • Having separate webpages according to their concepts (as currently database page has all the information, we can split that page into multiple pages). For navigation, floating section or breadcrumbs should be there.
  • Automate the deployment process- whenever code is changed, and a release branch is created, it should trigger the deployment process (e.g., Azure pipeline). This deployment is not completed unless the authoritative person confirms the process.
  • On map, we can change the colours and also add legend that explains he color distinctions.
  • Adding filters on the map, like country, date, organizations which own measuring devices,
  • Plot the frequency dataset and then add filters on that plot. like if we select country, then it should show the plot related to that specified country. Other filters can be date intervals, time intervals, regions, and organizations.
  • If we want to compare different dataset on the plot, we can also do this.
  • We can have a default plot whenever we render the page. This plot will show the most recently updated dataset.
  • When we update the dataset, it should show either as an alert or as a sidebar events section. this is clickable and when we click on this alert, it will go to the database page.
  • We can add Team' page.
  • Just like an idea of adding items in the cart, we can add multiple datasets and then download it as zip file.

Jekyll and website deployment

Here is the jekyll based theme in branch website.

I'd like to try to integrate a map from leaflet, which seems to have all the tools that we need.

The current configuration for jekyll uses a remote_theme, so we don't need the local css or html files.

[API] OSF API to website?

I've been chewing through OSF's API system and I think this might be the way to do to get the download scheme from their API sorted. Let's see if this is the way to go. For now I'll leave this issue here and we see if that makes sense

[New Data] 3-location PMU data from the Nordic Grid, 2020 (unspecified locations)

Adding 3 synchronous recordings from the Nordic Grid from 2020, provided by the Swedish TSO, upon personal request by me.
These comprise a full year of data, with 0.02 second resolution, from three locations in Sweden. Due to data protection policies, the exact locations of the recordings were not provided. These are simply: North Sweden, Mid Sweden, South Sweden.

This needs to be added to:

  • Map
  • Database

and we need to ensure

  • links to the project are detailed
  • links to the authors are detailed
  • licensing and referencing are detailed correctly

[New Data] Two new recordings from Palma de Mallorca, Spain

Two new recordings to include from the Power grid frequency data base

This includes an (almost) full year of 2020 taken in Tokyo, Japan, within the 50Hz Japanese Grid (Japan has several different operating grid, some at 50Hz, some at 60Hz).
This needs to be added to:

  • Map
  • Database

and we need to ensure

  • links to the project are detailed (as previously)
  • links to the authors are detailed (as previously)
  • licensing and referencing are detailed correctly (as previously)

[General] Purchasing a domain name on Google

I am planning to purchase a domain name for the power-grid frequency website, which, naturally, will be named: power-grid-frequecy.org. I will update this as the process progresses.

[ToDo] Typos and smaller issues

Small issues:

  • The location for the Krakow measure is off, it is not pointing to Krakow.
  • The recordings of the 2013 data in the Nordic Grid have the KIT logo on it when they should not.
  • Add different sampling rates to the README.

[to be continued]

[New Data] Tokyo, Japan (Japanese 50Hz Grid), 2020 - ACES project

The ACES project as a new dataset of power-grid frequency produced by Andreas Thingvad, Lisa Calearo, and Mattia Marinelli. They have granted us the right to add it to the database

This includes an (almost) full year of 2020 taken in Tokyo, Japan, within the 50Hz Japanese Grid (Japan has several different operating grid, some at 50Hz, some at 60Hz).
This needs to be added to:

  • Map
  • Database

and we need to ensure

  • links to the project are detailed
  • links to the authors are detailed
  • licensing and referencing are detailed correctly

The details are found here.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.