Git Product home page Git Product logo

favorites1 / rl-for-binary-computation-offloading-in-wireless-powered-mec-networks Goto Github PK

View Code? Open in Web Editor NEW

This project forked from jordan8409212/rl-for-binary-computation-offloading-in-wireless-powered-mec-networks

0.0 0.0 0.0 21.77 MB

It's a implementation about the paper Liang Huang, Suzhi Bi, and Ying-jun Angela Zhang, "Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks", on https://ieeexplore.ieee.org/document/8771176

Python 100.00%

rl-for-binary-computation-offloading-in-wireless-powered-mec-networks's Introduction

RL-for-binary-computation-offloading-in-wireless-powered-MEC-networks

I've modified some parameters and the number of neurons in the decoder network, and I switch the decoder method to 'K nearest neighbor'. This work considered a wireless powered mobile edge-computing network that follows binary offloading policy. That is, each computation is either computed on the energy harvesting WD or offloaded to an server(AP). The goal of DROO is to optimize the offloading decisions and allocate the resouces according to the channel conditions(channel gain).

Performance

  • The train loss and the test loss. In fact it's validation loss cause I calculate it during training phase. In addition, the decoder never seen these data.
  • train
  • The nomalized computation rate during training the nomalized computation rate is defined as follows

The blue curve denotes the moving average of \hat{Q} over the last 50 time frames, and the light blue shadow denotes the maximum and minimum of \hat{Q} in the last 50 frames.

  • train

I test the performance of the model every 100 time frames, we can see that \hat{Q} is almost 0.95 after 30000 time frames

  • train

Data

The folder includs all pre-generated training and testing data set, including:

  • data_#.mat: , where # = {10, 20, 30} is the number of WDs

Data samples are generated by enumerating all 2^N binary offloading actions for N <= 10 and by following the CD method presented in https://ieeexplore.ieee.org/document/8334188 for N = 20, 30. There are 30,000 (for N = 10, 20, 30) or 10,000 (otherwise) samples saved in each *.mat file. Where each data sample includes:

variable description
input_h The wireless channel gain between WDs and the AP
output_mode The optimal binary offloading action
output_a The optimal fraction of time that the AP broadcasts RF energy for the WDs to harvest
output_tau The optimal fraction of time allocated to WDs for task offloading
output_obj The optimal weighted sum computation rate

rl-for-binary-computation-offloading-in-wireless-powered-mec-networks's People

Contributors

jordan8409212 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.