Git Product home page Git Product logo

dpdg-env's Introduction

DPDG Environment and Periocular Depth Estimation for Eye Health in VR

This repository contains the Dynamic Periocular Data Generation (DPDG) environment and our depth estimation model code, as introduced in our research paper on eye health in Virtual Reality (VR).

Contents

Introduction

The captivating realism offered by Virtual Reality (VR) brings along challenges, including potential eye strain and long-term visual impairments for users. To combat these side effects and further the understanding of eye health in VR, this repository presents two primary contributions:

  1. Dynamic Periocular Data Generation (DPDG): An innovative environment based on UE MetaHuman, designed to synthesize a plethora of training images from a limited set of human facial scan data. This addresses the data collection challenges inherent in VR research.

  2. Periocular Depth Estimation: Building on the U-Net 3+ deep learning architecture, we've developed and fine-tuned a method for estimating periocular depth maps. This tool aids in reconstructing three-dimensional periocular regions, providing a foundation for in-depth analyses related to light stimulus and medical guidelines in VR.

By open-sourcing these tools, we aim to drive forward research on eye health in VR and invite collaboration from the broader scientific community.

Usage

Please see the readme files in subfolders

Data Access

The raw data from our experiments contains sensitive facial information. To ensure the confidentiality of our participants, those interested in accessing the raw data must contact the authors directly and sign a Non-Disclosure Agreement (NDA).

Email: [email protected]

Contribution and Feedback

We welcome contributions and feedback on our code. If you find any issues or have suggestions, please open an issue or submit a pull request.

License

This project is licensed under the GPL-3.0 License]. See the LICENSE file for details.

Citation

If you find our work useful for your research, please consider citing our paper: "To be released soon"

dpdg-env's People

Contributors

sunyitong avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.