Created Date: 26/08/2020
Last Updated Date: 03/09/2020

Created by team-20 in COMP90082 from UniMelb

Focusing on the question "What will the life of a child born now look like?", the "Children Now" project will collectively imagine the 100-year lifetime of a child born in 2020, creating a rare and extraordinary moment in the life of the Victorian era. Participants and visitors will have the opportunity to consciously sympathize with the next generation, who will inherit our culture, customs, and impact on the environment.

The project is expected to take ten days in 2021 to show people the 100 years of a "person" in the form of a 144-meter tall augmented reality (AR) sculpture. In the project, we collected the personal portraits and voices of 14,400 participants from all walks of life. fully represent the diversity of life in Victoria with different cultures, ages, languages, bodies, genders and voices. After sorting these portraits by the age of the participants, the giant will grow every minute for 10 days. When it grows from 1 to 100, the statue will continue to age by switching the face, body and voice of the contributor. People can see every moment of the life of the statue above Hammer Concert Hall through large screens and mobile phones, and can also watch screens throughout the city and around the world through real-time streaming.

For our team 20, our main task is divided into two parts: creating a mesh from Point cloud data captured from Azure for Kinect arrays and making an interactive interface suitable for people to enjoy our project.

In this project, the target of team 20 is to convert the collected data into images and capture and output the portraits, and then design an interactive interface as much as possible to allow users to better enjoy the results of our project.

1. Portraits should be capture from the central area without background.
2. Three camera should be implemented with individual output in the same fashion as above.
3. Recording can be started and stopped by technician on tablet or workstation
4. Recording can be started and stopped by user pressing button
5. Recording can run for a set time.
6. A ‘3, 2, 1’ countdown sound plays once button pressed.
7. A sound indicates when recording begins and end.
8. Sounds can play during the recording that contain instructions for the user or music.
9. Video or image can be displayed on the user screen while the recording plays.
10. quickly see if every prompt or instruction in a session has a take [are there any gaps]
11. quickly see if any prompt or instruction has more than one take [so they know they have to select the best one]
12. select the best take for an individual instruction or prompt
13. delete or move takes from a recording session
14. add a take from another recording session
15. save the recording session in the library

1. Collect data of participants.
2. Process audio files of participants.

• SuD: The Point Cloud to Mesh system.
• Actor: 14,400 Victorians(Users), Cameras, user-interation display, developers.

Scenario 1: User enters the recording area and touches the record button on the display. Three cameras will then start recording the user's movements. The Point Cloud Mesh System transfers the movements to the 3D hologram recording. After recording and transfer are finished, the user reviews the 3D hologram recording and in the meantime, the developer will review the recording quality. If the recording quality is qualified, the user will leave the recording area and enter the review area. In the review area, users input their Demographic Info into the display, and receive a 3D hologram recording from the system.

Scenario 2: User enters the Recording area and touches the record button on the display. Three cameras will then start recording the user's movements. The Point Cloud Mesh System transfers the movements to a 3D hologram for recording. After recording is finished, the user reviews the 3D hologram recording, and in the meantime, the developer will review the recording quality. If the quality of a recording is NOT qualified, the developer will ask the user to record again until the quality is qualified. Then user leaves the recording area and enters the review area. In the review area, user inputs his Demographic Info into the display, and receive a 3D hologram recording from the system.

Scenario 3: User enters the Recording area, and touches the Start Recording button on the user-interaction display. Three cameras will then start recording the user's movements. The Point Cloud Mesh transfers the movements to the 3D hologram recording. After recording is finished, the user reviews the 3D hologram recording, and the developer then reviews the recording quality. However, the user is not satisfied with the quality of the recording, so he asks for another recording. The system will then delete the old recording and record a new recording. When the quality of recording is satisfied to both user and developer, user can leave the recording area and enter the review area. In the review area, user inputs his Demographic Info into the display, and receives a 3D hologram recording from the system.

In order to complete the tasks of the project, we need several different capabilities and technologies. First, we need complex algorithms to convert 2D images to 3D models. During the process, unity should be used to establish and implement the 3D models. Besides, a functional user interface should be built to facilitate the communication between users and the system.

According to the requirements and the project timeline, our group establishes the following schedule for the semester to complete the expected tasks and assignments after the discussion.

The Kinect can transfers the users' movements data to Point Cloud. The users' movement data is captured by three cameras, before generate the fina 3D hologram recording, we need use Kinect to transfer RGB images to point cloud.

Unity can transfer the OBJ/FBX to final outcomes(Child of Now).

Any formal documentation that is needed in the span of the project is to be written and stored in the team Google Drive such that the documents pertaining to the project are available for all members of the development team. Also by utilizing Google Drive we will have version control of the documents as well and prevent version mismatch within the team.

Google Drive can be found here: LINK

As this project is developed utilizing the agile principles we are going to use Trello as our project management tool.

The Trello board can be found here: LINK

Child of now will utilize Trello in order to keep track of the project progress.

For this project (child of now) we are going to use github exclusively as our repository and version control system (VCS).

Do to the COVID-19 situation there it is not a and option to be co-located and some members not having the same time zone slack offers an easy way for team members to communicate and members can get all relevant information at their own leisure. Also restricting communication to a team channel also prevents the information from being lost or not communicated to every member of the team as its available for every member of the team.

Slack will also be integrated with every app that the development team uses when available using slack apps. This will allow team members to rapidly get a quick update on what has happened since they last check.

The slack group can be found here: LINK

There will also be a need for “face-to-face” communication, this will be handled using Zoom. This will happen either with the pre-scheduled meetings on Unimelb LMS or posted in Slack.