Separate between baseline and experimental data about hyperscanning2-redesign HOT 21 CLOSED

In the end of this issue, it should go directly to issue #7. Since it is related to each other.

from hyperscanning2-redesign.

• Check the previous script
• Get all markers and put into a list
• Get data only up to the 6th marker (baseline data)
• - [ ] Save the data as *.fif file
• Get data from 7th - 24th marker (experimental data
• Save the data as *.fif file

from hyperscanning2-redesign.

ae334cb separate baseline data and experimental data. It also convert it into numpy array so that it can be loaded into mne python.

To-do :

• load into mne
• give a proper name. give baseline in the end of each file
• see the experimental data section in that script
• Save the data as *.fif file

from hyperscanning2-redesign.

895c183 has covered the following issues

• separate baseline data and load into mne
• save it into mne format (*.fif file)

To-Do :

• get a file name from original file
• search files of csv in folder so that we need to put folder path that contains csv files as input of function and sort it out ascending order
• work on experimental data and follow the whole process similar like a previous script

from hyperscanning2-redesign.

9da7466 has covered the following issue

• get a file name from original file
• search files of csv in folder so that we need to put folder path that contains csv files as input of function and sort it out ascending order

To-Do :

• test with all files

from hyperscanning2-redesign.

141d5ca extract all baseline data. We can put excepted data that is not being processed now. For example, EEG-S8.csv is corrupted. No need to be processed further. Please add more if there are other corrupted files later on.

To-Do :

• Create a separate function to extract experimental data
• Change the name of function of extract_eeg inside this file141d5ca17bd6f18c7e77fa5539a823d2efe09968 into extract_baseline_data function
• Create option to create a list of bad files to skip. By default is empty list. If it is empty, then skip or continue process as usual.

from hyperscanning2-redesign.

b682bbd in progress to detect bad files in list.
We want to put a list of bad files as argument of function.
Not success yet

from hyperscanning2-redesign.

6ef345d can skip bad files that are defined in a list

from hyperscanning2-redesign.

39b39a6 Extracted & separated raw files of baseline to each hand condition. Note that for baseline, all eye conditions are run in averted eye only

from hyperscanning2-redesign.

127f7f7 turn to function for extracting baseline data

To-Do :

• Make a better explanation or documentation for the function. See in the internet.
• For being adopted to extracting experimental data, change the labelsequence to be list.
• Clean up the code.

See below comment for the ticked list (no.1 and 3)

from hyperscanning2-redesign.

6683d1f incorporated the above to-do list, particularly for no.1& 3.
Clean code and better documentation about the function.

from hyperscanning2-redesign.

cea8f8a extract experimental data. See the section extract experimental data
Need some cleaning up and change variable name from baseline to experimental

from hyperscanning2-redesign.

100d449 module to separate baseline and experimental data. It can be imported.
This is in *.py file. Name and variables in extract_experimental_data has been cleaned and and adjusted accordingly (as requested above).

There are two functions in extract_eeg_data.py

1. extract_baseline_data
   2. extract_experimental_data

ToDo:
Needs to be merged to master

from hyperscanning2-redesign.

Merged to main branch here 3730f78

from hyperscanning2-redesign.

74598ed module in *.py to extract eye tracker data

This commit is not related to EEG remember. It is related to EYE TRACKER DATA

from hyperscanning2-redesign.

Change the loop (line 31) inside 74598ed

From for (root, dirs, file) in os.walk(path_2_csv_files): to for file in os.listdir(path_2_csv_files):

The current code's issue is :

1. It takes also a subfolder and its content which is located under the folder of raw csv files
   We don't want that

The resulted filename should be *.fif not csv

From this

To this

Please change accordingly if anyting that is affected in extract_eeg_data.py file

from hyperscanning2-redesign.

6822042 has solved the above issue. Now, it only takes files within specified folder that is defined in path_2_csv_files excluding files that are contained in the subfolders.

• Cleaned up the code
• Put into module that is in .py file

from hyperscanning2-redesign.

0cb2f74 code has been cleaned up (see section of Extract baseline_eeg_data_function)

from hyperscanning2-redesign.

for extract_experimental_eeg_data function still has an issue

from hyperscanning2-redesign.

e04adc0 the above issue has been solved.
ToDo :

• Clean up - change variable names that fit to experimental. It is still in baseline related variables
• Turn to a function
• Git revert for file *.py

from hyperscanning2-redesign.

Jupyterlab
c3ea46d use this if we want to use jupyter lab

Python file
2e2b86e it is using *.py file

from hyperscanning2-redesign.