Git Product home page Git Product logo

mp-dl-unh's People

Watchers

 avatar  avatar  avatar

mp-dl-unh's Issues

Burst selections have zero length

The process creates selections that have zero duration. E.g. the file

gls_selections_mp-dl-unh_2019-10-23-06-46-10.csv

contains the following selection

2019-10-22 20:26:20,2019-10-22 20:26:20,150.0,MP crossing (automatically generated)

All selections should have a minimum duration of 10 seconds.

Burst selections can be ~40 hrs in duration

Some of the selections are ~40hrs in duration. Below is a list of all selections > 1 hr in duration. Some of the shorter selections, like 2019-10-22 20:27:10 with ∆t = 4190 appears real based on the quick-look plots, and the file itself contains multiple selections. Files with longer selections, such as 2020-01-18 05:16:43 with ∆t = 149900 are unrealistic, appear to span the entire first 2 science ROIs for the orbit [see plots 1, 2, 3, 4], and have only this one selection. The three ROIs for the latter interval, occurring during orbit 1076, span from 2020-01-18 05:16:01 UTC to 2020-01-21 09:54:09 UTC.

                                            FILE               TSTART                TSTOP  ∆t
gls_selections_mp-dl-unh_2019-10-23-06-46-10.csv  2019-10-22 20:28:20  2019-10-22 21:37:00  4120
gls_selections_mp-dl-unh_2019-10-26-17-07-23.csv  2019-10-22 20:25:40  2019-10-22 21:58:10  5550
gls_selections_mp-dl-unh_2019-10-26-19-17-40.csv  2019-10-22 20:28:30  2019-10-22 21:37:00  4110
gls_selections_mp-dl-unh_2019-10-26-22-57-28.csv  2019-10-22 20:27:10  2019-10-22 21:37:00  4190
gls_selections_mp-dl-unh_2019-10-27-20-46-24.csv  2019-10-26 03:46:20  2019-10-27 00:24:20  74280
gls_selections_mp-dl-unh_2019-10-27-21-56-28.csv  2019-10-26 03:46:50  2019-10-27 00:25:10  74300
gls_selections_mp-dl-unh_2019-10-27-22-56-13.csv  2019-10-26 03:47:00  2019-10-27 00:25:00  74280
gls_selections_mp-dl-unh_2019-10-28-00-06-55.csv  2019-10-26 03:46:40  2019-10-27 00:24:50  74290
gls_selections_mp-dl-unh_2019-10-31-03-55-59.csv  2019-10-29 16:36:30  2019-10-30 12:55:20  73130
gls_selections_mp-dl-unh_2019-11-03-21-56-42.csv  2019-11-02 05:07:10  2019-11-03 01:10:20  72190
gls_selections_mp-dl-unh_2019-11-04-00-46-42.csv  2019-11-02 05:06:50  2019-11-03 01:10:10  72200
gls_selections_mp-dl-unh_2019-11-06-03-16-05.csv  2019-11-05 17:12:10  2019-11-05 23:27:20  22510
gls_selections_mp-dl-unh_2019-11-07-12-07-06.csv  2019-11-05 17:12:00  2019-11-06 12:50:10  70690
gls_selections_mp-dl-unh_2019-11-10-03-56-14.csv  2019-11-09 04:56:50  2019-11-10 00:15:10  69500
gls_selections_mp-dl-unh_2019-11-10-22-06-12.csv  2019-11-09 04:57:10  2019-11-10 00:15:20  69490
gls_selections_mp-dl-unh_2019-11-11-00-36-26.csv  2019-11-09 04:57:00  2019-11-10 00:15:00  69480
gls_selections_mp-dl-unh_2019-11-17-08-16-22.csv  2019-11-16 04:07:03  2019-11-16 22:35:23  66500
gls_selections_mp-dl-unh_2019-11-24-07-55-34.csv  2019-11-23 04:02:13  2019-11-23 21:30:23  62890
gls_selections_mp-dl-unh_2019-11-28-04-25-25.csv  2019-11-26 15:31:43  2019-11-27 08:30:13  61110
gls_selections_mp-dl-unh_2019-11-28-12-06-04.csv  2019-11-26 15:31:53  2019-11-27 08:30:23  61110
gls_selections_mp-dl-unh_2019-11-28-13-55-40.csv  2019-11-26 15:32:03  2019-11-27 08:30:24  61101
gls_selections_mp-dl-unh_2019-12-01-06-45-06.csv  2019-11-30 04:02:03  2019-11-30 20:30:03  59280
gls_selections_mp-dl-unh_2019-12-08-05-25-14.csv  2019-12-07 04:16:43  2019-12-07 19:35:13  55110
gls_selections_mp-dl-unh_2019-12-08-21-34-35.csv  2019-12-07 04:17:03  2019-12-07 19:35:13  55090
gls_selections_mp-dl-unh_2019-12-09-04-35-04.csv  2019-12-07 04:16:33  2019-12-08 17:20:03  133410
gls_selections_mp-dl-unh_2019-12-15-02-44-32.csv  2019-12-14 04:16:53  2019-12-14 18:35:03  51490
gls_selections_mp-dl-unh_2019-12-15-23-44-24.csv  2019-12-14 04:17:04  2019-12-14 18:35:03  51479
gls_selections_mp-dl-unh_2019-12-16-02-34-34.csv  2019-12-14 04:16:43  2019-12-15 20:40:03  145400
gls_selections_mp-dl-unh_2019-12-23-03-44-43.csv  2019-12-21 04:26:43  2019-12-22 20:35:03  144500
gls_selections_mp-dl-unh_2019-12-23-12-54-47.csv  2019-12-21 04:26:53  2019-12-22 20:35:03  144490
gls_selections_mp-dl-unh_2019-12-25-03-44-18.csv  2019-12-24 15:47:03  2019-12-24 23:57:33  29430
gls_selections_mp-dl-unh_2019-12-29-10-13-42.csv  2019-12-28 04:27:03  2019-12-28 16:45:04  44281
gls_selections_mp-dl-unh_2020-01-02-17-54-07.csv  2019-12-31 16:06:53  2020-01-01 04:00:03  42790
gls_selections_mp-dl-unh_2020-01-02-22-33-50.csv  2019-12-31 16:06:43  2020-01-01 04:00:03  42800
gls_selections_mp-dl-unh_2020-01-06-02-43-51.csv  2020-01-04 04:51:44  2020-01-05 18:30:03  135499
gls_selections_mp-dl-unh_2020-01-06-04-34-02.csv  2020-01-04 04:51:53  2020-01-05 18:29:53  135480
gls_selections_mp-dl-unh_2020-01-06-11-54-17.csv  2020-01-04 04:52:03  2020-01-05 16:20:33  127710
gls_selections_mp-dl-unh_2020-01-12-07-43-48.csv  2020-01-11 04:57:04  2020-01-11 15:45:13  38889
gls_selections_mp-dl-unh_2020-01-13-03-13-23.csv  2020-01-11 04:56:43  2020-01-12 20:20:03  141800
gls_selections_mp-dl-unh_2020-01-13-11-23-26.csv  2020-01-11 04:56:44  2020-01-12 20:19:53  141789
gls_selections_mp-dl-unh_2020-01-14-02-33-29.csv  2020-01-11 04:57:03  2020-01-12 20:20:14  141791
gls_selections_mp-dl-unh_2020-01-19-08-22-50.csv  2020-01-18 05:17:03  2020-01-18 15:30:13  36790
gls_selections_mp-dl-unh_2020-01-20-04-33-13.csv  2020-01-18 05:16:43  2020-01-19 22:55:03  149900
gls_selections_mp-dl-unh_2020-01-23-11-43-41.csv  2020-01-21 16:46:53  2020-01-22 02:45:04  35891
gls_selections_mp-dl-unh_2020-01-23-12-43-36.csv  2020-01-21 16:46:43  2020-01-22 02:44:53  35890

Model results do not seem to be reproducible

The model seems to produce new selections every time it runs, even if it is run on the same set of data. Below are the sorted, non-overlapping selections for a few days' worth of selections. TSTART, TSTOP, FOM, SOURCEID, and, DISCUSSION describe the time interval, ranking, gls model, and description of the event. CREATETIME is the generation time of the file containing the respective selection.

import datetime as dt
from pymms.pymms import selections as sel

t1 = dt.datetime(2019, 12, 3, 15, 40, 58)
t2 = dt.datetime(2019, 12, 7, 0, 0)

data = sel.selections('gls', t1, t2, unique=True)
sel.print_selections(data, full=True)

Gives are the results. Note that if overlapping segements are included, the number of selections increases from 105 to 616.

             TSTART                 TSTOP            CREATETIME     FOM    SOURCEID   DISCUSSION
2019-11-30 06:06:53   2019-11-30 06:11:13   2019-12-04 01:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-11-30 06:24:53   2019-11-30 06:33:13   2019-12-04 01:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-11-30 06:37:13   2019-11-30 06:37:43   2019-12-04 01:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-11-30 06:39:43   2019-11-30 07:01:03   2019-12-04 01:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 15:41:43   2019-12-03 15:50:33   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 15:54:13   2019-12-03 15:55:03   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 15:58:33   2019-12-03 15:59:33   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 16:05:33   2019-12-03 16:06:13   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 18:45:03   2019-12-03 18:45:13   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 18:47:54   2019-12-03 18:48:43   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 18:56:13   2019-12-03 18:59:23   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 19:01:43   2019-12-03 19:04:33   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 21:43:03   2019-12-03 21:43:13   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 21:48:53   2019-12-03 21:52:33   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 21:55:13   2019-12-03 21:58:13   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 22:10:33   2019-12-03 22:11:23   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-03 22:11:53   2019-12-03 22:12:53   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 03:02:43   2019-12-05 03:03:03   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 03:15:33   2019-12-05 03:15:43   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 03:36:13   2019-12-05 03:36:23   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 03:45:13   2019-12-05 03:45:23   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 03:51:53   2019-12-05 03:52:03   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 03:52:23   2019-12-05 03:52:33   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:02:04   2019-12-05 04:02:14   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:02:23   2019-12-05 04:02:33   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:05:34   2019-12-05 04:05:44   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:06:54   2019-12-05 04:07:03   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:07:24   2019-12-05 04:07:34   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:07:44   2019-12-05 04:09:04   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:09:43   2019-12-05 04:10:03   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:10:03   2019-12-05 04:10:54   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:12:14   2019-12-05 04:12:24   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:12:53   2019-12-05 04:13:03   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:13:23   2019-12-05 04:13:43   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:14:13   2019-12-05 04:14:23   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:14:53   2019-12-05 04:15:03   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:15:13   2019-12-05 04:15:23   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:15:33   2019-12-05 04:15:53   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:16:13   2019-12-05 04:17:23   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:17:33   2019-12-05 04:19:13   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:21:43   2019-12-05 04:22:23   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:23:44   2019-12-05 04:23:54   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:24:03   2019-12-05 04:24:13   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:24:23   2019-12-05 04:24:33   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:25:33   2019-12-05 04:26:23   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:27:04   2019-12-05 04:28:34   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:29:03   2019-12-05 04:29:23   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:31:13   2019-12-05 04:32:24   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:32:34   2019-12-05 04:32:44   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:34:34   2019-12-05 04:36:23   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:36:43   2019-12-05 04:36:53   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:37:24   2019-12-05 04:37:33   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:37:44   2019-12-05 04:37:54   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:38:43   2019-12-05 04:39:13   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:41:23   2019-12-05 04:41:33   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:42:43   2019-12-05 04:42:53   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:44:03   2019-12-05 04:45:24   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:46:13   2019-12-05 04:46:43   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:47:03   2019-12-05 04:47:13   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:47:43   2019-12-05 04:49:24   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:49:43   2019-12-05 04:49:53   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:50:03   2019-12-05 04:50:13   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:50:43   2019-12-05 04:50:53   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:51:14   2019-12-05 04:51:53   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:52:03   2019-12-05 04:53:23   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:54:13   2019-12-05 04:55:53   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:56:53   2019-12-05 04:57:23   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:57:24   2019-12-05 04:58:14   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:59:13   2019-12-05 04:59:23   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:59:33   2019-12-05 04:59:43   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 04:59:44   2019-12-05 05:00:04   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:00:53   2019-12-05 05:02:03   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:02:13   2019-12-05 05:03:13   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:05:03   2019-12-05 05:05:54   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:06:13   2019-12-05 05:06:33   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:08:54   2019-12-05 05:09:04   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:09:13   2019-12-05 05:10:53   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:10:54   2019-12-05 05:13:13   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:13:54   2019-12-05 05:16:34   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:16:44   2019-12-05 05:16:54   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:16:54   2019-12-05 05:19:04   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:20:03   2019-12-05 05:23:23   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:23:23   2019-12-05 05:23:24   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:23:34   2019-12-05 05:23:44   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:24:14   2019-12-05 05:24:34   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:25:33   2019-12-05 05:25:53   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:26:33   2019-12-05 05:27:23   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:28:34   2019-12-05 05:30:53   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:31:33   2019-12-05 05:31:43   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:31:54   2019-12-05 05:32:14   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:33:23   2019-12-05 05:34:13   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:35:13   2019-12-05 05:35:33   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:35:53   2019-12-05 05:36:03   2019-12-06 20:46:48   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:36:04   2019-12-05 05:37:13   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:44:53   2019-12-05 05:45:03   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:45:53   2019-12-05 05:46:03   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:48:13   2019-12-05 05:48:23   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:49:23   2019-12-05 05:49:33   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:49:43   2019-12-05 05:49:53   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:50:14   2019-12-05 05:50:24   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:50:34   2019-12-05 05:50:44   2019-12-06 22:26:14   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:53:43   2019-12-05 05:54:03   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:56:23   2019-12-05 05:57:33   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:57:53   2019-12-05 05:58:03   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)
2019-12-05 05:58:43   2019-12-05 05:58:53   2019-12-06 19:16:20   150.0   mp-dl-unh   MP crossing (automatically generated)

Feature corrections

Some of the features are calculated or read from file incorrectly. I know you said you got some of these already, but I am going to put them all here anyway. Feel free to close it immediately.

DES

Missing columns from energyspectr_omni, bulkv, heatq. Namely, energyspectr_omni_31, 'bulkv_2orheatq_2`.

if fpi_dis_cdf[var][...].ndim > 1:  # Data includes more than one measurement
    for i in range(0, fpi_dis_cdf[var].shape[1] - 1):
        fpi_dis_df[var + f'_{i}'] = fpi_dis_cdf[var][:, i]

should be (no - 1)

if fpi_dis_cdf[var][...].ndim > 1:  # Data includes more than one measurement
    for i in range(0, fpi_dis_cdf[var].shape[1]):
        fpi_dis_df[var + f'_{i}'] = fpi_dis_cdf[var][:, i]

DIS

Same problem as for DES

AFG

Bz_Q was calculated using Bx

Multiple Instruments

  • plasma_beta should be (Pi + Pe) / P_B, where Pi, Pe, and P_B are the (scalar) pressures from DIS, DES, and AFG.
  • temperature_ratio should be Ti/Te, where Ti and Te are the scalar temperatures from DIS and DES

Burst selections are too long

In EVA, the tool used to make SITL selections, the default selection size is 150 seconds. Selections that are longer than that are broken into contiguous chunks. Any GLS selection with duration longer than 150 seconds should be split into several selections of duration <= 150s.

Burst selections can have durations < 0 seconds

The following selections have durations less than 0 seconds.

                                            FILE               TSTART                TSTOP  ∆T
gls_selections_mp-dl-unh_2019-12-06-05-05-45.csv  2019-12-05 04:17:44  2019-12-05 04:17:43  -1
gls_selections_mp-dl-unh_2019-12-06-05-05-45.csv  2019-12-05 05:40:44  2019-12-05 05:40:43  -1
gls_selections_mp-dl-unh_2020-01-15-06-13-06.csv  2020-01-14 16:31:54  2020-01-14 16:31:53  -1

Model not making selections

The model appears to be missing selections in SROI3. One example is from orbit 1066. The SITL window is the time period that the SITL has to make and submit selections. The DSN contacts are the times when the satellites can transmit data to the ground. For orbit 1066, some of the data was transmitted after the SITL window closed. This caused us to submit selections to the "back structure", equivalent to sys-admin override of the standard SITL process.

SC    Orbit         Start DSN Contact           End DSN Contact        gls_selections
mms1   1066   2019-12-14T10:25:00.000   2019-12-14T12:15:00.000   2019-12-14 14:15:41
mms2   1066   2019-12-14T12:30:00.000   2019-12-14T14:20:00.000   2019-12-14 16:25:50
mms3   1066   2019-12-14T21:40:00.000   2019-12-15T00:40:00.000
-------------------------SITL WINDOW OPENS 2019-12-14 23:12:28-----------------------
mms4   1066   2019-12-15T00:55:00.000   2019-12-15T01:35:00.000   2019-12-15 02:44:32
mms1   1066   2019-12-15T01:40:00.000   2019-12-15T03:15:00.000   2019-12-15 05:14:25
mms2   1066   2019-12-15T05:40:00.000   2019-12-15T07:15:00.000
mms3   1066   2019-12-15T07:30:00.000   2019-12-15T09:05:00.000   2019-12-15 09:14:36
                                                                  2019-12-15 11:04:22
mms4   1066   2019-12-15T15:30:00.000   2019-12-15T17:05:00.000
mms1   1066   2019-12-15T17:20:00.000   2019-12-15T18:10:00.000
mms2   1066   2019-12-15T18:25:00.000   2019-12-15T19:15:00.000   2019-12-15 20:14:29
mms3   1066   2019-12-15T19:45:00.000   2019-12-15T20:35:00.000   2019-12-15 21:14:21
mms4   1066   2019-12-15T20:50:00.000   2019-12-15T21:40:00.000   2019-12-15 22:34:27
                                                                  2019-12-15 23:44:24
mms1   1066   2019-12-15T21:55:00.000   2019-12-16T00:35:00.000   2019-12-16 02:34:34
mms2   1066   2019-12-16T01:20:00.000   2019-12-16T04:00:00.000   2019-12-16 06:04:44
mms3   1066   2019-12-16T04:35:00.000   2019-12-16T06:15:00.000   2019-12-16 08:14:40
mms4   1066   2019-12-16T09:35:00.000   2019-12-16T11:15:00.000   2019-12-16 13:14:53
------------------------SITL WINDOW CLOSES 2019-12-17 12:02:15-----------------------
mms1   1066   2019-12-16T19:10:00.000   2019-12-16T20:30:00.000   2019-12-16 22:35:08
mms2   1066   2019-12-17T00:30:00.000   2019-12-17T01:50:00.000
mms3   1066   2019-12-17T02:05:00.000   2019-12-17T03:25:00.000   2019-12-17 03:55:28
mms4   1066   2019-12-17T03:40:00.000   2019-12-17T05:00:00.000   2019-12-17 05:25:45
                                                                  2019-12-17 07:05:40
mms1   1067   2019-12-17T19:10:00.000   2019-12-17T21:00:00.000
mms2   1067   2019-12-17T21:15:00.000   2019-12-17T23:05:00.000   2019-12-17 23:06:06
mms3   1067   2019-12-17T23:20:00.000   2019-12-18T01:10:00.000   2019-12-18 01:06:29
mms4   1067   2019-12-18T01:15:00.000   2019-12-18T03:05:00.000   2019-12-18 03:15:03

The SITL selected magnetopause crossings between 0400 and 0600 on 17 Dec. 2019 and submitted them in the back structure (7th panel in the plot below). This "late" data was indeed processed by our model; however, the model made no selections (see 6th panel).

burst_selections_orbit-1066_sroi-3

We should run the model again for orbit 1066 SROI3 from 2019-12-16 17:56:00 to 2019-12-17 08:08:59.000 to see if it can now identify the magnetopause crossings during that interval.

Below are the gls_selections files surrounding the final DSN contacts of the orbit:

gls_selections_mp-dl-unh_2019-12-16-22-35-08.csv
gls_selections_mp-dl-unh_2019-12-17-03-55-28.csv
gls_selections_mp-dl-unh_2019-12-17-05-25-45.csv
gls_selections_mp-dl-unh_2019-12-17-07-05-40.csv
gls_selections_mp-dl-unh_2019-12-17-23-06-06.csv
gls_selections_mp-dl-unh_2019-12-18-01-06-29.csv

As well as their basic contents, although the selections are not exactly the same in all files.

2019-12-14 06:04:43   2019-12-14 06:16:54   150.0   MP crossing (automatically generated)
2019-12-14 06:20:34   2019-12-14 06:33:24   150.0   MP crossing (automatically generated)
2019-12-14 06:34:14   2019-12-14 06:37:33   150.0   MP crossing (automatically generated)
2019-12-14 06:47:43   2019-12-14 06:51:13   150.0   MP crossing (automatically generated)
2019-12-14 06:52:23   2019-12-14 06:55:03   150.0   MP crossing (automatically generated)
2019-12-14 06:56:23   2019-12-14 07:00:03   150.0   MP crossing (automatically generated)
2019-12-14 07:07:43   2019-12-14 07:10:33   150.0   MP crossing (automatically generated)
2019-12-14 07:12:33   2019-12-14 07:13:33   150.0   MP crossing (automatically generated)
2019-12-14 07:18:23   2019-12-14 07:22:03   150.0   MP crossing (automatically generated)
2019-12-14 09:57:33   2019-12-14 09:58:13   150.0   MP crossing (automatically generated)
2019-12-14 09:59:03   2019-12-14 10:01:53   150.0   MP crossing (automatically generated)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.