Submission 15653

Submission

15653

Competing

yes

Challenge

aido-LF-sim-validation

User

Keyan Pishdadian

Date submitted

2021-05-26 23:30:15+00:00

Last status update

2021-12-04 20:47:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 110907 sim-1of4: 110895 sim-2of4: 110906 sim-3of4: 110893

User label

modelv0-behavior-cloning

Admin priority

Blessing

n/a

User priority

110907

Click the images to see detailed statistics about the episode.

loop2-000

110906

Click the images to see detailed statistics about the episode.

loop-000

110895

Click the images to see detailed statistics about the episode.

autolab-000

110893

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

110907

sim-0of4

success

yes

2021-11-05 09:21:34+00:00

2021-11-05 09:23:09+00:00

0:01:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.650592574569903
survival_time_median	7.84999999999998
deviation-center-line_median	0.20636325204900607
in-drivable-lane_median	4.999999999999982

other stats

deviation-center-line_max	0.20636325204900607
deviation-center-line_mean	0.20636325204900607
deviation-center-line_min	0.20636325204900607
deviation-heading_max	1.1973049872665278
deviation-heading_mean	1.1973049872665278
deviation-heading_median	1.1973049872665278
deviation-heading_min	1.1973049872665278
distance-from-start_max	1.6452860110782537
distance-from-start_mean	1.6452860110782537
distance-from-start_median	1.6452860110782537
distance-from-start_min	1.6452860110782537
driven_any_max	1.676746842062352
driven_any_mean	1.676746842062352
driven_any_median	1.676746842062352
driven_any_min	1.676746842062352
driven_lanedir_consec_max	0.650592574569903
driven_lanedir_consec_mean	0.650592574569903
driven_lanedir_consec_min	0.650592574569903
driven_lanedir_max	0.650592574569903
driven_lanedir_mean	0.650592574569903
driven_lanedir_median	0.650592574569903
driven_lanedir_min	0.650592574569903
in-drivable-lane_max	4.999999999999982
in-drivable-lane_mean	4.999999999999982
in-drivable-lane_min	4.999999999999982
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.676746842062352, "survival_time": 7.84999999999998, "driven_lanedir": 0.650592574569903, "in-drivable-lane": 4.999999999999982, "deviation-heading": 1.1973049872665278, "distance-from-start": 1.6452860110782537, "deviation-center-line": 0.20636325204900607, "driven_lanedir_consec": 0.650592574569903}}
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	7.84999999999998
survival_time_min	7.84999999999998

No reset possible

110906

sim-2of4

success

yes

2021-11-05 09:20:59+00:00

2021-11-05 09:23:24+00:00

0:02:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.1375157055069267
survival_time_median	26.850000000000247
deviation-center-line_median	0.8269761442393427
in-drivable-lane_median	13.600000000000191

other stats

deviation-center-line_max	0.8269761442393427
deviation-center-line_mean	0.8269761442393427
deviation-center-line_min	0.8269761442393427
deviation-heading_max	4.932649400939787
deviation-heading_mean	4.932649400939787
deviation-heading_median	4.932649400939787
deviation-heading_min	4.932649400939787
distance-from-start_max	2.6082104320507837
distance-from-start_mean	2.6082104320507837
distance-from-start_median	2.6082104320507837
distance-from-start_min	2.6082104320507837
driven_any_max	7.228703605886832
driven_any_mean	7.228703605886832
driven_any_median	7.228703605886832
driven_any_min	7.228703605886832
driven_lanedir_consec_max	3.1375157055069267
driven_lanedir_consec_mean	3.1375157055069267
driven_lanedir_consec_min	3.1375157055069267
driven_lanedir_max	3.188869236898159
driven_lanedir_mean	3.188869236898159
driven_lanedir_median	3.188869236898159
driven_lanedir_min	3.188869236898159
in-drivable-lane_max	13.600000000000191
in-drivable-lane_mean	13.600000000000191
in-drivable-lane_min	13.600000000000191
per-episodes	details {"loop-000-ego0": {"driven_any": 7.228703605886832, "survival_time": 26.850000000000247, "driven_lanedir": 3.188869236898159, "in-drivable-lane": 13.600000000000191, "deviation-heading": 4.932649400939787, "distance-from-start": 2.6082104320507837, "deviation-center-line": 0.8269761442393427, "driven_lanedir_consec": 3.1375157055069267}}
simulation-passed	1
survival_time_max	26.850000000000247
survival_time_mean	26.850000000000247
survival_time_min	26.850000000000247

No reset possible

110903

sim-0of4

success

yes

2021-11-05 09:19:42+00:00

2021-11-05 09:21:03+00:00

0:01:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110897

sim-0of4

success

yes

2021-11-05 09:17:33+00:00

2021-11-05 09:19:28+00:00

0:01:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110896

sim-2of4

success

yes

2021-11-05 09:17:33+00:00

2021-11-05 09:20:20+00:00

0:02:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110895

sim-1of4

success

yes

2021-11-05 09:16:42+00:00

2021-11-05 09:18:19+00:00

0:01:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.2097218970209855
survival_time_median	9.55
deviation-center-line_median	0.4853028891617569
in-drivable-lane_median	2.6000000000000174

other stats

deviation-center-line_max	0.4853028891617569
deviation-center-line_mean	0.4853028891617569
deviation-center-line_min	0.4853028891617569
deviation-heading_max	1.6033133609727022
deviation-heading_mean	1.6033133609727022
deviation-heading_median	1.6033133609727022
deviation-heading_min	1.6033133609727022
distance-from-start_max	1.8217596069508304
distance-from-start_mean	1.8217596069508304
distance-from-start_median	1.8217596069508304
distance-from-start_min	1.8217596069508304
driven_any_max	2.8313898503429575
driven_any_mean	2.8313898503429575
driven_any_median	2.8313898503429575
driven_any_min	2.8313898503429575
driven_lanedir_consec_max	2.2097218970209855
driven_lanedir_consec_mean	2.2097218970209855
driven_lanedir_consec_min	2.2097218970209855
driven_lanedir_max	2.2097218970209855
driven_lanedir_mean	2.2097218970209855
driven_lanedir_median	2.2097218970209855
driven_lanedir_min	2.2097218970209855
in-drivable-lane_max	2.6000000000000174
in-drivable-lane_mean	2.6000000000000174
in-drivable-lane_min	2.6000000000000174
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.8313898503429575, "survival_time": 9.55, "driven_lanedir": 2.2097218970209855, "in-drivable-lane": 2.6000000000000174, "deviation-heading": 1.6033133609727022, "distance-from-start": 1.8217596069508304, "deviation-center-line": 0.4853028891617569, "driven_lanedir_consec": 2.2097218970209855}}
simulation-passed	1
survival_time_max	9.55
survival_time_mean	9.55
survival_time_min	9.55

No reset possible

110893

sim-3of4

success

yes

2021-11-05 09:14:59+00:00

2021-11-05 09:17:14+00:00

0:02:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7127281712494713
survival_time_median	18.70000000000013
deviation-center-line_median	0.443368430406808
in-drivable-lane_median	14.150000000000125

other stats

deviation-center-line_max	0.443368430406808
deviation-center-line_mean	0.443368430406808
deviation-center-line_min	0.443368430406808
deviation-heading_max	3.481743962521644
deviation-heading_mean	3.481743962521644
deviation-heading_median	3.481743962521644
deviation-heading_min	3.481743962521644
distance-from-start_max	3.860796446121827
distance-from-start_mean	3.860796446121827
distance-from-start_median	3.860796446121827
distance-from-start_min	3.860796446121827
driven_any_max	4.562756742188068
driven_any_mean	4.562756742188068
driven_any_median	4.562756742188068
driven_any_min	4.562756742188068
driven_lanedir_consec_max	0.7127281712494713
driven_lanedir_consec_mean	0.7127281712494713
driven_lanedir_consec_min	0.7127281712494713
driven_lanedir_max	0.7164190769804457
driven_lanedir_mean	0.7164190769804457
driven_lanedir_median	0.7164190769804457
driven_lanedir_min	0.7164190769804457
in-drivable-lane_max	14.150000000000125
in-drivable-lane_mean	14.150000000000125
in-drivable-lane_min	14.150000000000125
per-episodes	details {"zigzag-000-ego0": {"driven_any": 4.562756742188068, "survival_time": 18.70000000000013, "driven_lanedir": 0.7164190769804457, "in-drivable-lane": 14.150000000000125, "deviation-heading": 3.481743962521644, "distance-from-start": 3.860796446121827, "deviation-center-line": 0.443368430406808, "driven_lanedir_consec": 0.7127281712494713}}
simulation-passed	1
survival_time_max	18.70000000000013
survival_time_mean	18.70000000000013
survival_time_min	18.70000000000013

No reset possible

110892

sim-2of4

success

yes

2021-11-05 09:14:56+00:00

2021-11-05 09:17:14+00:00

0:02:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110889

sim-1of4

success

yes

2021-11-05 09:13:17+00:00

2021-11-05 09:16:15+00:00

0:02:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110888

sim-3of4

success

yes

2021-11-05 09:13:14+00:00

2021-11-05 09:14:45+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

92260

sim-3of4

success

2021-10-23 23:50:41+00:00

2021-10-23 23:57:12+00:00

0:06:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

92255

sim-0of4

success

2021-10-23 23:42:22+00:00

2021-10-23 23:50:24+00:00

0:08:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

92250

sim-2of4

success

2021-10-23 23:35:53+00:00

2021-10-23 23:41:53+00:00

0:06:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

92244

sim-1of4

success

2021-10-23 23:24:10+00:00

2021-10-23 23:35:00+00:00

0:10:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77556

sim-3of4

success

2021-05-26 23:59:13+00:00

2021-05-27 00:01:56+00:00

0:02:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77555

sim-2of4

success

2021-05-26 23:57:39+00:00

2021-05-27 00:05:04+00:00

0:07:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77554

sim-1of4

success

2021-05-26 23:57:37+00:00

2021-05-27 00:00:29+00:00

0:02:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77553

sim-3of4

success

2021-05-26 23:57:08+00:00

2021-05-26 23:58:52+00:00

0:01:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77552

sim-0of4

success

2021-05-26 23:57:08+00:00

2021-05-27 00:00:32+00:00

0:03:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77551

sim-1of4

success

2021-05-26 23:54:26+00:00

2021-05-26 23:57:24+00:00

0:02:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77550

sim-3of4

success

2021-05-26 23:54:21+00:00

2021-05-26 23:57:00+00:00

0:02:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77549

sim-0of4

success

2021-05-26 23:53:11+00:00

2021-05-26 23:56:36+00:00

0:03:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77548

sim-3of4

success

2021-05-26 23:52:39+00:00

2021-05-26 23:54:15+00:00

0:01:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77547

sim-3of4

success

2021-05-26 23:50:51+00:00

2021-05-26 23:52:33+00:00

0:01:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77546

sim-1of4

success

2021-05-26 23:50:48+00:00

2021-05-26 23:53:47+00:00

0:02:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77545

sim-2of4

success

2021-05-26 23:50:06+00:00

2021-05-26 23:57:25+00:00

0:07:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77544

sim-0of4

success

2021-05-26 23:49:31+00:00

2021-05-26 23:52:59+00:00

0:03:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77543

sim-1of4

success

2021-05-26 23:47:56+00:00

2021-05-26 23:50:42+00:00

0:02:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77542

sim-3of4

success

2021-05-26 23:47:24+00:00

2021-05-26 23:50:02+00:00

0:02:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77541

sim-0of4

success

2021-05-26 23:46:02+00:00

2021-05-26 23:49:08+00:00

0:03:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77540

sim-3of4

success

2021-05-26 23:44:29+00:00

2021-05-26 23:47:00+00:00

0:02:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77539

sim-1of4

success

2021-05-26 23:44:28+00:00

2021-05-26 23:47:24+00:00

0:02:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77538

sim-0of4

success

2021-05-26 23:42:16+00:00

2021-05-26 23:45:30+00:00

0:03:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77537

sim-2of4

success

2021-05-26 23:42:14+00:00

2021-05-26 23:49:50+00:00

0:07:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77536

sim-3of4

success

2021-05-26 23:41:44+00:00

2021-05-26 23:44:01+00:00

0:02:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77535

sim-1of4

success

2021-05-26 23:41:05+00:00

2021-05-26 23:44:01+00:00

0:02:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77534

sim-3of4

success

2021-05-26 23:39:43+00:00

2021-05-26 23:41:24+00:00

0:01:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77533

sim-0of4

success

2021-05-26 23:37:58+00:00

2021-05-26 23:41:55+00:00

0:03:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77532

sim-1of4

success

2021-05-26 23:37:56+00:00

2021-05-26 23:40:38+00:00

0:02:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77531

sim-3of4

success

2021-05-26 23:37:25+00:00

2021-05-26 23:39:12+00:00

0:01:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77530

sim-2of4

success

2021-05-26 23:32:31+00:00

2021-05-26 23:42:02+00:00

0:09:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77529

sim-1of4

success

2021-05-26 23:32:26+00:00

2021-05-26 23:37:32+00:00

0:05:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77528

sim-0of4

success

2021-05-26 23:32:16+00:00

2021-05-26 23:37:50+00:00

0:05:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77527

sim-3of4

success

2021-05-26 23:32:14+00:00

2021-05-26 23:36:55+00:00

0:04:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible