Submission 15653

Submission

15653

Competing

yes

Challenge

aido-LF-sim-validation

User

Keyan Pishdadian

Date submitted

2021-05-26 23:30:15+00:00

Last status update

2021-12-04 20:47:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 110907 sim-1of4: 110895 sim-2of4: 110906 sim-3of4: 110893

User label

modelv0-behavior-cloning

Admin priority

Blessing

n/a

User priority

110907

Click the images to see detailed statistics about the episode.

loop2-000

110906

Click the images to see detailed statistics about the episode.

loop-000

110895

Click the images to see detailed statistics about the episode.

autolab-000

110893

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

110907

sim-0of4

success

yes

2021-11-05 09:21:34+00:00

2021-11-05 09:23:09+00:00

0:01:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.650592574569903
survival_time_median	7.84999999999998
deviation-center-line_median	0.20636325204900607
in-drivable-lane_median	4.999999999999982

other stats

deviation-center-line_max	0.20636325204900607
deviation-center-line_mean	0.20636325204900607
deviation-center-line_min	0.20636325204900607
deviation-heading_max	1.1973049872665278
deviation-heading_mean	1.1973049872665278
deviation-heading_median	1.1973049872665278
deviation-heading_min	1.1973049872665278
distance-from-start_max	1.6452860110782537
distance-from-start_mean	1.6452860110782537
distance-from-start_median	1.6452860110782537
distance-from-start_min	1.6452860110782537
driven_any_max	1.676746842062352
driven_any_mean	1.676746842062352
driven_any_median	1.676746842062352
driven_any_min	1.676746842062352
driven_lanedir_consec_max	0.650592574569903
driven_lanedir_consec_mean	0.650592574569903
driven_lanedir_consec_min	0.650592574569903
driven_lanedir_max	0.650592574569903
driven_lanedir_mean	0.650592574569903
driven_lanedir_median	0.650592574569903
driven_lanedir_min	0.650592574569903
in-drivable-lane_max	4.999999999999982
in-drivable-lane_mean	4.999999999999982
in-drivable-lane_min	4.999999999999982
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.676746842062352, "survival_time": 7.84999999999998, "driven_lanedir": 0.650592574569903, "in-drivable-lane": 4.999999999999982, "deviation-heading": 1.1973049872665278, "distance-from-start": 1.6452860110782537, "deviation-center-line": 0.20636325204900607, "driven_lanedir_consec": 0.650592574569903}}
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	7.84999999999998
survival_time_min	7.84999999999998

No reset possible

110906

sim-2of4

success

yes

2021-11-05 09:20:59+00:00

2021-11-05 09:23:24+00:00

0:02:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.1375157055069267
survival_time_median	26.850000000000247
deviation-center-line_median	0.8269761442393427
in-drivable-lane_median	13.600000000000191

other stats

deviation-center-line_max	0.8269761442393427
deviation-center-line_mean	0.8269761442393427
deviation-center-line_min	0.8269761442393427
deviation-heading_max	4.932649400939787
deviation-heading_mean	4.932649400939787
deviation-heading_median	4.932649400939787
deviation-heading_min	4.932649400939787
distance-from-start_max	2.6082104320507837
distance-from-start_mean	2.6082104320507837
distance-from-start_median	2.6082104320507837
distance-from-start_min	2.6082104320507837
driven_any_max	7.228703605886832
driven_any_mean	7.228703605886832
driven_any_median	7.228703605886832
driven_any_min	7.228703605886832
driven_lanedir_consec_max	3.1375157055069267
driven_lanedir_consec_mean	3.1375157055069267
driven_lanedir_consec_min	3.1375157055069267
driven_lanedir_max	3.188869236898159
driven_lanedir_mean	3.188869236898159
driven_lanedir_median	3.188869236898159
driven_lanedir_min	3.188869236898159
in-drivable-lane_max	13.600000000000191
in-drivable-lane_mean	13.600000000000191
in-drivable-lane_min	13.600000000000191
per-episodes	details {"loop-000-ego0": {"driven_any": 7.228703605886832, "survival_time": 26.850000000000247, "driven_lanedir": 3.188869236898159, "in-drivable-lane": 13.600000000000191, "deviation-heading": 4.932649400939787, "distance-from-start": 2.6082104320507837, "deviation-center-line": 0.8269761442393427, "driven_lanedir_consec": 3.1375157055069267}}
simulation-passed	1
survival_time_max	26.850000000000247
survival_time_mean	26.850000000000247
survival_time_min	26.850000000000247

No reset possible

110903

sim-0of4

success

yes

2021-11-05 09:19:42+00:00

2021-11-05 09:21:03+00:00

0:01:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110897

sim-0of4

success

yes

2021-11-05 09:17:33+00:00

2021-11-05 09:19:28+00:00

0:01:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110896

sim-2of4

success

yes

2021-11-05 09:17:33+00:00

2021-11-05 09:20:20+00:00

0:02:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110895

sim-1of4

success

yes

2021-11-05 09:16:42+00:00

2021-11-05 09:18:19+00:00

0:01:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.2097218970209855
survival_time_median	9.55
deviation-center-line_median	0.4853028891617569
in-drivable-lane_median	2.6000000000000174

other stats

deviation-center-line_max	0.4853028891617569
deviation-center-line_mean	0.4853028891617569
deviation-center-line_min	0.4853028891617569
deviation-heading_max	1.6033133609727022
deviation-heading_mean	1.6033133609727022
deviation-heading_median	1.6033133609727022
deviation-heading_min	1.6033133609727022
distance-from-start_max	1.8217596069508304
distance-from-start_mean	1.8217596069508304
distance-from-start_median	1.8217596069508304
distance-from-start_min	1.8217596069508304
driven_any_max	2.8313898503429575
driven_any_mean	2.8313898503429575
driven_any_median	2.8313898503429575
driven_any_min	2.8313898503429575
driven_lanedir_consec_max	2.2097218970209855
driven_lanedir_consec_mean	2.2097218970209855
driven_lanedir_consec_min	2.2097218970209855
driven_lanedir_max	2.2097218970209855
driven_lanedir_mean	2.2097218970209855
driven_lanedir_median	2.2097218970209855
driven_lanedir_min	2.2097218970209855
in-drivable-lane_max	2.6000000000000174
in-drivable-lane_mean	2.6000000000000174
in-drivable-lane_min	2.6000000000000174
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.8313898503429575, "survival_time": 9.55, "driven_lanedir": 2.2097218970209855, "in-drivable-lane": 2.6000000000000174, "deviation-heading": 1.6033133609727022, "distance-from-start": 1.8217596069508304, "deviation-center-line": 0.4853028891617569, "driven_lanedir_consec": 2.2097218970209855}}
simulation-passed	1
survival_time_max	9.55
survival_time_mean	9.55
survival_time_min	9.55

No reset possible

110893

sim-3of4

success

yes

2021-11-05 09:14:59+00:00

2021-11-05 09:17:14+00:00

0:02:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7127281712494713
survival_time_median	18.70000000000013
deviation-center-line_median	0.443368430406808
in-drivable-lane_median	14.150000000000125

other stats

deviation-center-line_max	0.443368430406808
deviation-center-line_mean	0.443368430406808
deviation-center-line_min	0.443368430406808
deviation-heading_max	3.481743962521644
deviation-heading_mean	3.481743962521644
deviation-heading_median	3.481743962521644
deviation-heading_min	3.481743962521644
distance-from-start_max	3.860796446121827
distance-from-start_mean	3.860796446121827
distance-from-start_median	3.860796446121827
distance-from-start_min	3.860796446121827
driven_any_max	4.562756742188068
driven_any_mean	4.562756742188068
driven_any_median	4.562756742188068
driven_any_min	4.562756742188068
driven_lanedir_consec_max	0.7127281712494713
driven_lanedir_consec_mean	0.7127281712494713
driven_lanedir_consec_min	0.7127281712494713
driven_lanedir_max	0.7164190769804457
driven_lanedir_mean	0.7164190769804457
driven_lanedir_median	0.7164190769804457
driven_lanedir_min	0.7164190769804457
in-drivable-lane_max	14.150000000000125
in-drivable-lane_mean	14.150000000000125
in-drivable-lane_min	14.150000000000125
per-episodes	details {"zigzag-000-ego0": {"driven_any": 4.562756742188068, "survival_time": 18.70000000000013, "driven_lanedir": 0.7164190769804457, "in-drivable-lane": 14.150000000000125, "deviation-heading": 3.481743962521644, "distance-from-start": 3.860796446121827, "deviation-center-line": 0.443368430406808, "driven_lanedir_consec": 0.7127281712494713}}
simulation-passed	1
survival_time_max	18.70000000000013
survival_time_mean	18.70000000000013
survival_time_min	18.70000000000013

No reset possible

110892

sim-2of4

success

yes

2021-11-05 09:14:56+00:00

2021-11-05 09:17:14+00:00

0:02:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110889

sim-1of4

success

yes

2021-11-05 09:13:17+00:00

2021-11-05 09:16:15+00:00

0:02:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

110888

sim-3of4

success

yes

2021-11-05 09:13:14+00:00

2021-11-05 09:14:45+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible