Submission 17092

Submission

17092

Competing

yes

Challenge

aido-LF-sim-validation

User

Sampsa Ranta

Date submitted

2021-09-23 09:10:14+00:00

Last status update

2021-12-04 20:47:19+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 107903 sim-1of4: 107892 sim-2of4: 107893 sim-3of4: 107891

User label

Quack²: Oh Quack Là Là

Admin priority

Blessing

n/a

User priority

107903

Click the images to see detailed statistics about the episode.

loop2-000

107893

Click the images to see detailed statistics about the episode.

autolab-000

107892

Click the images to see detailed statistics about the episode.

zigzag-000

107891

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

107903

sim-0of4

success

yes

2021-11-03 14:15:16+00:00

2021-11-03 14:19:13+00:00

0:03:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	12.463336678664406
survival_time_median	59.99999999999873
deviation-center-line_median	0.47571039031334783
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	0.47571039031334783
deviation-center-line_mean	0.47571039031334783
deviation-center-line_min	0.47571039031334783
deviation-heading_max	2.531583772780281
deviation-heading_mean	2.531583772780281
deviation-heading_median	2.531583772780281
deviation-heading_min	2.531583772780281
distance-from-start_max	1.0552070713940485
distance-from-start_mean	1.0552070713940485
distance-from-start_median	1.0552070713940485
distance-from-start_min	1.0552070713940485
driven_any_max	12.485735617026323
driven_any_mean	12.485735617026323
driven_any_median	12.485735617026323
driven_any_min	12.485735617026323
driven_lanedir_consec_max	12.463336678664406
driven_lanedir_consec_mean	12.463336678664406
driven_lanedir_consec_min	12.463336678664406
driven_lanedir_max	12.463336678664406
driven_lanedir_mean	12.463336678664406
driven_lanedir_median	12.463336678664406
driven_lanedir_min	12.463336678664406
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 12.485735617026323, "survival_time": 59.99999999999873, "driven_lanedir": 12.463336678664406, "in-drivable-lane": 0.0, "deviation-heading": 2.531583772780281, "distance-from-start": 1.0552070713940485, "deviation-center-line": 0.47571039031334783, "driven_lanedir_consec": 12.463336678664406}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107895

sim-0of4

success

yes

2021-11-03 14:10:36+00:00

2021-11-03 14:14:38+00:00

0:04:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107893

sim-2of4

success

yes

2021-11-03 14:09:22+00:00

2021-11-03 14:14:45+00:00

0:05:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	12.444205046295227
survival_time_median	59.99999999999873
deviation-center-line_median	0.9240893911414042
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	0.9240893911414042
deviation-center-line_mean	0.9240893911414042
deviation-center-line_min	0.9240893911414042
deviation-heading_max	3.4351494363791764
deviation-heading_mean	3.4351494363791764
deviation-heading_median	3.4351494363791764
deviation-heading_min	3.4351494363791764
distance-from-start_max	3.228481530688105
distance-from-start_mean	3.228481530688105
distance-from-start_median	3.228481530688105
distance-from-start_min	3.228481530688105
driven_any_max	12.48610365350292
driven_any_mean	12.48610365350292
driven_any_median	12.48610365350292
driven_any_min	12.48610365350292
driven_lanedir_consec_max	12.444205046295227
driven_lanedir_consec_mean	12.444205046295227
driven_lanedir_consec_min	12.444205046295227
driven_lanedir_max	12.444205046295227
driven_lanedir_mean	12.444205046295227
driven_lanedir_median	12.444205046295227
driven_lanedir_min	12.444205046295227
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 12.48610365350292, "survival_time": 59.99999999999873, "driven_lanedir": 12.444205046295227, "in-drivable-lane": 0.0, "deviation-heading": 3.4351494363791764, "distance-from-start": 3.228481530688105, "deviation-center-line": 0.9240893911414042, "driven_lanedir_consec": 12.444205046295227}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107892

sim-1of4

success

yes

2021-11-03 14:09:19+00:00

2021-11-03 14:14:34+00:00

0:05:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	12.41482130217664
survival_time_median	59.99999999999873
deviation-center-line_median	1.2999058184748988
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	1.2999058184748988
deviation-center-line_mean	1.2999058184748988
deviation-center-line_min	1.2999058184748988
deviation-heading_max	5.074599998501322
deviation-heading_mean	5.074599998501322
deviation-heading_median	5.074599998501322
deviation-heading_min	5.074599998501322
distance-from-start_max	4.4359169870709945
distance-from-start_mean	4.4359169870709945
distance-from-start_median	4.4359169870709945
distance-from-start_min	4.4359169870709945
driven_any_max	12.485903561858104
driven_any_mean	12.485903561858104
driven_any_median	12.485903561858104
driven_any_min	12.485903561858104
driven_lanedir_consec_max	12.41482130217664
driven_lanedir_consec_mean	12.41482130217664
driven_lanedir_consec_min	12.41482130217664
driven_lanedir_max	12.41482130217664
driven_lanedir_mean	12.41482130217664
driven_lanedir_median	12.41482130217664
driven_lanedir_min	12.41482130217664
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 12.485903561858104, "survival_time": 59.99999999999873, "driven_lanedir": 12.41482130217664, "in-drivable-lane": 0.0, "deviation-heading": 5.074599998501322, "distance-from-start": 4.4359169870709945, "deviation-center-line": 1.2999058184748988, "driven_lanedir_consec": 12.41482130217664}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107891

sim-3of4

success

yes

2021-11-03 14:09:19+00:00

2021-11-03 14:13:45+00:00

0:04:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	12.465410778629105
survival_time_median	59.99999999999873
deviation-center-line_median	0.5921436320955038
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	0.5921436320955038
deviation-center-line_mean	0.5921436320955038
deviation-center-line_min	0.5921436320955038
deviation-heading_max	2.4413540220484298
deviation-heading_mean	2.4413540220484298
deviation-heading_median	2.4413540220484298
deviation-heading_min	2.4413540220484298
distance-from-start_max	2.514907589409954
distance-from-start_mean	2.514907589409954
distance-from-start_median	2.514907589409954
distance-from-start_min	2.514907589409954
driven_any_max	12.486039443185682
driven_any_mean	12.486039443185682
driven_any_median	12.486039443185682
driven_any_min	12.486039443185682
driven_lanedir_consec_max	12.465410778629105
driven_lanedir_consec_mean	12.465410778629105
driven_lanedir_consec_min	12.465410778629105
driven_lanedir_max	12.465410778629105
driven_lanedir_mean	12.465410778629105
driven_lanedir_median	12.465410778629105
driven_lanedir_min	12.465410778629105
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 12.486039443185682, "survival_time": 59.99999999999873, "driven_lanedir": 12.465410778629105, "in-drivable-lane": 0.0, "deviation-heading": 2.4413540220484298, "distance-from-start": 2.514907589409954, "deviation-center-line": 0.5921436320955038, "driven_lanedir_consec": 12.465410778629105}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

89126

sim-0of4

success

2021-10-19 22:37:39+00:00

2021-10-19 22:46:22+00:00

0:08:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

89125

sim-0of4

success

2021-10-19 22:26:22+00:00

2021-10-19 22:37:07+00:00

0:10:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86146

sim-0of4

success

2021-09-23 11:03:12+00:00

2021-09-23 11:40:15+00:00

0:37:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86145

sim-0of4

aborted

2021-09-23 10:49:30+00:00

2021-09-23 10:54:21+00:00

0:04:51

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86144

sim-1of4

success

2021-09-23 09:45:53+00:00

2021-09-23 09:56:44+00:00

0:10:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86143

sim-3of4

success

2021-09-23 09:32:16+00:00

2021-09-23 09:43:55+00:00

0:11:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

86142

sim-2of4

success

2021-09-23 09:13:28+00:00

2021-09-23 09:27:52+00:00

0:14:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible