Submission 17969

Submission

17969

Competing

yes

Challenge

aido-LF-sim-validation

User

Sampsa Ranta

Date submitted

2021-11-23 00:15:57+00:00

Last status update

2021-12-04 20:47:19+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 118339 sim-1of4: 118337 sim-2of4: 118336 sim-3of4: 118340

User label

Quack²: Oh Quack Là Là

Admin priority

Blessing

n/a

User priority

118340

Click the images to see detailed statistics about the episode.

autolab-000

118339

Click the images to see detailed statistics about the episode.

zigzag-000

118337

Click the images to see detailed statistics about the episode.

loop2-000

118336

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

118340

sim-3of4

success

yes

2021-11-23 21:25:18+00:00

2021-11-23 21:34:54+00:00

0:09:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	25.883054393008344
survival_time_median	59.99999999999873
deviation-center-line_median	2.449634332140492
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.449634332140492
deviation-center-line_mean	2.449634332140492
deviation-center-line_min	2.449634332140492
deviation-heading_max	9.639813061811072
deviation-heading_mean	9.639813061811072
deviation-heading_median	9.639813061811072
deviation-heading_min	9.639813061811072
distance-from-start_max	3.214635174142251
distance-from-start_mean	3.214635174142251
distance-from-start_median	3.214635174142251
distance-from-start_min	3.214635174142251
driven_any_max	26.510899959085496
driven_any_mean	26.510899959085496
driven_any_median	26.510899959085496
driven_any_min	26.510899959085496
driven_lanedir_consec_max	25.883054393008344
driven_lanedir_consec_mean	25.883054393008344
driven_lanedir_consec_min	25.883054393008344
driven_lanedir_max	25.883054393008344
driven_lanedir_mean	25.883054393008344
driven_lanedir_median	25.883054393008344
driven_lanedir_min	25.883054393008344
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 26.510899959085496, "survival_time": 59.99999999999873, "driven_lanedir": 25.883054393008344, "in-drivable-lane": 0.0, "deviation-heading": 9.639813061811072, "distance-from-start": 3.214635174142251, "deviation-center-line": 2.449634332140492, "driven_lanedir_consec": 25.883054393008344}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

118339

sim-0of4

success

yes

2021-11-23 21:14:04+00:00

2021-11-23 21:24:57+00:00

0:10:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	25.67989532143748
survival_time_median	59.99999999999873
deviation-center-line_median	2.807768851808852
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.807768851808852
deviation-center-line_mean	2.807768851808852
deviation-center-line_min	2.807768851808852
deviation-heading_max	10.68163142920631
deviation-heading_mean	10.68163142920631
deviation-heading_median	10.68163142920631
deviation-heading_min	10.68163142920631
distance-from-start_max	4.400947833413052
distance-from-start_mean	4.400947833413052
distance-from-start_median	4.400947833413052
distance-from-start_min	4.400947833413052
driven_any_max	26.394148569372835
driven_any_mean	26.394148569372835
driven_any_median	26.394148569372835
driven_any_min	26.394148569372835
driven_lanedir_consec_max	25.67989532143748
driven_lanedir_consec_mean	25.67989532143748
driven_lanedir_consec_min	25.67989532143748
driven_lanedir_max	25.67989532143748
driven_lanedir_mean	25.67989532143748
driven_lanedir_median	25.67989532143748
driven_lanedir_min	25.67989532143748
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 26.394148569372835, "survival_time": 59.99999999999873, "driven_lanedir": 25.67989532143748, "in-drivable-lane": 0.0, "deviation-heading": 10.68163142920631, "distance-from-start": 4.400947833413052, "deviation-center-line": 2.807768851808852, "driven_lanedir_consec": 25.67989532143748}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

118337

sim-1of4

success

yes

2021-11-23 21:04:29+00:00

2021-11-23 21:13:31+00:00

0:09:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	25.00890993268608
survival_time_median	59.99999999999873
deviation-center-line_median	3.2787216178197593
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	3.2787216178197593
deviation-center-line_mean	3.2787216178197593
deviation-center-line_min	3.2787216178197593
deviation-heading_max	15.054821786732589
deviation-heading_mean	15.054821786732589
deviation-heading_median	15.054821786732589
deviation-heading_min	15.054821786732589
distance-from-start_max	1.0801038590225982
distance-from-start_mean	1.0801038590225982
distance-from-start_median	1.0801038590225982
distance-from-start_min	1.0801038590225982
driven_any_max	26.319965647288853
driven_any_mean	26.319965647288853
driven_any_median	26.319965647288853
driven_any_min	26.319965647288853
driven_lanedir_consec_max	25.00890993268608
driven_lanedir_consec_mean	25.00890993268608
driven_lanedir_consec_min	25.00890993268608
driven_lanedir_max	25.00890993268608
driven_lanedir_mean	25.00890993268608
driven_lanedir_median	25.00890993268608
driven_lanedir_min	25.00890993268608
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 26.319965647288853, "survival_time": 59.99999999999873, "driven_lanedir": 25.00890993268608, "in-drivable-lane": 0.0, "deviation-heading": 15.054821786732589, "distance-from-start": 1.0801038590225982, "deviation-center-line": 3.2787216178197593, "driven_lanedir_consec": 25.00890993268608}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

118336

sim-2of4

success

yes

2021-11-23 20:54:19+00:00

2021-11-23 21:04:08+00:00

0:09:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	26.03550196666991
survival_time_median	59.99999999999873
deviation-center-line_median	2.5231419811494957
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.5231419811494957
deviation-center-line_mean	2.5231419811494957
deviation-center-line_min	2.5231419811494957
deviation-heading_max	8.892883568471259
deviation-heading_mean	8.892883568471259
deviation-heading_median	8.892883568471259
deviation-heading_min	8.892883568471259
distance-from-start_max	2.546692424996979
distance-from-start_mean	2.546692424996979
distance-from-start_median	2.546692424996979
distance-from-start_min	2.546692424996979
driven_any_max	26.588726053957224
driven_any_mean	26.588726053957224
driven_any_median	26.588726053957224
driven_any_min	26.588726053957224
driven_lanedir_consec_max	26.03550196666991
driven_lanedir_consec_mean	26.03550196666991
driven_lanedir_consec_min	26.03550196666991
driven_lanedir_max	26.03550196666991
driven_lanedir_mean	26.03550196666991
driven_lanedir_median	26.03550196666991
driven_lanedir_min	26.03550196666991
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 26.588726053957224, "survival_time": 59.99999999999873, "driven_lanedir": 26.03550196666991, "in-drivable-lane": 0.0, "deviation-heading": 8.892883568471259, "distance-from-start": 2.546692424996979, "deviation-center-line": 2.5231419811494957, "driven_lanedir_consec": 26.03550196666991}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

118209

sim-2of4

timeout

yes

2021-11-23 17:12:27+00:00

2021-11-23 17:13:09+00:00

0:00:42

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

118100

sim-2of4

timeout

yes

2021-11-23 14:59:52+00:00

2021-11-23 15:00:33+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

118099

sim-2of4

timeout

yes

2021-11-23 14:58:46+00:00

2021-11-23 14:59:25+00:00

0:00:39

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117946

sim-2of4

timeout

yes

2021-11-23 12:06:33+00:00

2021-11-23 12:07:12+00:00

0:00:39

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117945

sim-2of4

timeout

yes

2021-11-23 12:05:25+00:00

2021-11-23 12:06:06+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117928

sim-2of4

timeout

yes

2021-11-23 11:45:31+00:00

2021-11-23 11:46:11+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117813

sim-2of4

timeout

yes

2021-11-23 09:28:06+00:00

2021-11-23 09:28:47+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117778

sim-0of4

timeout

yes

2021-11-23 08:48:44+00:00

2021-11-23 08:49:24+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117777

sim-3of4

timeout

yes

2021-11-23 08:47:35+00:00

2021-11-23 08:48:17+00:00

0:00:42

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117776

sim-3of4

timeout

yes

2021-11-23 08:45:58+00:00

2021-11-23 08:46:40+00:00

0:00:42

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117775

sim-3of4

timeout

yes

2021-11-23 08:44:22+00:00

2021-11-23 08:45:04+00:00

0:00:42

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117772

sim-2of4

timeout

yes

2021-11-23 08:40:29+00:00

2021-11-23 08:41:10+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117771

sim-2of4

timeout

yes

2021-11-23 08:39:21+00:00

2021-11-23 08:40:02+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117770

sim-2of4

timeout

yes

2021-11-23 08:38:13+00:00

2021-11-23 08:38:54+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117769

sim-2of4

timeout

yes

2021-11-23 08:37:05+00:00

2021-11-23 08:37:45+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117768

sim-2of4

timeout

yes

2021-11-23 08:35:56+00:00

2021-11-23 08:36:38+00:00

0:00:42

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117767

sim-2of4

timeout

yes

2021-11-23 08:34:49+00:00

2021-11-23 08:35:30+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117762

sim-2of4

timeout

yes

2021-11-23 08:28:50+00:00

2021-11-23 08:29:29+00:00

0:00:39

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117761

sim-2of4

timeout

yes

2021-11-23 08:27:15+00:00

2021-11-23 08:27:56+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117760

sim-2of4

timeout

yes

2021-11-23 08:25:42+00:00

2021-11-23 08:26:22+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117750

sim-2of4

timeout

yes

2021-11-23 08:14:06+00:00

2021-11-23 08:14:46+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117749

sim-2of4

timeout

yes

2021-11-23 08:12:59+00:00

2021-11-23 08:13:39+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117748

sim-2of4

timeout

yes

2021-11-23 08:11:24+00:00

2021-11-23 08:12:05+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117747

sim-2of4

timeout

yes

2021-11-23 08:10:16+00:00

2021-11-23 08:10:57+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117746

sim-2of4

timeout

yes

2021-11-23 08:08:40+00:00

2021-11-23 08:09:22+00:00

0:00:42

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117745

sim-2of4

timeout

yes

2021-11-23 08:07:34+00:00

2021-11-23 08:08:14+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117744

sim-2of4

timeout

yes

2021-11-23 08:06:27+00:00

2021-11-23 08:07:08+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117743

sim-2of4

timeout

yes

2021-11-23 08:04:54+00:00

2021-11-23 08:05:34+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117742

sim-2of4

timeout

yes

2021-11-23 08:03:45+00:00

2021-11-23 08:04:26+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117741

sim-2of4

timeout

yes

2021-11-23 08:02:37+00:00

2021-11-23 08:03:18+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117735

sim-2of4

timeout

yes

2021-11-23 07:54:05+00:00

2021-11-23 07:54:46+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117734

sim-2of4

timeout

yes

2021-11-23 07:52:29+00:00

2021-11-23 07:53:10+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117733

sim-2of4

timeout

yes

2021-11-23 07:51:21+00:00

2021-11-23 07:52:02+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117719

sim-3of4

timeout

yes

2021-11-23 07:34:46+00:00

2021-11-23 07:35:27+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117718

sim-3of4

timeout

yes

2021-11-23 07:33:38+00:00

2021-11-23 07:34:19+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117717

sim-3of4

timeout

yes

2021-11-23 07:32:29+00:00

2021-11-23 07:33:10+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117716

sim-2of4

timeout

yes

2021-11-23 07:31:23+00:00

2021-11-23 07:32:02+00:00

0:00:39

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117715

sim-2of4

timeout

yes

2021-11-23 07:29:46+00:00

2021-11-23 07:30:27+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117707

sim-2of4

timeout

yes

2021-11-23 07:19:25+00:00

2021-11-23 07:20:06+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117706

sim-2of4

timeout

yes

2021-11-23 07:17:53+00:00

2021-11-23 07:18:32+00:00

0:00:39

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117705

sim-2of4

timeout

yes

2021-11-23 07:16:19+00:00

2021-11-23 07:16:59+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117704

sim-2of4

timeout

yes

2021-11-23 07:14:44+00:00

2021-11-23 07:15:25+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117693

sim-2of4

timeout

yes

2021-11-23 07:01:54+00:00

2021-11-23 07:02:34+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117692

sim-2of4

timeout

yes

2021-11-23 07:00:45+00:00

2021-11-23 07:01:27+00:00

0:00:42

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117691

sim-2of4

timeout

yes

2021-11-23 06:59:37+00:00

2021-11-23 07:00:17+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

117690

sim-2of4

timeout

yes

2021-11-23 06:58:31+00:00

2021-11-23 06:59:11+00:00

0:00:40

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible