Submission 18544

Submission

18544

Competing

yes

Challenge

aido-LFI-sim-validation

User

Sampsa Ranta

Date submitted

2021-12-08 20:21:52+00:00

Last status update

2021-12-08 20:49:12+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 122403 sim-1of4: 122401 sim-2of4: 122385 sim-3of4: 122402

User label

Quack² - To Quack Or Not

Admin priority

Blessing

n/a

User priority

122403

Click the images to see detailed statistics about the episode.

4way-000

122401

Click the images to see detailed statistics about the episode.

4way-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

122403

sim-0of4

success

yes

2021-12-08 20:41:19+00:00

2021-12-08 20:43:46+00:00

0:02:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.35000000000004
in-drivable-lane_median	1.4500000000000206
driven_lanedir_consec_median	1.585317884519874
deviation-center-line_median	0.5688906709174205

other stats

deviation-center-line_max	0.5688906709174205
deviation-center-line_mean	0.5688906709174205
deviation-center-line_min	0.5688906709174205
deviation-heading_max	2.923452069254368
deviation-heading_mean	2.923452069254368
deviation-heading_median	2.923452069254368
deviation-heading_min	2.923452069254368
distance-from-start_max	2.2558059749090997
distance-from-start_mean	2.2558059749090997
distance-from-start_median	2.2558059749090997
distance-from-start_min	2.2558059749090997
driven_any_max	2.350075803117086
driven_any_mean	2.350075803117086
driven_any_median	2.350075803117086
driven_any_min	2.350075803117086
driven_lanedir_consec_max	1.585317884519874
driven_lanedir_consec_mean	1.585317884519874
driven_lanedir_consec_min	1.585317884519874
driven_lanedir_max	2.010019706246707
driven_lanedir_mean	2.010019706246707
driven_lanedir_median	2.010019706246707
driven_lanedir_min	2.010019706246707
in-drivable-lane_max	1.4500000000000206
in-drivable-lane_mean	1.4500000000000206
in-drivable-lane_min	1.4500000000000206
per-episodes	details {"4way-000-ego0": {"driven_any": 2.350075803117086, "survival_time": 12.35000000000004, "driven_lanedir": 2.010019706246707, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 2.923452069254368, "distance-from-start": 2.2558059749090997, "deviation-center-line": 0.5688906709174205, "driven_lanedir_consec": 1.585317884519874}}
simulation-passed	1
survival_time_max	12.35000000000004
survival_time_mean	12.35000000000004
survival_time_min	12.35000000000004

No reset possible

122402

sim-3of4

success

yes

2021-12-08 20:40:18+00:00

2021-12-08 20:41:32+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

122401

sim-1of4

success

yes

2021-12-08 20:38:38+00:00

2021-12-08 20:42:22+00:00

0:03:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.74999999999999
in-drivable-lane_median	3.200000000000001
driven_lanedir_consec_median	0.9466964536446724
deviation-center-line_median	0.3479797818983331

other stats

deviation-center-line_max	0.3479797818983331
deviation-center-line_mean	0.3479797818983331
deviation-center-line_min	0.3479797818983331
deviation-heading_max	2.1153083876789474
deviation-heading_mean	2.1153083876789474
deviation-heading_median	2.1153083876789474
deviation-heading_min	2.1153083876789474
distance-from-start_max	1.5519585018620026
distance-from-start_mean	1.5519585018620026
distance-from-start_median	1.5519585018620026
distance-from-start_min	1.5519585018620026
driven_any_max	1.5848882155924473
driven_any_mean	1.5848882155924473
driven_any_median	1.5848882155924473
driven_any_min	1.5848882155924473
driven_lanedir_consec_max	0.9466964536446724
driven_lanedir_consec_mean	0.9466964536446724
driven_lanedir_consec_min	0.9466964536446724
driven_lanedir_max	0.9579896180685328
driven_lanedir_mean	0.9579896180685328
driven_lanedir_median	0.9579896180685328
driven_lanedir_min	0.9579896180685328
in-drivable-lane_max	3.200000000000001
in-drivable-lane_mean	3.200000000000001
in-drivable-lane_min	3.200000000000001
per-episodes	details {"4way-000-ego0": {"driven_any": 1.5848882155924473, "survival_time": 8.74999999999999, "driven_lanedir": 0.9579896180685328, "in-drivable-lane": 3.200000000000001, "deviation-heading": 2.1153083876789474, "distance-from-start": 1.5519585018620026, "deviation-center-line": 0.3479797818983331, "driven_lanedir_consec": 0.9466964536446724}}
simulation-passed	1
survival_time_max	8.74999999999999
survival_time_mean	8.74999999999999
survival_time_min	8.74999999999999

No reset possible

122400

sim-0of4

success

yes

2021-12-08 20:38:37+00:00

2021-12-08 20:41:10+00:00

0:02:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122397

sim-3of4

success

yes

2021-12-08 20:38:36+00:00

2021-12-08 20:39:55+00:00

0:01:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122392

sim-3of4

timeout

yes

2021-12-08 20:36:15+00:00

2021-12-08 20:38:22+00:00

0:02:07

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122391

sim-3of4

success

yes

2021-12-08 20:34:28+00:00

2021-12-08 20:35:42+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122390

sim-0of4

timeout

yes

2021-12-08 20:34:27+00:00

2021-12-08 20:38:23+00:00

0:03:56

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122386

sim-1of4

success

yes

2021-12-08 20:34:13+00:00

2021-12-08 20:38:12+00:00

0:03:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122385

sim-2of4

success

yes

2021-12-08 20:31:34+00:00

2021-12-08 20:33:37+00:00

0:02:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

122384

sim-2of4

success

yes

2021-12-08 20:29:19+00:00

2021-12-08 20:31:21+00:00

0:02:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

122383

sim-2of4

success

yes

2021-12-08 20:26:38+00:00

2021-12-08 20:28:42+00:00

0:02:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible