Submission 18192

Submission

18192

Competing

yes

Challenge

aido-LFVI_multi-sim-validation

User

David Bardos

Date submitted

2021-12-02 22:58:28+00:00

Last status update

2021-12-04 20:47:44+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 119123 sim-1of4: 119124 sim-2of4: 119135 sim-3of4: 119128

User label

template-random

Admin priority

Blessing

n/a

User priority

119124

Click the images to see detailed statistics about the episode.

udem-000

119123

Click the images to see detailed statistics about the episode.

4way-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

119135

sim-2of4

success

yes

2021-12-03 00:09:21+00:00

2021-12-03 00:11:17+00:00

0:01:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

119134

sim-2of4

success

yes

2021-12-03 00:07:17+00:00

2021-12-03 00:09:13+00:00

0:01:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

119133

sim-2of4

success

yes

2021-12-03 00:04:02+00:00

2021-12-03 00:06:56+00:00

0:02:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

119132

sim-2of4

timeout

yes

2021-12-03 00:02:59+00:00

0:00:00

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

119131

sim-2of4

timeout

yes

2021-12-03 00:02:02+00:00

2021-12-03 00:02:11+00:00

0:00:09

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

119130

sim-2of4

success

yes

2021-12-02 23:58:53+00:00

2021-12-03 00:00:47+00:00

0:01:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

119129

sim-2of4

success

yes

2021-12-02 23:56:43+00:00

2021-12-02 23:58:46+00:00

0:02:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

119128

sim-3of4

success

yes

2021-12-02 23:54:41+00:00

2021-12-02 23:56:37+00:00

0:01:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

119127

sim-3of4

success

yes

2021-12-02 23:51:59+00:00

2021-12-02 23:53:49+00:00

0:01:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

119126

sim-3of4

success

yes

2021-12-02 23:49:56+00:00

2021-12-02 23:51:45+00:00

0:01:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

119125

sim-3of4

success

yes

2021-12-02 23:47:30+00:00

2021-12-02 23:49:36+00:00

0:02:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

119124

sim-1of4

success

yes

2021-12-02 23:31:51+00:00

2021-12-02 23:47:22+00:00

0:15:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	33.75000000000022
in-drivable-lane_median	29.825000000000212
driven_lanedir_consec_median	0.21731228142323933
deviation-center-line_median	0.3331807431846997

other stats

deviation-center-line_max	0.7655512378412563
deviation-center-line_mean	0.379245390698747
deviation-center-line_min	0.0850688385843324
deviation-heading_max	5.708723015945328
deviation-heading_mean	2.8582267855416443
deviation-heading_median	2.247219992369361
deviation-heading_min	1.229744141482529
distance-from-start_max	0.9340577697896516
distance-from-start_mean	0.6073071039932331
distance-from-start_median	0.5461575079396492
distance-from-start_min	0.4028556303039823
driven_any_max	8.310583890769195
driven_any_mean	3.410525124545609
driven_any_median	2.453720078564638
driven_any_min	0.4240764502839678
driven_lanedir_consec_max	0.3926134494082678
driven_lanedir_consec_mean	0.2327684277313727
driven_lanedir_consec_min	0.10383569867074448
driven_lanedir_max	0.3926134494082678
driven_lanedir_mean	0.2281267458150863
driven_lanedir_median	0.21016777279894416
driven_lanedir_min	0.09955798825418904
in-drivable-lane_max	31.650000000000222
in-drivable-lane_mean	29.125000000000213
in-drivable-lane_min	25.2000000000002
per-episodes	details {"udem-000-ego0": {"driven_any": 8.310583890769195, "survival_time": 33.75000000000022, "driven_lanedir": 0.25382856508768814, "in-drivable-lane": 25.2000000000002, "deviation-heading": 5.708723015945328, "distance-from-start": 0.9340577697896516, "deviation-center-line": 0.7655512378412563, "driven_lanedir_consec": 0.2718370953578422}, "udem-000-ego1": {"driven_any": 0.4240764502839678, "survival_time": 33.75000000000022, "driven_lanedir": 0.3926134494082678, "in-drivable-lane": 31.650000000000222, "deviation-heading": 1.229744141482529, "distance-from-start": 0.4028556303039823, "deviation-center-line": 0.0850688385843324, "driven_lanedir_consec": 0.3926134494082678}, "udem-000-ego2": {"driven_any": 2.4390062983425578, "survival_time": 33.75000000000022, "driven_lanedir": 0.1665069805102002, "in-drivable-lane": 29.350000000000215, "deviation-heading": 2.144336915325389, "distance-from-start": 0.5461575079396477, "deviation-center-line": 0.3777614073769809, "driven_lanedir_consec": 0.16278746748863648}, "udem-000-ego3": {"driven_any": 2.4684338587867183, "survival_time": 33.75000000000022, "driven_lanedir": 0.09955798825418904, "in-drivable-lane": 30.30000000000021, "deviation-heading": 2.350103069413333, "distance-from-start": 0.5461575079396509, "deviation-center-line": 0.2886000789924186, "driven_lanedir_consec": 0.10383569867074448}}
simulation-passed	1
survival_time_max	33.75000000000022
survival_time_mean	33.75000000000022
survival_time_min	33.75000000000022

No reset possible

119123

sim-0of4

success

yes

2021-12-02 23:17:55+00:00

2021-12-02 23:31:29+00:00

0:13:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	27.85000000000026
in-drivable-lane_median	23.575000000000244
driven_lanedir_consec_median	0.2152178291743677
deviation-center-line_median	0.34607680035313926

other stats

deviation-center-line_max	0.7555295762526522
deviation-center-line_mean	0.3831880038858158
deviation-center-line_min	0.0850688385843324
deviation-heading_max	5.523299013646982
deviation-heading_mean	2.976848653346106
deviation-heading_median	2.577175729127456
deviation-heading_min	1.229744141482529
distance-from-start_max	0.8413577961802242
distance-from-start_mean	0.6171534020652945
distance-from-start_median	0.6122000908884857
distance-from-start_min	0.4028556303039823
driven_any_max	6.724613878580574
driven_any_mean	3.448516774187835
driven_any_median	3.322688383943399
driven_any_min	0.4240764502839678
driven_lanedir_consec_max	0.3926134494082678
driven_lanedir_consec_mean	0.23172102279300744
driven_lanedir_consec_min	0.10383498341502671
driven_lanedir_max	0.3926134494082678
driven_lanedir_mean	0.22283655208020933
driven_lanedir_median	0.1995874449338097
driven_lanedir_min	0.09955786904495012
in-drivable-lane_max	25.750000000000263
in-drivable-lane_mean	23.05000000000025
in-drivable-lane_min	19.30000000000024
per-episodes	details {"4way-000-ego0": {"driven_any": 6.724613878580574, "survival_time": 27.85000000000026, "driven_lanedir": 0.24963678127672728, "in-drivable-lane": 19.30000000000024, "deviation-heading": 5.523299013646982, "distance-from-start": 0.8413577961802242, "deviation-center-line": 0.7555295762526522, "driven_lanedir_consec": 0.26764984149988424}, "4way-000-ego1": {"driven_any": 0.4240764502839678, "survival_time": 27.85000000000026, "driven_lanedir": 0.3926134494082678, "in-drivable-lane": 25.750000000000263, "deviation-heading": 1.229744141482529, "distance-from-start": 0.4028556303039823, "deviation-center-line": 0.0850688385843324, "driven_lanedir_consec": 0.3926134494082678}, "4way-000-ego2": {"driven_any": 4.117732239446978, "survival_time": 27.85000000000026, "driven_lanedir": 0.14953810859089212, "in-drivable-lane": 22.75000000000024, "deviation-heading": 2.8042483888415783, "distance-from-start": 0.6736010379604935, "deviation-center-line": 0.4035531580478341, "driven_lanedir_consec": 0.16278581684885107}, "4way-000-ego3": {"driven_any": 2.527644528439821, "survival_time": 27.85000000000026, "driven_lanedir": 0.09955786904495012, "in-drivable-lane": 24.40000000000025, "deviation-heading": 2.350103069413334, "distance-from-start": 0.5507991438164779, "deviation-center-line": 0.2886004426584445, "driven_lanedir_consec": 0.10383498341502671}}
simulation-passed	1
survival_time_max	27.85000000000026
survival_time_mean	27.85000000000026
survival_time_min	27.85000000000026

No reset possible