Submission 17496

Submission

17496

Competing

yes

Challenge

aido-LF-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-01 13:48:05+00:00

Last status update

2021-12-04 20:47:19+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 107597 sim-1of4: 107611 sim-2of4: 107595 sim-3of4: 107593

User label

baseline-dagger-pytorch

Admin priority

Blessing

n/a

User priority

107611

Click the images to see detailed statistics about the episode.

autolab-000

107597

Click the images to see detailed statistics about the episode.

loop2-000

107595

Click the images to see detailed statistics about the episode.

loop-000

107593

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

107611

sim-1of4

success

yes

2021-11-03 12:37:48+00:00

2021-11-03 12:43:37+00:00

0:05:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.764915690792074
survival_time_median	59.99999999999873
deviation-center-line_median	2.7643274043326933
in-drivable-lane_median	4.800000000000015

other stats

deviation-center-line_max	2.7643274043326933
deviation-center-line_mean	2.7643274043326933
deviation-center-line_min	2.7643274043326933
deviation-heading_max	15.497548004216895
deviation-heading_mean	15.497548004216895
deviation-heading_median	15.497548004216895
deviation-heading_min	15.497548004216895
distance-from-start_max	3.3141747651071607
distance-from-start_mean	3.3141747651071607
distance-from-start_median	3.3141747651071607
distance-from-start_min	3.3141747651071607
driven_any_max	10.306259428113073
driven_any_mean	10.306259428113073
driven_any_median	10.306259428113073
driven_any_min	10.306259428113073
driven_lanedir_consec_max	8.764915690792074
driven_lanedir_consec_mean	8.764915690792074
driven_lanedir_consec_min	8.764915690792074
driven_lanedir_max	8.764915690792074
driven_lanedir_mean	8.764915690792074
driven_lanedir_median	8.764915690792074
driven_lanedir_min	8.764915690792074
in-drivable-lane_max	4.800000000000015
in-drivable-lane_mean	4.800000000000015
in-drivable-lane_min	4.800000000000015
per-episodes	details {"autolab-000-ego0": {"driven_any": 10.306259428113073, "survival_time": 59.99999999999873, "driven_lanedir": 8.764915690792074, "in-drivable-lane": 4.800000000000015, "deviation-heading": 15.497548004216895, "distance-from-start": 3.3141747651071607, "deviation-center-line": 2.7643274043326933, "driven_lanedir_consec": 8.764915690792074}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107597

sim-0of4

success

yes

2021-11-03 12:29:25+00:00

2021-11-03 12:38:05+00:00

0:08:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.760601468458484
survival_time_median	59.99999999999873
deviation-center-line_median	3.5795926068873944
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	3.5795926068873944
deviation-center-line_mean	3.5795926068873944
deviation-center-line_min	3.5795926068873944
deviation-heading_max	14.482575800234487
deviation-heading_mean	14.482575800234487
deviation-heading_median	14.482575800234487
deviation-heading_min	14.482575800234487
distance-from-start_max	1.1051756419021357
distance-from-start_mean	1.1051756419021357
distance-from-start_median	1.1051756419021357
distance-from-start_min	1.1051756419021357
driven_any_max	11.206072151067431
driven_any_mean	11.206072151067431
driven_any_median	11.206072151067431
driven_any_min	11.206072151067431
driven_lanedir_consec_max	10.760601468458484
driven_lanedir_consec_mean	10.760601468458484
driven_lanedir_consec_min	10.760601468458484
driven_lanedir_max	10.760601468458484
driven_lanedir_mean	10.760601468458484
driven_lanedir_median	10.760601468458484
driven_lanedir_min	10.760601468458484
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 11.206072151067431, "survival_time": 59.99999999999873, "driven_lanedir": 10.760601468458484, "in-drivable-lane": 0.0, "deviation-heading": 14.482575800234487, "distance-from-start": 1.1051756419021357, "deviation-center-line": 3.5795926068873944, "driven_lanedir_consec": 10.760601468458484}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107595

sim-2of4

success

yes

2021-11-03 12:29:24+00:00

2021-11-03 12:37:21+00:00

0:07:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.544970623077356
survival_time_median	59.99999999999873
deviation-center-line_median	2.630250933640815
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.630250933640815
deviation-center-line_mean	2.630250933640815
deviation-center-line_min	2.630250933640815
deviation-heading_max	11.0027409815822
deviation-heading_mean	11.0027409815822
deviation-heading_median	11.0027409815822
deviation-heading_min	11.0027409815822
distance-from-start_max	2.4626684049240524
distance-from-start_mean	2.4626684049240524
distance-from-start_median	2.4626684049240524
distance-from-start_min	2.4626684049240524
driven_any_max	10.813748245351167
driven_any_mean	10.813748245351167
driven_any_median	10.813748245351167
driven_any_min	10.813748245351167
driven_lanedir_consec_max	10.544970623077356
driven_lanedir_consec_mean	10.544970623077356
driven_lanedir_consec_min	10.544970623077356
driven_lanedir_max	10.544970623077356
driven_lanedir_mean	10.544970623077356
driven_lanedir_median	10.544970623077356
driven_lanedir_min	10.544970623077356
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 10.813748245351167, "survival_time": 59.99999999999873, "driven_lanedir": 10.544970623077356, "in-drivable-lane": 0.0, "deviation-heading": 11.0027409815822, "distance-from-start": 2.4626684049240524, "deviation-center-line": 2.630250933640815, "driven_lanedir_consec": 10.544970623077356}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107593

sim-3of4

success

yes

2021-11-03 12:29:20+00:00

2021-11-03 12:38:08+00:00

0:08:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.937508449887703
survival_time_median	59.99999999999873
deviation-center-line_median	3.1545361396364595
in-drivable-lane_median	0.6500000000000092

other stats

deviation-center-line_max	3.1545361396364595
deviation-center-line_mean	3.1545361396364595
deviation-center-line_min	3.1545361396364595
deviation-heading_max	16.433166980267934
deviation-heading_mean	16.433166980267934
deviation-heading_median	16.433166980267934
deviation-heading_min	16.433166980267934
distance-from-start_max	4.507581461487132
distance-from-start_mean	4.507581461487132
distance-from-start_median	4.507581461487132
distance-from-start_min	4.507581461487132
driven_any_max	9.65403318716674
driven_any_mean	9.65403318716674
driven_any_median	9.65403318716674
driven_any_min	9.65403318716674
driven_lanedir_consec_max	8.937508449887703
driven_lanedir_consec_mean	8.937508449887703
driven_lanedir_consec_min	8.937508449887703
driven_lanedir_max	8.937508449887703
driven_lanedir_mean	8.937508449887703
driven_lanedir_median	8.937508449887703
driven_lanedir_min	8.937508449887703
in-drivable-lane_max	0.6500000000000092
in-drivable-lane_mean	0.6500000000000092
in-drivable-lane_min	0.6500000000000092
per-episodes	details {"zigzag-000-ego0": {"driven_any": 9.65403318716674, "survival_time": 59.99999999999873, "driven_lanedir": 8.937508449887703, "in-drivable-lane": 0.6500000000000092, "deviation-heading": 16.433166980267934, "distance-from-start": 4.507581461487132, "deviation-center-line": 3.1545361396364595, "driven_lanedir_consec": 8.937508449887703}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107582

sim-2of4

timeout

yes

2021-11-03 12:22:00+00:00

No reset possible

107580

sim-1of4

timeout

yes

2021-11-03 12:21:56+00:00

No reset possible

107577

sim-3of4

timeout

yes

2021-11-03 12:20:49+00:00

No reset possible