Submission 17494

Submission

17494

Competing

yes

Challenge

aido-LFV-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-01 13:48:04+00:00

Last status update

2021-12-04 20:47:22+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 107646 sim-1of4: 107632 sim-2of4: 107639 sim-3of4: 107640

User label

baseline-dagger-pytorch

Admin priority

Blessing

n/a

User priority

107646

Click the images to see detailed statistics about the episode.

loop2-000

107640

Click the images to see detailed statistics about the episode.

zigzag-000

107639

Click the images to see detailed statistics about the episode.

loop-000

107632

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

107646

sim-0of4

success

yes

2021-11-03 12:53:22+00:00

2021-11-03 12:57:52+00:00

0:04:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	33.70000000000022
in-drivable-lane_median	0.6999999999999602
driven_lanedir_consec_median	5.898683610914455
deviation-center-line_median	1.818876864008101

other stats

deviation-center-line_max	1.818876864008101
deviation-center-line_mean	1.818876864008101
deviation-center-line_min	1.818876864008101
deviation-heading_max	7.925068451399026
deviation-heading_mean	7.925068451399026
deviation-heading_median	7.925068451399026
deviation-heading_min	7.925068451399026
distance-from-start_max	1.068209792070088
distance-from-start_mean	1.068209792070088
distance-from-start_median	1.068209792070088
distance-from-start_min	1.068209792070088
driven_any_max	6.159476789581713
driven_any_mean	6.159476789581713
driven_any_median	6.159476789581713
driven_any_min	6.159476789581713
driven_lanedir_consec_max	5.898683610914455
driven_lanedir_consec_mean	5.898683610914455
driven_lanedir_consec_min	5.898683610914455
driven_lanedir_max	5.898683610914455
driven_lanedir_mean	5.898683610914455
driven_lanedir_median	5.898683610914455
driven_lanedir_min	5.898683610914455
in-drivable-lane_max	0.6999999999999602
in-drivable-lane_mean	0.6999999999999602
in-drivable-lane_min	0.6999999999999602
per-episodes	details {"loop2-000-ego0": {"driven_any": 6.159476789581713, "survival_time": 33.70000000000022, "driven_lanedir": 5.898683610914455, "in-drivable-lane": 0.6999999999999602, "deviation-heading": 7.925068451399026, "distance-from-start": 1.068209792070088, "deviation-center-line": 1.818876864008101, "driven_lanedir_consec": 5.898683610914455}}
simulation-passed	1
survival_time_max	33.70000000000022
survival_time_mean	33.70000000000022
survival_time_min	33.70000000000022

No reset possible

107640

sim-3of4

success

yes

2021-11-03 12:50:09+00:00

2021-11-03 13:02:13+00:00

0:12:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.199999999999969
driven_lanedir_consec_median	8.49337342906497
deviation-center-line_median	2.496495711873816

other stats

deviation-center-line_max	2.496495711873816
deviation-center-line_mean	2.496495711873816
deviation-center-line_min	2.496495711873816
deviation-heading_max	12.519402135651449
deviation-heading_mean	12.519402135651449
deviation-heading_median	12.519402135651449
deviation-heading_min	12.519402135651449
distance-from-start_max	4.561466811125065
distance-from-start_mean	4.561466811125065
distance-from-start_median	4.561466811125065
distance-from-start_min	4.561466811125065
driven_any_max	9.096199966690246
driven_any_mean	9.096199966690246
driven_any_median	9.096199966690246
driven_any_min	9.096199966690246
driven_lanedir_consec_max	8.49337342906497
driven_lanedir_consec_mean	8.49337342906497
driven_lanedir_consec_min	8.49337342906497
driven_lanedir_max	8.49337342906497
driven_lanedir_mean	8.49337342906497
driven_lanedir_median	8.49337342906497
driven_lanedir_min	8.49337342906497
in-drivable-lane_max	1.199999999999969
in-drivable-lane_mean	1.199999999999969
in-drivable-lane_min	1.199999999999969
per-episodes	details {"zigzag-000-ego0": {"driven_any": 9.096199966690246, "survival_time": 59.99999999999873, "driven_lanedir": 8.49337342906497, "in-drivable-lane": 1.199999999999969, "deviation-heading": 12.519402135651449, "distance-from-start": 4.561466811125065, "deviation-center-line": 2.496495711873816, "driven_lanedir_consec": 8.49337342906497}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107639

sim-2of4

success

yes

2021-11-03 12:48:55+00:00

2021-11-03 12:52:40+00:00

0:03:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	19.40000000000014
in-drivable-lane_median	1.6500000000000234
driven_lanedir_consec_median	2.9698615383791904
deviation-center-line_median	0.8197644690350872

other stats

deviation-center-line_max	0.8197644690350872
deviation-center-line_mean	0.8197644690350872
deviation-center-line_min	0.8197644690350872
deviation-heading_max	3.91166631602572
deviation-heading_mean	3.91166631602572
deviation-heading_median	3.91166631602572
deviation-heading_min	3.91166631602572
distance-from-start_max	2.413139578128744
distance-from-start_mean	2.413139578128744
distance-from-start_median	2.413139578128744
distance-from-start_min	2.413139578128744
driven_any_max	3.2765124515379136
driven_any_mean	3.2765124515379136
driven_any_median	3.2765124515379136
driven_any_min	3.2765124515379136
driven_lanedir_consec_max	2.9698615383791904
driven_lanedir_consec_mean	2.9698615383791904
driven_lanedir_consec_min	2.9698615383791904
driven_lanedir_max	2.9698615383791904
driven_lanedir_mean	2.9698615383791904
driven_lanedir_median	2.9698615383791904
driven_lanedir_min	2.9698615383791904
in-drivable-lane_max	1.6500000000000234
in-drivable-lane_mean	1.6500000000000234
in-drivable-lane_min	1.6500000000000234
per-episodes	details {"loop-000-ego0": {"driven_any": 3.2765124515379136, "survival_time": 19.40000000000014, "driven_lanedir": 2.9698615383791904, "in-drivable-lane": 1.6500000000000234, "deviation-heading": 3.91166631602572, "distance-from-start": 2.413139578128744, "deviation-center-line": 0.8197644690350872, "driven_lanedir_consec": 2.9698615383791904}}
simulation-passed	1
survival_time_max	19.40000000000014
survival_time_mean	19.40000000000014
survival_time_min	19.40000000000014

No reset possible

107632

sim-1of4

success

yes

2021-11-03 12:45:24+00:00

2021-11-03 12:53:58+00:00

0:08:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	44.399999999999615
in-drivable-lane_median	0.0
driven_lanedir_consec_median	6.540430450683964
deviation-center-line_median	1.7600730162541354

other stats

deviation-center-line_max	1.7600730162541354
deviation-center-line_mean	1.7600730162541354
deviation-center-line_min	1.7600730162541354
deviation-heading_max	9.360256236593328
deviation-heading_mean	9.360256236593328
deviation-heading_median	9.360256236593328
deviation-heading_min	9.360256236593328
distance-from-start_max	2.715521230037354
distance-from-start_mean	2.715521230037354
distance-from-start_median	2.715521230037354
distance-from-start_min	2.715521230037354
driven_any_max	6.746773988880715
driven_any_mean	6.746773988880715
driven_any_median	6.746773988880715
driven_any_min	6.746773988880715
driven_lanedir_consec_max	6.540430450683964
driven_lanedir_consec_mean	6.540430450683964
driven_lanedir_consec_min	6.540430450683964
driven_lanedir_max	6.540430450683964
driven_lanedir_mean	6.540430450683964
driven_lanedir_median	6.540430450683964
driven_lanedir_min	6.540430450683964
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 6.746773988880715, "survival_time": 44.399999999999615, "driven_lanedir": 6.540430450683964, "in-drivable-lane": 0.0, "deviation-heading": 9.360256236593328, "distance-from-start": 2.715521230037354, "deviation-center-line": 1.7600730162541354, "driven_lanedir_consec": 6.540430450683964}}
simulation-passed	1
survival_time_max	44.399999999999615
survival_time_mean	44.399999999999615
survival_time_min	44.399999999999615

No reset possible