Submission 17495

Submission

17495

Competing

yes

Challenge

aido-LFP-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-01 13:48:05+00:00

Last status update

2021-12-04 20:47:21+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 107627 sim-1of4: 107618 sim-2of4: 107633 sim-3of4: 107621

User label

baseline-dagger-pytorch

Admin priority

Blessing

n/a

User priority

107633

Click the images to see detailed statistics about the episode.

loop-000

107627

Click the images to see detailed statistics about the episode.

loop2-000

107621

Click the images to see detailed statistics about the episode.

zigzag-000

107618

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

107633

sim-2of4

success

yes

2021-11-03 12:47:06+00:00

2021-11-03 12:48:34+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.399999999999985
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.9535315433096052
deviation-center-line_median	0.25719703663221316

other stats

deviation-center-line_max	0.25719703663221316
deviation-center-line_mean	0.25719703663221316
deviation-center-line_min	0.25719703663221316
deviation-heading_max	1.5385670767868518
deviation-heading_mean	1.5385670767868518
deviation-heading_median	1.5385670767868518
deviation-heading_min	1.5385670767868518
distance-from-start_max	0.7768103220184499
distance-from-start_mean	0.7768103220184499
distance-from-start_median	0.7768103220184499
distance-from-start_min	0.7768103220184499
driven_any_max	0.9814887967345316
driven_any_mean	0.9814887967345316
driven_any_median	0.9814887967345316
driven_any_min	0.9814887967345316
driven_lanedir_consec_max	0.9535315433096052
driven_lanedir_consec_mean	0.9535315433096052
driven_lanedir_consec_min	0.9535315433096052
driven_lanedir_max	0.9535315433096052
driven_lanedir_mean	0.9535315433096052
driven_lanedir_median	0.9535315433096052
driven_lanedir_min	0.9535315433096052
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 0.9814887967345316, "survival_time": 6.399999999999985, "driven_lanedir": 0.9535315433096052, "in-drivable-lane": 0.0, "deviation-heading": 1.5385670767868518, "distance-from-start": 0.7768103220184499, "deviation-center-line": 0.25719703663221316, "driven_lanedir_consec": 0.9535315433096052}}
simulation-passed	1
survival_time_max	6.399999999999985
survival_time_mean	6.399999999999985
survival_time_min	6.399999999999985

No reset possible

107630

sim-2of4

success

yes

2021-11-03 12:44:51+00:00

2021-11-03 12:46:27+00:00

0:01:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107627

sim-0of4

success

yes

2021-11-03 12:43:55+00:00

2021-11-03 12:49:28+00:00

0:05:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	9.649144163950949
deviation-center-line_median	2.7605349872456517

other stats

deviation-center-line_max	2.7605349872456517
deviation-center-line_mean	2.7605349872456517
deviation-center-line_min	2.7605349872456517
deviation-heading_max	11.394971495315682
deviation-heading_mean	11.394971495315682
deviation-heading_median	11.394971495315682
deviation-heading_min	11.394971495315682
distance-from-start_max	1.0693642484770567
distance-from-start_mean	1.0693642484770567
distance-from-start_median	1.0693642484770567
distance-from-start_min	1.0693642484770567
driven_any_max	9.942930190248155
driven_any_mean	9.942930190248155
driven_any_median	9.942930190248155
driven_any_min	9.942930190248155
driven_lanedir_consec_max	9.649144163950949
driven_lanedir_consec_mean	9.649144163950949
driven_lanedir_consec_min	9.649144163950949
driven_lanedir_max	9.649144163950949
driven_lanedir_mean	9.649144163950949
driven_lanedir_median	9.649144163950949
driven_lanedir_min	9.649144163950949
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 9.942930190248155, "survival_time": 59.99999999999873, "driven_lanedir": 9.649144163950949, "in-drivable-lane": 0.0, "deviation-heading": 11.394971495315682, "distance-from-start": 1.0693642484770567, "deviation-center-line": 2.7605349872456517, "driven_lanedir_consec": 9.649144163950949}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107623

sim-2of4

success

yes

2021-11-03 12:42:52+00:00

2021-11-03 12:44:25+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107621

sim-3of4

success

yes

2021-11-03 12:41:53+00:00

2021-11-03 12:44:46+00:00

0:02:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	19.100000000000136
in-drivable-lane_median	0.0
driven_lanedir_consec_median	2.731286258863705
deviation-center-line_median	0.7205897875362623

other stats

deviation-center-line_max	0.7205897875362623
deviation-center-line_mean	0.7205897875362623
deviation-center-line_min	0.7205897875362623
deviation-heading_max	4.0444950051874855
deviation-heading_mean	4.0444950051874855
deviation-heading_median	4.0444950051874855
deviation-heading_min	4.0444950051874855
distance-from-start_max	2.4255112277864805
distance-from-start_mean	2.4255112277864805
distance-from-start_median	2.4255112277864805
distance-from-start_min	2.4255112277864805
driven_any_max	2.8056459156362985
driven_any_mean	2.8056459156362985
driven_any_median	2.8056459156362985
driven_any_min	2.8056459156362985
driven_lanedir_consec_max	2.731286258863705
driven_lanedir_consec_mean	2.731286258863705
driven_lanedir_consec_min	2.731286258863705
driven_lanedir_max	2.731286258863705
driven_lanedir_mean	2.731286258863705
driven_lanedir_median	2.731286258863705
driven_lanedir_min	2.731286258863705
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 2.8056459156362985, "survival_time": 19.100000000000136, "driven_lanedir": 2.731286258863705, "in-drivable-lane": 0.0, "deviation-heading": 4.0444950051874855, "distance-from-start": 2.4255112277864805, "deviation-center-line": 0.7205897875362623, "driven_lanedir_consec": 2.731286258863705}}
simulation-passed	1
survival_time_max	19.100000000000136
survival_time_mean	19.100000000000136
survival_time_min	19.100000000000136

No reset possible

107618

sim-1of4

success

yes

2021-11-03 12:40:35+00:00

2021-11-03 12:42:19+00:00

0:01:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.000000000000036
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.2160550047630394
deviation-center-line_median	0.25489473453491385

other stats

deviation-center-line_max	0.25489473453491385
deviation-center-line_mean	0.25489473453491385
deviation-center-line_min	0.25489473453491385
deviation-heading_max	1.868252516167412
deviation-heading_mean	1.868252516167412
deviation-heading_median	1.868252516167412
deviation-heading_min	1.868252516167412
distance-from-start_max	1.0878037081779657
distance-from-start_mean	1.0878037081779657
distance-from-start_median	1.0878037081779657
distance-from-start_min	1.0878037081779657
driven_any_max	1.239203347513004
driven_any_mean	1.239203347513004
driven_any_median	1.239203347513004
driven_any_min	1.239203347513004
driven_lanedir_consec_max	1.2160550047630394
driven_lanedir_consec_mean	1.2160550047630394
driven_lanedir_consec_min	1.2160550047630394
driven_lanedir_max	1.2160550047630394
driven_lanedir_mean	1.2160550047630394
driven_lanedir_median	1.2160550047630394
driven_lanedir_min	1.2160550047630394
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.239203347513004, "survival_time": 12.000000000000036, "driven_lanedir": 1.2160550047630394, "in-drivable-lane": 0.0, "deviation-heading": 1.868252516167412, "distance-from-start": 1.0878037081779657, "deviation-center-line": 0.25489473453491385, "driven_lanedir_consec": 1.2160550047630394}}
simulation-passed	1
survival_time_max	12.000000000000036
survival_time_mean	12.000000000000036
survival_time_min	12.000000000000036

No reset possible

107613

sim-1of4

success

yes

2021-11-03 12:38:21+00:00

2021-11-03 12:40:15+00:00

0:01:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107612

sim-3of4

success

yes

2021-11-03 12:38:18+00:00

2021-11-03 12:41:19+00:00

0:03:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible