Submission 17569

Submission

17569

Competing

yes

Challenge

aido-LF-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 08:48:17+00:00

Last status update

2021-12-04 20:47:19+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 105829 sim-1of4: 105830 sim-2of4: 105823 sim-3of4: 105828

User label

template-ros

Admin priority

Blessing

n/a

User priority

105830

Click the images to see detailed statistics about the episode.

zigzag-000

105829

Click the images to see detailed statistics about the episode.

loop2-000

105828

Click the images to see detailed statistics about the episode.

loop-000

105823

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

105830

sim-1of4

success

yes

2021-11-03 04:40:48+00:00

2021-11-03 04:42:23+00:00

0:01:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.543683704010592
survival_time_median	13.65000000000006
deviation-center-line_median	0.23422487976946776
in-drivable-lane_median	10.600000000000044

other stats

deviation-center-line_max	0.23422487976946776
deviation-center-line_mean	0.23422487976946776
deviation-center-line_min	0.23422487976946776
deviation-heading_max	2.37033060093305
deviation-heading_mean	2.37033060093305
deviation-heading_median	2.37033060093305
deviation-heading_min	2.37033060093305
distance-from-start_max	3.693798402482159
distance-from-start_mean	3.693798402482159
distance-from-start_median	3.693798402482159
distance-from-start_min	3.693798402482159
driven_any_max	3.90553057821537
driven_any_mean	3.90553057821537
driven_any_median	3.90553057821537
driven_any_min	3.90553057821537
driven_lanedir_consec_max	0.543683704010592
driven_lanedir_consec_mean	0.543683704010592
driven_lanedir_consec_min	0.543683704010592
driven_lanedir_max	0.543683704010592
driven_lanedir_mean	0.543683704010592
driven_lanedir_median	0.543683704010592
driven_lanedir_min	0.543683704010592
in-drivable-lane_max	10.600000000000044
in-drivable-lane_mean	10.600000000000044
in-drivable-lane_min	10.600000000000044
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.90553057821537, "survival_time": 13.65000000000006, "driven_lanedir": 0.543683704010592, "in-drivable-lane": 10.600000000000044, "deviation-heading": 2.37033060093305, "distance-from-start": 3.693798402482159, "deviation-center-line": 0.23422487976946776, "driven_lanedir_consec": 0.543683704010592}}
simulation-passed	1
survival_time_max	13.65000000000006
survival_time_mean	13.65000000000006
survival_time_min	13.65000000000006

No reset possible

105829

sim-0of4

success

yes

2021-11-03 04:40:44+00:00

2021-11-03 04:41:58+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6170424564371197
survival_time_median	8.14999999999998
deviation-center-line_median	0.17892778238776663
in-drivable-lane_median	4.799999999999985

other stats

deviation-center-line_max	0.17892778238776663
deviation-center-line_mean	0.17892778238776663
deviation-center-line_min	0.17892778238776663
deviation-heading_max	1.6715705154208271
deviation-heading_mean	1.6715705154208271
deviation-heading_median	1.6715705154208271
deviation-heading_min	1.6715705154208271
distance-from-start_max	1.7185976707652513
distance-from-start_mean	1.7185976707652513
distance-from-start_median	1.7185976707652513
distance-from-start_min	1.7185976707652513
driven_any_max	1.9408125776915703
driven_any_mean	1.9408125776915703
driven_any_median	1.9408125776915703
driven_any_min	1.9408125776915703
driven_lanedir_consec_max	0.6170424564371197
driven_lanedir_consec_mean	0.6170424564371197
driven_lanedir_consec_min	0.6170424564371197
driven_lanedir_max	0.6211974265860583
driven_lanedir_mean	0.6211974265860583
driven_lanedir_median	0.6211974265860583
driven_lanedir_min	0.6211974265860583
in-drivable-lane_max	4.799999999999985
in-drivable-lane_mean	4.799999999999985
in-drivable-lane_min	4.799999999999985
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.9408125776915703, "survival_time": 8.14999999999998, "driven_lanedir": 0.6211974265860583, "in-drivable-lane": 4.799999999999985, "deviation-heading": 1.6715705154208271, "distance-from-start": 1.7185976707652513, "deviation-center-line": 0.17892778238776663, "driven_lanedir_consec": 0.6170424564371197}}
simulation-passed	1
survival_time_max	8.14999999999998
survival_time_mean	8.14999999999998
survival_time_min	8.14999999999998

No reset possible

105828

sim-3of4

success

yes

2021-11-03 04:40:41+00:00

2021-11-03 04:41:33+00:00

0:00:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.14601603956085318
survival_time_median	1.7000000000000008
deviation-center-line_median	0.05212270150251237
in-drivable-lane_median	0.8000000000000006

other stats

deviation-center-line_max	0.05212270150251237
deviation-center-line_mean	0.05212270150251237
deviation-center-line_min	0.05212270150251237
deviation-heading_max	0.5710686571277814
deviation-heading_mean	0.5710686571277814
deviation-heading_median	0.5710686571277814
deviation-heading_min	0.5710686571277814
distance-from-start_max	0.2143975325795631
distance-from-start_mean	0.2143975325795631
distance-from-start_median	0.2143975325795631
distance-from-start_min	0.2143975325795631
driven_any_max	0.21565751469824213
driven_any_mean	0.21565751469824213
driven_any_median	0.21565751469824213
driven_any_min	0.21565751469824213
driven_lanedir_consec_max	0.14601603956085318
driven_lanedir_consec_mean	0.14601603956085318
driven_lanedir_consec_min	0.14601603956085318
driven_lanedir_max	0.14601603956085318
driven_lanedir_mean	0.14601603956085318
driven_lanedir_median	0.14601603956085318
driven_lanedir_min	0.14601603956085318
in-drivable-lane_max	0.8000000000000006
in-drivable-lane_mean	0.8000000000000006
in-drivable-lane_min	0.8000000000000006
per-episodes	details {"loop-000-ego0": {"driven_any": 0.21565751469824213, "survival_time": 1.7000000000000008, "driven_lanedir": 0.14601603956085318, "in-drivable-lane": 0.8000000000000006, "deviation-heading": 0.5710686571277814, "distance-from-start": 0.2143975325795631, "deviation-center-line": 0.05212270150251237, "driven_lanedir_consec": 0.14601603956085318}}
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.7000000000000008
survival_time_min	1.7000000000000008

No reset possible

105823

sim-2of4

success

yes

2021-11-03 04:39:39+00:00

2021-11-03 04:41:02+00:00

0:01:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2029241977324503
survival_time_median	9.650000000000002
deviation-center-line_median	0.0952103547514783
in-drivable-lane_median	8.3

other stats

deviation-center-line_max	0.0952103547514783
deviation-center-line_mean	0.0952103547514783
deviation-center-line_min	0.0952103547514783
deviation-heading_max	0.754853984637854
deviation-heading_mean	0.754853984637854
deviation-heading_median	0.754853984637854
deviation-heading_min	0.754853984637854
distance-from-start_max	1.9307677063370396
distance-from-start_mean	1.9307677063370396
distance-from-start_median	1.9307677063370396
distance-from-start_min	1.9307677063370396
driven_any_max	2.472980937863588
driven_any_mean	2.472980937863588
driven_any_median	2.472980937863588
driven_any_min	2.472980937863588
driven_lanedir_consec_max	0.2029241977324503
driven_lanedir_consec_mean	0.2029241977324503
driven_lanedir_consec_min	0.2029241977324503
driven_lanedir_max	0.2029241977324503
driven_lanedir_mean	0.2029241977324503
driven_lanedir_median	0.2029241977324503
driven_lanedir_min	0.2029241977324503
in-drivable-lane_max	8.3
in-drivable-lane_mean	8.3
in-drivable-lane_min	8.3
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.472980937863588, "survival_time": 9.650000000000002, "driven_lanedir": 0.2029241977324503, "in-drivable-lane": 8.3, "deviation-heading": 0.754853984637854, "distance-from-start": 1.9307677063370396, "deviation-center-line": 0.0952103547514783, "driven_lanedir_consec": 0.2029241977324503}}
simulation-passed	1
survival_time_max	9.650000000000002
survival_time_mean	9.650000000000002
survival_time_min	9.650000000000002

No reset possible

105822

sim-1of4

success

yes

2021-11-03 04:39:04+00:00

2021-11-03 04:40:21+00:00

0:01:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105821

sim-0of4

success

yes

2021-11-03 04:39:01+00:00

2021-11-03 04:40:22+00:00

0:01:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105820

sim-3of4

success

yes

2021-11-03 04:39:01+00:00

2021-11-03 04:40:16+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105816

sim-2of4

success

yes

2021-11-03 04:38:02+00:00

2021-11-03 04:39:12+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105815

sim-3of4

success

yes

2021-11-03 04:37:35+00:00

2021-11-03 04:38:45+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105814

sim-1of4

success

yes

2021-11-03 04:37:34+00:00

2021-11-03 04:38:35+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105812

sim-0of4

success

yes

2021-11-03 04:37:31+00:00

2021-11-03 04:38:43+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105810

sim-1of4

success

yes

2021-11-03 04:35:59+00:00

2021-11-03 04:37:02+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105807

sim-3of4

success

yes

2021-11-03 04:35:54+00:00

2021-11-03 04:37:00+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105804

sim-3of4

success

yes

2021-11-03 04:34:05+00:00

2021-11-03 04:35:06+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105801

sim-1of4

success

yes

2021-11-03 04:33:59+00:00

2021-11-03 04:35:05+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105796

sim-3of4

success

yes

2021-11-03 04:32:12+00:00

2021-11-03 04:33:08+00:00

0:00:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105794

sim-1of4

success

yes

2021-11-03 04:32:11+00:00

2021-11-03 04:33:13+00:00

0:01:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible