Submission 17566

Submission

17566

Competing

yes

Challenge

aido-LFV_multi-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 08:48:11+00:00

Last status update

2021-12-04 20:47:23+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 105893 sim-1of4: 105895 sim-2of4: 105890 sim-3of4: 105894

User label

template-ros

Admin priority

Blessing

n/a

User priority

105895

Click the images to see detailed statistics about the episode.

zigzag-000

105894

Click the images to see detailed statistics about the episode.

loop-000

105893

Click the images to see detailed statistics about the episode.

loop2-000

105890

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

105895

sim-1of4

success

yes

2021-11-03 04:56:22+00:00

2021-11-03 04:59:38+00:00

0:03:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	10.15000000000001
in-drivable-lane_median	8.425000000000008
driven_lanedir_consec_median	0.35962472567622306
deviation-center-line_median	0.1052657655845778

other stats

deviation-center-line_max	0.1673321181765728
deviation-center-line_mean	0.10857334795260495
deviation-center-line_min	0.05642974246469139
deviation-heading_max	0.807800640557598
deviation-heading_mean	0.6040868077656704
deviation-heading_median	0.5594616133545697
deviation-heading_min	0.489623363795944
distance-from-start_max	2.596785059940118
distance-from-start_mean	1.5344235195431646
distance-from-start_median	1.4179974367831534
distance-from-start_min	0.7049141446662338
driven_any_max	2.695081878728849
driven_any_mean	1.583103146817428
driven_any_median	1.465887602971501
driven_any_min	0.7055555025978625
driven_lanedir_consec_max	0.586195549571924
driven_lanedir_consec_mean	0.3654219939353261
driven_lanedir_consec_min	0.15624297481693394
driven_lanedir_max	0.586195549571924
driven_lanedir_mean	0.3654219939353261
driven_lanedir_median	0.35962472567622306
driven_lanedir_min	0.15624297481693394
in-drivable-lane_max	9.20000000000001
in-drivable-lane_mean	8.46250000000001
in-drivable-lane_min	7.80000000000001
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.7055555025978625, "survival_time": 10.15000000000001, "driven_lanedir": 0.20900660253066097, "in-drivable-lane": 9.050000000000008, "deviation-heading": 0.5799604672360525, "distance-from-start": 0.7049141446662338, "deviation-center-line": 0.07738198324775468, "driven_lanedir_consec": 0.20900660253066097}, "zigzag-000-ego1": {"driven_any": 1.7119623323036277, "survival_time": 10.15000000000001, "driven_lanedir": 0.5102428488217852, "in-drivable-lane": 7.80000000000001, "deviation-heading": 0.807800640557598, "distance-from-start": 1.6318296873347364, "deviation-center-line": 0.13314954792140096, "driven_lanedir_consec": 0.5102428488217852}, "zigzag-000-ego2": {"driven_any": 2.695081878728849, "survival_time": 10.15000000000001, "driven_lanedir": 0.586195549571924, "in-drivable-lane": 7.80000000000001, "deviation-heading": 0.5389627594730868, "distance-from-start": 2.596785059940118, "deviation-center-line": 0.1673321181765728, "driven_lanedir_consec": 0.586195549571924}, "zigzag-000-ego3": {"driven_any": 1.219812873639374, "survival_time": 10.15000000000001, "driven_lanedir": 0.15624297481693394, "in-drivable-lane": 9.20000000000001, "deviation-heading": 0.489623363795944, "distance-from-start": 1.2041651862315703, "deviation-center-line": 0.05642974246469139, "driven_lanedir_consec": 0.15624297481693394}}
simulation-passed	1
survival_time_max	10.15000000000001
survival_time_mean	10.15000000000001
survival_time_min	10.15000000000001

No reset possible

105894

sim-3of4

success

yes

2021-11-03 04:56:19+00:00

2021-11-03 04:58:59+00:00

0:02:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.199999999999982
in-drivable-lane_median	5.949999999999983
driven_lanedir_consec_median	0.352046566469677
deviation-center-line_median	0.1251382288770948

other stats

deviation-center-line_max	1.0207216072609266
deviation-center-line_mean	0.34097838210580045
deviation-center-line_min	0.09291546340808556
deviation-heading_max	3.301991825640301
deviation-heading_mean	1.556770501805412
deviation-heading_median	1.2079836714143115
deviation-heading_min	0.509122838752723
distance-from-start_max	1.9110277034859455
distance-from-start_mean	1.0892401849836184
distance-from-start_median	0.9525176829997792
distance-from-start_min	0.54089767044897
driven_any_max	2.014178459591265
driven_any_mean	1.1194832367380765
driven_any_median	0.9610564198885124
driven_any_min	0.5416416475840157
driven_lanedir_consec_max	0.6670356797177335
driven_lanedir_consec_mean	0.3809422464282075
driven_lanedir_consec_min	0.15264017305574273
driven_lanedir_max	0.6670356797177335
driven_lanedir_mean	0.3864683285149262
driven_lanedir_median	0.36309873064311415
driven_lanedir_min	0.15264017305574273
in-drivable-lane_max	7.099999999999981
in-drivable-lane_mean	4.749999999999987
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 2.014178459591265, "survival_time": 8.199999999999982, "driven_lanedir": 0.19773822672936037, "in-drivable-lane": 6.299999999999984, "deviation-heading": 1.8244669232377289, "distance-from-start": 1.9110277034859455, "deviation-center-line": 0.13405775282904006, "driven_lanedir_consec": 0.1756338983824861}, "loop-000-ego1": {"driven_any": 1.0568706125155316, "survival_time": 8.199999999999982, "driven_lanedir": 0.15264017305574273, "in-drivable-lane": 7.099999999999981, "deviation-heading": 0.5915004195908948, "distance-from-start": 1.0472850900371908, "deviation-center-line": 0.09291546340808556, "driven_lanedir_consec": 0.15264017305574273}, "loop-000-ego2": {"driven_any": 0.5416416475840157, "survival_time": 8.199999999999982, "driven_lanedir": 0.5284592345568679, "in-drivable-lane": 0.0, "deviation-heading": 3.301991825640301, "distance-from-start": 0.54089767044897, "deviation-center-line": 1.0207216072609266, "driven_lanedir_consec": 0.5284592345568679}, "loop-000-ego3": {"driven_any": 0.8652422272614931, "survival_time": 8.199999999999982, "driven_lanedir": 0.6670356797177335, "in-drivable-lane": 5.599999999999983, "deviation-heading": 0.509122838752723, "distance-from-start": 0.8577502759623676, "deviation-center-line": 0.11621870492514956, "driven_lanedir_consec": 0.6670356797177335}}
simulation-passed	1
survival_time_max	8.199999999999982
survival_time_mean	8.199999999999982
survival_time_min	8.199999999999982

No reset possible

105893

sim-0of4

success

yes

2021-11-03 04:55:52+00:00

2021-11-03 04:57:28+00:00

0:01:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	3.7499999999999942
in-drivable-lane_median	2.649999999999994
driven_lanedir_consec_median	0.18057035326277504
deviation-center-line_median	0.08071729251835011

other stats

deviation-center-line_max	0.09524570421526891
deviation-center-line_mean	0.08071729251835011
deviation-center-line_min	0.06618888082143129
deviation-heading_max	0.6131951125086655
deviation-heading_mean	0.5761610270999794
deviation-heading_median	0.5761610270999794
deviation-heading_min	0.5391269416912933
distance-from-start_max	0.7901554705524935
distance-from-start_mean	0.7823414902231411
distance-from-start_median	0.7823414902231411
distance-from-start_min	0.7745275098937887
driven_any_max	0.7932404650501621
driven_any_mean	0.79298199483497
driven_any_median	0.79298199483497
driven_any_min	0.7927235246197779
driven_lanedir_consec_max	0.18628257030439155
driven_lanedir_consec_mean	0.18057035326277504
driven_lanedir_consec_min	0.17485813622115853
driven_lanedir_max	0.18628257030439155
driven_lanedir_mean	0.18057035326277504
driven_lanedir_median	0.18057035326277504
driven_lanedir_min	0.17485813622115853
in-drivable-lane_max	2.649999999999994
in-drivable-lane_mean	2.649999999999994
in-drivable-lane_min	2.649999999999994
per-episodes	details {"loop2-000-ego0": {"driven_any": 0.7927235246197779, "survival_time": 3.7499999999999942, "driven_lanedir": 0.18628257030439155, "in-drivable-lane": 2.649999999999994, "deviation-heading": 0.6131951125086655, "distance-from-start": 0.7745275098937887, "deviation-center-line": 0.06618888082143129, "driven_lanedir_consec": 0.18628257030439155}, "loop2-000-ego1": {"driven_any": 0.7932404650501621, "survival_time": 3.7499999999999942, "driven_lanedir": 0.17485813622115853, "in-drivable-lane": 2.649999999999994, "deviation-heading": 0.5391269416912933, "distance-from-start": 0.7901554705524935, "deviation-center-line": 0.09524570421526891, "driven_lanedir_consec": 0.17485813622115853}}
simulation-passed	1
survival_time_max	3.7499999999999942
survival_time_mean	3.7499999999999942
survival_time_min	3.7499999999999942

No reset possible

105890

sim-2of4

success

yes

2021-11-03 04:55:13+00:00

2021-11-03 04:57:50+00:00

0:02:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.249999999999982
in-drivable-lane_median	5.999999999999982
driven_lanedir_consec_median	0.2544287235051862
deviation-center-line_median	0.08217960621438308

other stats

deviation-center-line_max	0.1564467136498831
deviation-center-line_mean	0.09696124204556196
deviation-center-line_min	0.06703904210359855
deviation-heading_max	1.8025147192622968
deviation-heading_mean	0.801512949016954
deviation-heading_median	0.5088256030383933
deviation-heading_min	0.38588587072873265
distance-from-start_max	1.8409956206326223
distance-from-start_mean	1.4436729962456147
distance-from-start_median	1.593168084854319
distance-from-start_min	0.7473601946411987
driven_any_max	1.908837227016058
driven_any_mean	1.4814872160963175
driven_any_median	1.616483361113129
driven_any_min	0.7841449151429538
driven_lanedir_consec_max	0.277617884508059
driven_lanedir_consec_mean	0.2175419091055848
driven_lanedir_consec_min	0.08369230490390778
driven_lanedir_max	0.277617884508059
driven_lanedir_mean	0.2175419091055848
driven_lanedir_median	0.2544287235051862
driven_lanedir_min	0.08369230490390778
in-drivable-lane_max	6.399999999999982
in-drivable-lane_mean	5.912499999999982
in-drivable-lane_min	5.249999999999985
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.434905936909613, "survival_time": 7.249999999999982, "driven_lanedir": 0.24055766354600805, "in-drivable-lane": 5.249999999999985, "deviation-heading": 1.8025147192622968, "distance-from-start": 1.4126024944013431, "deviation-center-line": 0.1564467136498831, "driven_lanedir_consec": 0.24055766354600805}, "autolab-000-ego1": {"driven_any": 0.7841449151429538, "survival_time": 7.249999999999982, "driven_lanedir": 0.08369230490390778, "in-drivable-lane": 6.399999999999982, "deviation-heading": 0.6256856006043656, "distance-from-start": 0.7473601946411987, "deviation-center-line": 0.07176046070145359, "driven_lanedir_consec": 0.08369230490390778}, "autolab-000-ego2": {"driven_any": 1.908837227016058, "survival_time": 7.249999999999982, "driven_lanedir": 0.277617884508059, "in-drivable-lane": 5.899999999999982, "deviation-heading": 0.391965605472421, "distance-from-start": 1.8409956206326223, "deviation-center-line": 0.09259875172731256, "driven_lanedir_consec": 0.277617884508059}, "autolab-000-ego3": {"driven_any": 1.798060785316645, "survival_time": 7.249999999999982, "driven_lanedir": 0.26829978346436434, "in-drivable-lane": 6.099999999999982, "deviation-heading": 0.38588587072873265, "distance-from-start": 1.7737336753072948, "deviation-center-line": 0.06703904210359855, "driven_lanedir_consec": 0.26829978346436434}}
simulation-passed	1
survival_time_max	7.249999999999982
survival_time_mean	7.249999999999982
survival_time_min	7.249999999999982

No reset possible

105886

sim-0of4

success

yes

2021-11-03 04:53:30+00:00

2021-11-03 04:55:09+00:00

0:01:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105885

sim-1of4

success

yes

2021-11-03 04:53:30+00:00

2021-11-03 04:55:51+00:00

0:02:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105883

sim-3of4

success

yes

2021-11-03 04:53:07+00:00

2021-11-03 04:56:01+00:00

0:02:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105869

sim-2of4

success

yes

2021-11-03 04:49:50+00:00

2021-11-03 04:53:31+00:00

0:03:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105868

sim-3of4

success

yes

2021-11-03 04:49:48+00:00

2021-11-03 04:52:11+00:00

0:02:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible