Submission 17675

Submission

17675

Competing

yes

Challenge

aido-LF-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 09:06:06+00:00

Last status update

2021-12-04 20:47:19+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104170 sim-1of4: 104169 sim-2of4: 104182 sim-3of4: 104168

User label

minimal-agent

Admin priority

Blessing

n/a

User priority

104182

Click the images to see detailed statistics about the episode.

autolab-000

104170

Click the images to see detailed statistics about the episode.

loop2-000

104169

Click the images to see detailed statistics about the episode.

zigzag-000

104168

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104182

sim-2of4

success

yes

2021-11-02 16:40:40+00:00

2021-11-02 16:41:52+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.19695248970180224
survival_time_median	10.100000000000009
deviation-center-line_median	0.1253905065384011
in-drivable-lane_median	8.350000000000009

other stats

deviation-center-line_max	0.1253905065384011
deviation-center-line_mean	0.1253905065384011
deviation-center-line_min	0.1253905065384011
deviation-heading_max	0.9520924629376072
deviation-heading_mean	0.9520924629376072
deviation-heading_median	0.9520924629376072
deviation-heading_min	0.9520924629376072
distance-from-start_max	1.4926447664752691
distance-from-start_mean	1.4926447664752691
distance-from-start_median	1.4926447664752691
distance-from-start_min	1.4926447664752691
driven_any_max	1.4929097725804397
driven_any_mean	1.4929097725804397
driven_any_median	1.4929097725804397
driven_any_min	1.4929097725804397
driven_lanedir_consec_max	0.19695248970180224
driven_lanedir_consec_mean	0.19695248970180224
driven_lanedir_consec_min	0.19695248970180224
driven_lanedir_max	0.19695248970180224
driven_lanedir_mean	0.19695248970180224
driven_lanedir_median	0.19695248970180224
driven_lanedir_min	0.19695248970180224
in-drivable-lane_max	8.350000000000009
in-drivable-lane_mean	8.350000000000009
in-drivable-lane_min	8.350000000000009
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.4929097725804397, "survival_time": 10.100000000000009, "driven_lanedir": 0.19695248970180224, "in-drivable-lane": 8.350000000000009, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.4926447664752691, "deviation-center-line": 0.1253905065384011, "driven_lanedir_consec": 0.19695248970180224}}
simulation-passed	1
survival_time_max	10.100000000000009
survival_time_mean	10.100000000000009
survival_time_min	10.100000000000009

No reset possible

104177

sim-2of4

success

yes

2021-11-02 16:39:07+00:00

2021-11-02 16:40:20+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104172

sim-2of4

success

yes

2021-11-02 16:37:49+00:00

2021-11-02 16:39:01+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104170

sim-0of4

success

yes

2021-11-02 16:36:40+00:00

2021-11-02 16:37:55+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.31872588830254256
survival_time_median	12.40000000000004
deviation-center-line_median	0.2634614200814006
in-drivable-lane_median	9.150000000000045

other stats

deviation-center-line_max	0.2634614200814006
deviation-center-line_mean	0.2634614200814006
deviation-center-line_min	0.2634614200814006
deviation-heading_max	2.539741615834614
deviation-heading_mean	2.539741615834614
deviation-heading_median	2.539741615834614
deviation-heading_min	2.539741615834614
distance-from-start_max	1.8751243016635992
distance-from-start_mean	1.8751243016635992
distance-from-start_median	1.8751243016635992
distance-from-start_min	1.8751243016635992
driven_any_max	1.8759780200120315
driven_any_mean	1.8759780200120315
driven_any_median	1.8759780200120315
driven_any_min	1.8759780200120315
driven_lanedir_consec_max	0.31872588830254256
driven_lanedir_consec_mean	0.31872588830254256
driven_lanedir_consec_min	0.31872588830254256
driven_lanedir_max	0.31872588830254256
driven_lanedir_mean	0.31872588830254256
driven_lanedir_median	0.31872588830254256
driven_lanedir_min	0.31872588830254256
in-drivable-lane_max	9.150000000000045
in-drivable-lane_mean	9.150000000000045
in-drivable-lane_min	9.150000000000045
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.8759780200120315, "survival_time": 12.40000000000004, "driven_lanedir": 0.31872588830254256, "in-drivable-lane": 9.150000000000045, "deviation-heading": 2.539741615834614, "distance-from-start": 1.8751243016635992, "deviation-center-line": 0.2634614200814006, "driven_lanedir_consec": 0.31872588830254256}}
simulation-passed	1
survival_time_max	12.40000000000004
survival_time_mean	12.40000000000004
survival_time_min	12.40000000000004

No reset possible

104169

sim-1of4

success

yes

2021-11-02 16:36:38+00:00

2021-11-02 16:37:54+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1380110688095861
survival_time_median	7.549999999999981
deviation-center-line_median	0.09382161194536316
in-drivable-lane_median	6.099999999999981

other stats

deviation-center-line_max	0.09382161194536316
deviation-center-line_mean	0.09382161194536316
deviation-center-line_min	0.09382161194536316
deviation-heading_max	0.9675206445358722
deviation-heading_mean	0.9675206445358722
deviation-heading_median	0.9675206445358722
deviation-heading_min	0.9675206445358722
distance-from-start_max	1.0727030809325406
distance-from-start_mean	1.0727030809325406
distance-from-start_median	1.0727030809325406
distance-from-start_min	1.0727030809325406
driven_any_max	1.0728646211091792
driven_any_mean	1.0728646211091792
driven_any_median	1.0728646211091792
driven_any_min	1.0728646211091792
driven_lanedir_consec_max	0.1380110688095861
driven_lanedir_consec_mean	0.1380110688095861
driven_lanedir_consec_min	0.1380110688095861
driven_lanedir_max	0.1380110688095861
driven_lanedir_mean	0.1380110688095861
driven_lanedir_median	0.1380110688095861
driven_lanedir_min	0.1380110688095861
in-drivable-lane_max	6.099999999999981
in-drivable-lane_mean	6.099999999999981
in-drivable-lane_min	6.099999999999981
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.0728646211091792, "survival_time": 7.549999999999981, "driven_lanedir": 0.1380110688095861, "in-drivable-lane": 6.099999999999981, "deviation-heading": 0.9675206445358722, "distance-from-start": 1.0727030809325406, "deviation-center-line": 0.09382161194536316, "driven_lanedir_consec": 0.1380110688095861}}
simulation-passed	1
survival_time_max	7.549999999999981
survival_time_mean	7.549999999999981
survival_time_min	7.549999999999981

No reset possible

104168

sim-3of4

success

yes

2021-11-02 16:36:38+00:00

2021-11-02 16:37:46+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.19694617160956465
survival_time_median	6.199999999999986
deviation-center-line_median	0.12539055697768176
in-drivable-lane_median	4.449999999999985

other stats

deviation-center-line_max	0.12539055697768176
deviation-center-line_mean	0.12539055697768176
deviation-center-line_min	0.12539055697768176
deviation-heading_max	0.9520924629376072
deviation-heading_mean	0.9520924629376072
deviation-heading_median	0.9520924629376072
deviation-heading_min	0.9520924629376072
distance-from-start_max	0.8501561575907637
distance-from-start_mean	0.8501561575907637
distance-from-start_median	0.8501561575907637
distance-from-start_min	0.8501561575907637
driven_any_max	0.8502902342720478
driven_any_mean	0.8502902342720478
driven_any_median	0.8502902342720478
driven_any_min	0.8502902342720478
driven_lanedir_consec_max	0.19694617160956465
driven_lanedir_consec_mean	0.19694617160956465
driven_lanedir_consec_min	0.19694617160956465
driven_lanedir_max	0.19694617160956465
driven_lanedir_mean	0.19694617160956465
driven_lanedir_median	0.19694617160956465
driven_lanedir_min	0.19694617160956465
in-drivable-lane_max	4.449999999999985
in-drivable-lane_mean	4.449999999999985
in-drivable-lane_min	4.449999999999985
per-episodes	details {"loop-000-ego0": {"driven_any": 0.8502902342720478, "survival_time": 6.199999999999986, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.9520924629376072, "distance-from-start": 0.8501561575907637, "deviation-center-line": 0.12539055697768176, "driven_lanedir_consec": 0.19694617160956465}}
simulation-passed	1
survival_time_max	6.199999999999986
survival_time_mean	6.199999999999986
survival_time_min	6.199999999999986

No reset possible

104167

sim-2of4

success

yes

2021-11-02 16:36:07+00:00

2021-11-02 16:37:31+00:00

0:01:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible