Submission 14808

Submission

14808

Competing

yes

Challenge

aido-LF-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-04-20 22:23:17+00:00

Last status update

2021-12-04 20:47:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104408 sim-1of4: 104429 sim-2of4: 104434 sim-3of4: 104433

User label

straight

Admin priority

Blessing

n/a

User priority

104434

Click the images to see detailed statistics about the episode.

loop-000

104433

Click the images to see detailed statistics about the episode.

loop-000

104429

Click the images to see detailed statistics about the episode.

autolab-000

104408

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104434

sim-2of4

success

yes

2021-11-02 17:54:02+00:00

2021-11-02 17:55:13+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.19694617160956465
survival_time_median	6.199999999999986
deviation-center-line_median	0.12539055697768176
in-drivable-lane_median	4.449999999999985

other stats

deviation-center-line_max	0.12539055697768176
deviation-center-line_mean	0.12539055697768176
deviation-center-line_min	0.12539055697768176
deviation-heading_max	0.9520924629376072
deviation-heading_mean	0.9520924629376072
deviation-heading_median	0.9520924629376072
deviation-heading_min	0.9520924629376072
distance-from-start_max	0.8501561575907637
distance-from-start_mean	0.8501561575907637
distance-from-start_median	0.8501561575907637
distance-from-start_min	0.8501561575907637
driven_any_max	0.8502902342720478
driven_any_mean	0.8502902342720478
driven_any_median	0.8502902342720478
driven_any_min	0.8502902342720478
driven_lanedir_consec_max	0.19694617160956465
driven_lanedir_consec_mean	0.19694617160956465
driven_lanedir_consec_min	0.19694617160956465
driven_lanedir_max	0.19694617160956465
driven_lanedir_mean	0.19694617160956465
driven_lanedir_median	0.19694617160956465
driven_lanedir_min	0.19694617160956465
in-drivable-lane_max	4.449999999999985
in-drivable-lane_mean	4.449999999999985
in-drivable-lane_min	4.449999999999985
per-episodes	details {"loop-000-ego0": {"driven_any": 0.8502902342720478, "survival_time": 6.199999999999986, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.9520924629376072, "distance-from-start": 0.8501561575907637, "deviation-center-line": 0.12539055697768176, "driven_lanedir_consec": 0.19694617160956465}}
simulation-passed	1
survival_time_max	6.199999999999986
survival_time_mean	6.199999999999986
survival_time_min	6.199999999999986

No reset possible

104433

sim-3of4

success

yes

2021-11-02 17:53:57+00:00

2021-11-02 17:55:00+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.19694617160956465
survival_time_median	6.199999999999986
deviation-center-line_median	0.12539055697768176
in-drivable-lane_median	4.449999999999985

other stats

deviation-center-line_max	0.12539055697768176
deviation-center-line_mean	0.12539055697768176
deviation-center-line_min	0.12539055697768176
deviation-heading_max	0.9520924629376072
deviation-heading_mean	0.9520924629376072
deviation-heading_median	0.9520924629376072
deviation-heading_min	0.9520924629376072
distance-from-start_max	0.8501561575907637
distance-from-start_mean	0.8501561575907637
distance-from-start_median	0.8501561575907637
distance-from-start_min	0.8501561575907637
driven_any_max	0.8502902342720478
driven_any_mean	0.8502902342720478
driven_any_median	0.8502902342720478
driven_any_min	0.8502902342720478
driven_lanedir_consec_max	0.19694617160956465
driven_lanedir_consec_mean	0.19694617160956465
driven_lanedir_consec_min	0.19694617160956465
driven_lanedir_max	0.19694617160956465
driven_lanedir_mean	0.19694617160956465
driven_lanedir_median	0.19694617160956465
driven_lanedir_min	0.19694617160956465
in-drivable-lane_max	4.449999999999985
in-drivable-lane_mean	4.449999999999985
in-drivable-lane_min	4.449999999999985
per-episodes	details {"loop-000-ego0": {"driven_any": 0.8502902342720478, "survival_time": 6.199999999999986, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.9520924629376072, "distance-from-start": 0.8501561575907637, "deviation-center-line": 0.12539055697768176, "driven_lanedir_consec": 0.19694617160956465}}
simulation-passed	1
survival_time_max	6.199999999999986
survival_time_mean	6.199999999999986
survival_time_min	6.199999999999986

No reset possible

104429

sim-1of4

success

yes

2021-11-02 17:52:56+00:00

2021-11-02 17:54:25+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.19695248970180224
survival_time_median	10.100000000000009
deviation-center-line_median	0.1253905065384011
in-drivable-lane_median	8.350000000000009

other stats

deviation-center-line_max	0.1253905065384011
deviation-center-line_mean	0.1253905065384011
deviation-center-line_min	0.1253905065384011
deviation-heading_max	0.9520924629376072
deviation-heading_mean	0.9520924629376072
deviation-heading_median	0.9520924629376072
deviation-heading_min	0.9520924629376072
distance-from-start_max	1.4926447664752691
distance-from-start_mean	1.4926447664752691
distance-from-start_median	1.4926447664752691
distance-from-start_min	1.4926447664752691
driven_any_max	1.4929097725804397
driven_any_mean	1.4929097725804397
driven_any_median	1.4929097725804397
driven_any_min	1.4929097725804397
driven_lanedir_consec_max	0.19695248970180224
driven_lanedir_consec_mean	0.19695248970180224
driven_lanedir_consec_min	0.19695248970180224
driven_lanedir_max	0.19695248970180224
driven_lanedir_mean	0.19695248970180224
driven_lanedir_median	0.19695248970180224
driven_lanedir_min	0.19695248970180224
in-drivable-lane_max	8.350000000000009
in-drivable-lane_mean	8.350000000000009
in-drivable-lane_min	8.350000000000009
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.4929097725804397, "survival_time": 10.100000000000009, "driven_lanedir": 0.19695248970180224, "in-drivable-lane": 8.350000000000009, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.4926447664752691, "deviation-center-line": 0.1253905065384011, "driven_lanedir_consec": 0.19695248970180224}}
simulation-passed	1
survival_time_max	10.100000000000009
survival_time_mean	10.100000000000009
survival_time_min	10.100000000000009

No reset possible

104428

sim-2of4

success

yes

2021-11-02 17:52:15+00:00

2021-11-02 17:53:25+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104427

sim-3of4

success

yes

2021-11-02 17:52:10+00:00

2021-11-02 17:53:29+00:00

0:01:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104424

sim-1of4

success

yes

2021-11-02 17:51:10+00:00

2021-11-02 17:52:34+00:00

0:01:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104422

sim-3of4

success

yes

2021-11-02 17:50:33+00:00

2021-11-02 17:51:35+00:00

0:01:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104421

sim-2of4

success

yes

2021-11-02 17:50:31+00:00

2021-11-02 17:51:51+00:00

0:01:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104416

sim-1of4

success

yes

2021-11-02 17:49:33+00:00

2021-11-02 17:50:47+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104414

sim-2of4

success

yes

2021-11-02 17:49:04+00:00

2021-11-02 17:50:20+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104413

sim-3of4

success

yes

2021-11-02 17:49:03+00:00

2021-11-02 17:50:22+00:00

0:01:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104408

sim-0of4

success

yes

2021-11-02 17:47:56+00:00

2021-11-02 17:49:21+00:00

0:01:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.31872588830254256
survival_time_median	12.40000000000004
deviation-center-line_median	0.2634614200814006
in-drivable-lane_median	9.150000000000045

other stats

deviation-center-line_max	0.2634614200814006
deviation-center-line_mean	0.2634614200814006
deviation-center-line_min	0.2634614200814006
deviation-heading_max	2.539741615834614
deviation-heading_mean	2.539741615834614
deviation-heading_median	2.539741615834614
deviation-heading_min	2.539741615834614
distance-from-start_max	1.8751243016635992
distance-from-start_mean	1.8751243016635992
distance-from-start_median	1.8751243016635992
distance-from-start_min	1.8751243016635992
driven_any_max	1.8759780200120315
driven_any_mean	1.8759780200120315
driven_any_median	1.8759780200120315
driven_any_min	1.8759780200120315
driven_lanedir_consec_max	0.31872588830254256
driven_lanedir_consec_mean	0.31872588830254256
driven_lanedir_consec_min	0.31872588830254256
driven_lanedir_max	0.31872588830254256
driven_lanedir_mean	0.31872588830254256
driven_lanedir_median	0.31872588830254256
driven_lanedir_min	0.31872588830254256
in-drivable-lane_max	9.150000000000045
in-drivable-lane_mean	9.150000000000045
in-drivable-lane_min	9.150000000000045
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.8759780200120315, "survival_time": 12.40000000000004, "driven_lanedir": 0.31872588830254256, "in-drivable-lane": 9.150000000000045, "deviation-heading": 2.539741615834614, "distance-from-start": 1.8751243016635992, "deviation-center-line": 0.2634614200814006, "driven_lanedir_consec": 0.31872588830254256}}
simulation-passed	1
survival_time_max	12.40000000000004
survival_time_mean	12.40000000000004
survival_time_min	12.40000000000004

No reset possible

104406

sim-2of4

success

yes

2021-11-02 17:47:29+00:00

2021-11-02 17:48:49+00:00

0:01:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104405

sim-1of4

success

yes

2021-11-02 17:47:28+00:00

2021-11-02 17:49:13+00:00

0:01:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104403

sim-3of4

success

yes

2021-11-02 17:46:52+00:00

2021-11-02 17:48:34+00:00

0:01:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104399

sim-0of4

success

yes

2021-11-02 17:46:19+00:00

2021-11-02 17:47:43+00:00

0:01:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible