Submission 13997

Submission

13997

Competing

yes

Challenge

aido-LF-sim-validation

User

Frank (Chude) Qian 🇨🇦

Date submitted

2021-04-05 04:53:15+00:00

Last status update

2021-12-04 20:47:19+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 114812 sim-1of4: 114842 sim-2of4: 114811 sim-3of4: 114808

User label

baseline-behavior-cloning New Dataset

Admin priority

Blessing

n/a

User priority

114842

Click the images to see detailed statistics about the episode.

autolab-000

114812

Click the images to see detailed statistics about the episode.

loop2-000

114811

Click the images to see detailed statistics about the episode.

loop-000

114808

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

114842

sim-1of4

success

yes

2021-11-06 12:32:33+00:00

2021-11-06 12:33:48+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.20788474160515413
survival_time_median	3.949999999999994
deviation-center-line_median	0.047018946221723784
in-drivable-lane_median	3.149999999999994

other stats

deviation-center-line_max	0.047018946221723784
deviation-center-line_mean	0.047018946221723784
deviation-center-line_min	0.047018946221723784
deviation-heading_max	0.43289757086256464
deviation-heading_mean	0.43289757086256464
deviation-heading_median	0.43289757086256464
deviation-heading_min	0.43289757086256464
distance-from-start_max	1.5128283115960612
distance-from-start_mean	1.5128283115960612
distance-from-start_median	1.5128283115960612
distance-from-start_min	1.5128283115960612
driven_any_max	1.513273743128723
driven_any_mean	1.513273743128723
driven_any_median	1.513273743128723
driven_any_min	1.513273743128723
driven_lanedir_consec_max	0.20788474160515413
driven_lanedir_consec_mean	0.20788474160515413
driven_lanedir_consec_min	0.20788474160515413
driven_lanedir_max	0.20788474160515413
driven_lanedir_mean	0.20788474160515413
driven_lanedir_median	0.20788474160515413
driven_lanedir_min	0.20788474160515413
in-drivable-lane_max	3.149999999999994
in-drivable-lane_mean	3.149999999999994
in-drivable-lane_min	3.149999999999994
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.513273743128723, "survival_time": 3.949999999999994, "driven_lanedir": 0.20788474160515413, "in-drivable-lane": 3.149999999999994, "deviation-heading": 0.43289757086256464, "distance-from-start": 1.5128283115960612, "deviation-center-line": 0.047018946221723784, "driven_lanedir_consec": 0.20788474160515413}}
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	3.949999999999994
survival_time_min	3.949999999999994

No reset possible

114833

sim-1of4

success

yes

2021-11-06 12:30:53+00:00

2021-11-06 12:32:14+00:00

0:01:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114821

sim-1of4

success

yes

2021-11-06 12:29:22+00:00

2021-11-06 12:30:35+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114814

sim-1of4

success

yes

2021-11-06 12:27:42+00:00

2021-11-06 12:28:50+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114812

sim-0of4

success

yes

2021-11-06 12:27:18+00:00

2021-11-06 12:28:33+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.35002041974603304
survival_time_median	4.849999999999991
deviation-center-line_median	0.0935432645469072
in-drivable-lane_median	3.5499999999999905

other stats

deviation-center-line_max	0.0935432645469072
deviation-center-line_mean	0.0935432645469072
deviation-center-line_min	0.0935432645469072
deviation-heading_max	0.9293754889603804
deviation-heading_mean	0.9293754889603804
deviation-heading_median	0.9293754889603804
deviation-heading_min	0.9293754889603804
distance-from-start_max	1.980290376623938
distance-from-start_mean	1.980290376623938
distance-from-start_median	1.980290376623938
distance-from-start_min	1.980290376623938
driven_any_max	1.9812965274760672
driven_any_mean	1.9812965274760672
driven_any_median	1.9812965274760672
driven_any_min	1.9812965274760672
driven_lanedir_consec_max	0.35002041974603304
driven_lanedir_consec_mean	0.35002041974603304
driven_lanedir_consec_min	0.35002041974603304
driven_lanedir_max	0.35002041974603304
driven_lanedir_mean	0.35002041974603304
driven_lanedir_median	0.35002041974603304
driven_lanedir_min	0.35002041974603304
in-drivable-lane_max	3.5499999999999905
in-drivable-lane_mean	3.5499999999999905
in-drivable-lane_min	3.5499999999999905
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.9812965274760672, "survival_time": 4.849999999999991, "driven_lanedir": 0.35002041974603304, "in-drivable-lane": 3.5499999999999905, "deviation-heading": 0.9293754889603804, "distance-from-start": 1.980290376623938, "deviation-center-line": 0.0935432645469072, "driven_lanedir_consec": 0.35002041974603304}}
simulation-passed	1
survival_time_max	4.849999999999991
survival_time_mean	4.849999999999991
survival_time_min	4.849999999999991

No reset possible

114811

sim-2of4

success

yes

2021-11-06 12:27:16+00:00

2021-11-06 12:28:26+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.20788164216361585
survival_time_median	2.5999999999999988
deviation-center-line_median	0.04701895684051978
in-drivable-lane_median	1.7999999999999987

other stats

deviation-center-line_max	0.04701895684051978
deviation-center-line_mean	0.04701895684051978
deviation-center-line_min	0.04701895684051978
deviation-heading_max	0.43289757086256464
deviation-heading_mean	0.43289757086256464
deviation-heading_median	0.43289757086256464
deviation-heading_min	0.43289757086256464
distance-from-start_max	0.8111869585588024
distance-from-start_mean	0.8111869585588024
distance-from-start_median	0.8111869585588024
distance-from-start_min	0.8111869585588024
driven_any_max	0.8112535469469242
driven_any_mean	0.8112535469469242
driven_any_median	0.8112535469469242
driven_any_min	0.8112535469469242
driven_lanedir_consec_max	0.20788164216361585
driven_lanedir_consec_mean	0.20788164216361585
driven_lanedir_consec_min	0.20788164216361585
driven_lanedir_max	0.20788164216361585
driven_lanedir_mean	0.20788164216361585
driven_lanedir_median	0.20788164216361585
driven_lanedir_min	0.20788164216361585
in-drivable-lane_max	1.7999999999999987
in-drivable-lane_mean	1.7999999999999987
in-drivable-lane_min	1.7999999999999987
per-episodes	details {"loop-000-ego0": {"driven_any": 0.8112535469469242, "survival_time": 2.5999999999999988, "driven_lanedir": 0.20788164216361585, "in-drivable-lane": 1.7999999999999987, "deviation-heading": 0.43289757086256464, "distance-from-start": 0.8111869585588024, "deviation-center-line": 0.04701895684051978, "driven_lanedir_consec": 0.20788164216361585}}
simulation-passed	1
survival_time_max	2.5999999999999988
survival_time_mean	2.5999999999999988
survival_time_min	2.5999999999999988

No reset possible

114808

sim-3of4

success

yes

2021-11-06 12:26:18+00:00

2021-11-06 12:27:23+00:00

0:01:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.14748570039883813
survival_time_median	2.8999999999999977
deviation-center-line_median	0.03698726629108051
in-drivable-lane_median	2.1999999999999975

other stats

deviation-center-line_max	0.03698726629108051
deviation-center-line_mean	0.03698726629108051
deviation-center-line_min	0.03698726629108051
deviation-heading_max	0.4466022050964941
deviation-heading_mean	0.4466022050964941
deviation-heading_median	0.4466022050964941
deviation-heading_min	0.4466022050964941
distance-from-start_max	0.9671360659845016
distance-from-start_mean	0.9671360659845016
distance-from-start_median	0.9671360659845016
distance-from-start_min	0.9671360659845016
driven_any_max	0.9672501976437972
driven_any_mean	0.9672501976437972
driven_any_median	0.9672501976437972
driven_any_min	0.9672501976437972
driven_lanedir_consec_max	0.14748570039883813
driven_lanedir_consec_mean	0.14748570039883813
driven_lanedir_consec_min	0.14748570039883813
driven_lanedir_max	0.14748570039883813
driven_lanedir_mean	0.14748570039883813
driven_lanedir_median	0.14748570039883813
driven_lanedir_min	0.14748570039883813
in-drivable-lane_max	2.1999999999999975
in-drivable-lane_mean	2.1999999999999975
in-drivable-lane_min	2.1999999999999975
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.9672501976437972, "survival_time": 2.8999999999999977, "driven_lanedir": 0.14748570039883813, "in-drivable-lane": 2.1999999999999975, "deviation-heading": 0.4466022050964941, "distance-from-start": 0.9671360659845016, "deviation-center-line": 0.03698726629108051, "driven_lanedir_consec": 0.14748570039883813}}
simulation-passed	1
survival_time_max	2.8999999999999977
survival_time_mean	2.8999999999999977
survival_time_min	2.8999999999999977

No reset possible

114805

sim-0of4

success

yes

2021-11-06 12:25:38+00:00

2021-11-06 12:26:53+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114804

sim-2of4

success

yes

2021-11-06 12:25:36+00:00

2021-11-06 12:26:45+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114800

sim-3of4

success

yes

2021-11-06 12:24:29+00:00

2021-11-06 12:25:32+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114799

sim-0of4

success

yes

2021-11-06 12:24:01+00:00

2021-11-06 12:25:12+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

114796

sim-2of4

success

yes

2021-11-06 12:23:58+00:00

2021-11-06 12:25:02+00:00

0:01:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

62993

347

success

yes

2021-04-05 04:56:42+00:00

2021-04-05 05:05:05+00:00

0:08:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible