Duckietown Challenges Home Challenges Submissions

Submission 2322

Submission2322
Competingyes
Challengeaido2_LF_r2-v4
UserBhairav Mehta
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 17196
Next
User labelBaseline solution using imitation learning from logs
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17196step1-simulationsuccessyes0:10:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.32213713493258966
survival_time_median5.349999999999989
deviation-center-line_median0.10947866131513168
in-drivable-lane_median2.549999999999994


other stats
agent_compute-ego_max0.08707147059233292
agent_compute-ego_mean0.08491525548362211
agent_compute-ego_median0.084543350537618
agent_compute-ego_min0.08337404794782122
deviation-center-line_max0.30943856151569576
deviation-center-line_mean0.13558784946922783
deviation-center-line_min0.05474306385624051
deviation-heading_max5.845225846718547
deviation-heading_mean3.1290424969605697
deviation-heading_median2.2367740589508944
deviation-heading_min0.8872721522108287
driven_any_max2.668518652355622
driven_any_mean1.4397422331748193
driven_any_median1.0279164629042528
driven_any_min0.4524014048252397
driven_lanedir_consec_max0.7452268851592021
driven_lanedir_consec_mean0.414186975114613
driven_lanedir_consec_min0.1643975632198682
driven_lanedir_max0.7452268851592021
driven_lanedir_mean0.414186975114613
driven_lanedir_median0.32213713493258966
driven_lanedir_min0.1643975632198682
in-drivable-lane_max7.900000000000046
in-drivable-lane_mean4.100000000000016
in-drivable-lane_min1.1499999999999997
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4775303713478112, "sim_physics": 0.00206688176030698, "survival_time": 2.3, "driven_lanedir": 0.1643975632198682, "sim_render-ego": 0.03266474993332573, "in-drivable-lane": 1.1499999999999997, "agent_compute-ego": 0.08707147059233292, "deviation-heading": 0.8872721522108287, "set_robot_commands": 0.04658510892287544, "deviation-center-line": 0.05474306385624051, "driven_lanedir_consec": 0.1643975632198682, "sim_compute_sim_state": 0.018944740295410156, "sim_compute_performance-ego": 0.033800975136134934, "sim_compute_robot_state-ego": 0.24329155942668085}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0279164629042528, "sim_physics": 0.001524526382161078, "survival_time": 5.349999999999989, "driven_lanedir": 0.32213713493258966, "sim_render-ego": 0.032695790317571055, "in-drivable-lane": 2.549999999999994, "agent_compute-ego": 0.08337404794782122, "deviation-heading": 2.2367740589508944, "set_robot_commands": 0.04773833372882594, "deviation-center-line": 0.10947866131513168, "driven_lanedir_consec": 0.32213713493258966, "sim_compute_sim_state": 0.01904997424544575, "sim_compute_performance-ego": 0.03389539005600403, "sim_compute_robot_state-ego": 0.04089099001661639}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4524014048252397, "sim_physics": 0.0015138105912642045, "survival_time": 2.7499999999999982, "driven_lanedir": 0.1691852145557844, "sim_render-ego": 0.03228483200073242, "in-drivable-lane": 1.299999999999999, "agent_compute-ego": 0.08528193994001909, "deviation-heading": 1.0670422529827466, "set_robot_commands": 0.04696846008300781, "deviation-center-line": 0.05799695215306621, "driven_lanedir_consec": 0.1691852145557844, "sim_compute_sim_state": 0.019180883060802113, "sim_compute_performance-ego": 0.03395423022183505, "sim_compute_robot_state-ego": 0.04128106724132191}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.668518652355622, "sim_physics": 0.0015081477165222168, "survival_time": 14.950000000000076, "driven_lanedir": 0.7452268851592021, "sim_render-ego": 0.032754600048065186, "in-drivable-lane": 7.600000000000039, "agent_compute-ego": 0.084543350537618, "deviation-heading": 5.845225846718547, "set_robot_commands": 0.047044765949249265, "deviation-center-line": 0.30943856151569576, "driven_lanedir_consec": 0.7452268851592021, "sim_compute_sim_state": 0.01911054372787475, "sim_compute_performance-ego": 0.03411301851272583, "sim_compute_robot_state-ego": 0.0403946590423584}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.572344274441171, "sim_physics": 0.0015049473444620769, "survival_time": 14.950000000000076, "driven_lanedir": 0.6699880777056206, "sim_render-ego": 0.03347188154856364, "in-drivable-lane": 7.900000000000046, "agent_compute-ego": 0.08430546840031941, "deviation-heading": 5.608898173939833, "set_robot_commands": 0.046942893664042154, "deviation-center-line": 0.1462820085060051, "driven_lanedir_consec": 0.6699880777056206, "sim_compute_sim_state": 0.01910713275273641, "sim_compute_performance-ego": 0.0338070011138916, "sim_compute_robot_state-ego": 0.04029829422632853}}
set_robot_commands_max0.04773833372882594
set_robot_commands_mean0.04705591246960013
set_robot_commands_median0.04696846008300781
set_robot_commands_min0.04658510892287544
sim_compute_performance-ego_max0.03411301851272583
sim_compute_performance-ego_mean0.03391412300811829
sim_compute_performance-ego_median0.03389539005600403
sim_compute_performance-ego_min0.033800975136134934
sim_compute_robot_state-ego_max0.24329155942668085
sim_compute_robot_state-ego_mean0.08123131399066122
sim_compute_robot_state-ego_median0.04089099001661639
sim_compute_robot_state-ego_min0.04029829422632853
sim_compute_sim_state_max0.019180883060802113
sim_compute_sim_state_mean0.01907865481645384
sim_compute_sim_state_median0.01910713275273641
sim_compute_sim_state_min0.018944740295410156
sim_physics_max0.00206688176030698
sim_physics_mean0.0016236627589433113
sim_physics_median0.0015138105912642045
sim_physics_min0.0015049473444620769
sim_render-ego_max0.03347188154856364
sim_render-ego_mean0.0327743707696516
sim_render-ego_median0.032695790317571055
sim_render-ego_min0.03228483200073242
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.060000000000027
survival_time_min2.3
No reset possible
17156step1-simulationabortedyes0:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17137step1-simulationabortedno0:05:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible