Duckietown Challenges Home Challenges Submissions

Submission 2334

Submission2334
Competingyes
Challengeaido2_LF_r2-v4
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 17143
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17143step1-simulationsuccessyes0:03:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06547588559990025
survival_time_median0.45
deviation-center-line_median0.010986795884802274
in-drivable-lane_median0.09999999999999998


other stats
agent_compute-ego_max0.1855294969346788
agent_compute-ego_mean0.1763763348261515
agent_compute-ego_median0.17294816176096597
agent_compute-ego_min0.17189931869506836
deviation-center-line_max0.016073309610310338
deviation-center-line_mean0.01196340158388667
deviation-center-line_min0.00907642338080725
deviation-heading_max0.3097652159357332
deviation-heading_mean0.2604368313198553
deviation-heading_median0.2499364354812047
deviation-heading_min0.23406401232761492
driven_any_max0.1661161148290178
driven_any_mean0.15140776462883884
driven_any_median0.15323077588476697
driven_any_min0.13228193718508044
driven_lanedir_consec_max0.06809852738584077
driven_lanedir_consec_mean0.06014568548728803
driven_lanedir_consec_min0.04444055902290778
driven_lanedir_max0.06809852738584077
driven_lanedir_mean0.06014568548728803
driven_lanedir_median0.06547588559990025
driven_lanedir_min0.04444055902290778
in-drivable-lane_max0.25
in-drivable-lane_mean0.14999999999999997
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15323077588476697, "sim_physics": 0.0036114321814643014, "survival_time": 0.45, "driven_lanedir": 0.06809852738584077, "sim_render-ego": 0.0744228098127577, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.1855294969346788, "deviation-heading": 0.2499364354812047, "set_robot_commands": 0.08010527822706434, "deviation-center-line": 0.010986795884802274, "driven_lanedir_consec": 0.06809852738584077, "sim_compute_sim_state": 0.04600172572665744, "sim_compute_performance-ego": 0.07160186767578125, "sim_compute_robot_state-ego": 1.3942893611060247}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16261682778551564, "sim_physics": 0.0036565065383911137, "survival_time": 0.6, "driven_lanedir": 0.06662854802592277, "sim_render-ego": 0.07077860832214355, "in-drivable-lane": 0.2, "agent_compute-ego": 0.17294816176096597, "deviation-heading": 0.3097652159357332, "set_robot_commands": 0.07947760820388794, "deviation-center-line": 0.016073309610310338, "driven_lanedir_consec": 0.06662854802592277, "sim_compute_sim_state": 0.0446013609568278, "sim_compute_performance-ego": 0.06902990738550822, "sim_compute_robot_state-ego": 0.07944023609161377}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1427931674598134, "sim_physics": 0.0034297042422824437, "survival_time": 0.45, "driven_lanedir": 0.05608490740186856, "sim_render-ego": 0.07005686230129665, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.17231414053175184, "deviation-heading": 0.27171870321035385, "set_robot_commands": 0.0788163079155816, "deviation-center-line": 0.01334651660354758, "driven_lanedir_consec": 0.05608490740186856, "sim_compute_sim_state": 0.04496985011630588, "sim_compute_performance-ego": 0.07443838649325901, "sim_compute_robot_state-ego": 0.08162856101989746}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1661161148290178, "sim_physics": 0.003632565339406331, "survival_time": 0.6, "driven_lanedir": 0.06547588559990025, "sim_render-ego": 0.07113506396611531, "in-drivable-lane": 0.25, "agent_compute-ego": 0.17919055620829263, "deviation-heading": 0.2366997896443696, "set_robot_commands": 0.08471192916234334, "deviation-center-line": 0.010333962439965916, "driven_lanedir_consec": 0.06547588559990025, "sim_compute_sim_state": 0.04565727710723877, "sim_compute_performance-ego": 0.07294185956319173, "sim_compute_robot_state-ego": 0.08172671000162761}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13228193718508044, "sim_physics": 0.003581821918487549, "survival_time": 0.4, "driven_lanedir": 0.04444055902290778, "sim_render-ego": 0.07073962688446045, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.17189931869506836, "deviation-heading": 0.23406401232761492, "set_robot_commands": 0.07852998375892639, "deviation-center-line": 0.00907642338080725, "driven_lanedir_consec": 0.04444055902290778, "sim_compute_sim_state": 0.047937870025634766, "sim_compute_performance-ego": 0.07150736451148987, "sim_compute_robot_state-ego": 0.0891089141368866}}
set_robot_commands_max0.08471192916234334
set_robot_commands_mean0.08032822145356072
set_robot_commands_median0.07947760820388794
set_robot_commands_min0.07852998375892639
sim_compute_performance-ego_max0.07443838649325901
sim_compute_performance-ego_mean0.07190387712584602
sim_compute_performance-ego_median0.07160186767578125
sim_compute_performance-ego_min0.06902990738550822
sim_compute_robot_state-ego_max1.3942893611060247
sim_compute_robot_state-ego_mean0.34523875647121005
sim_compute_robot_state-ego_median0.08172671000162761
sim_compute_robot_state-ego_min0.07944023609161377
sim_compute_sim_state_max0.047937870025634766
sim_compute_sim_state_mean0.04583361678653293
sim_compute_sim_state_median0.04565727710723877
sim_compute_sim_state_min0.0446013609568278
sim_physics_max0.0036565065383911137
sim_physics_mean0.003582406044006348
sim_physics_median0.0036114321814643014
sim_physics_min0.0034297042422824437
sim_render-ego_max0.0744228098127577
sim_render-ego_mean0.07142659425735473
sim_render-ego_median0.07077860832214355
sim_render-ego_min0.07005686230129665
simulation-passed1
survival_time_max0.6
survival_time_mean0.4999999999999999
survival_time_min0.4
No reset possible
17140step1-simulationerrorno0:03:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible