Duckietown Challenges Home Challenges Submissions

Submission 2318

Submission2318
Competingyes
Challengeaido2_LF_r2-v4
UserFANG MEIYIΒ πŸ‡ΈπŸ‡¬
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
ResultπŸ’š
Jobsstep1-simulation: 17158
Next
User labelBaseline solution using imitation learning from logs
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17158step1-simulationsuccessyes0:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.319514778943256
survival_time_median3.399999999999996
deviation-center-line_median0.14321219721956907
in-drivable-lane_median2.0499999999999967


other stats
agent_compute-ego_max0.16174074481515324
agent_compute-ego_mean0.15159503423164716
agent_compute-ego_median0.14950578808784484
agent_compute-ego_min0.14678519422357733
deviation-center-line_max0.21768105498084453
deviation-center-line_mean0.12271561500230632
deviation-center-line_min0.027720906512798266
deviation-heading_max3.655032594749009
deviation-heading_mean1.6074827418142192
deviation-heading_median1.266099663893892
deviation-heading_min0.4886362551025064
driven_any_max2.4910168350063504
driven_any_mean1.309921017625998
driven_any_median1.3062827501309398
driven_any_min0.43303832405777215
driven_lanedir_consec_max0.703692114523236
driven_lanedir_consec_mean0.3340026075124708
driven_lanedir_consec_min0.07680271452255027
driven_lanedir_max0.703692114523236
driven_lanedir_mean0.33758711178837875
driven_lanedir_median0.319514778943256
driven_lanedir_min0.09472523590209024
in-drivable-lane_max4.349999999999996
in-drivable-lane_mean1.9999999999999984
in-drivable-lane_min0.40000000000000013
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3062827501309398, "sim_physics": 0.0030599411796121035, "survival_time": 3.399999999999996, "driven_lanedir": 0.09472523590209024, "sim_render-ego": 0.06820242895799525, "in-drivable-lane": 2.1499999999999977, "agent_compute-ego": 0.16174074481515324, "deviation-heading": 1.0178378189114463, "set_robot_commands": 0.08161951864466947, "deviation-center-line": 0.14321219721956907, "driven_lanedir_consec": 0.07680271452255027, "sim_compute_sim_state": 0.04377225216697244, "sim_compute_performance-ego": 0.06947987219866585, "sim_compute_robot_state-ego": 0.30516089060727286}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5487627104102557, "sim_physics": 0.0033202916383743286, "survival_time": 3.999999999999994, "driven_lanedir": 0.4280473165409451, "sim_render-ego": 0.06689688265323639, "in-drivable-lane": 2.0499999999999967, "agent_compute-ego": 0.14950578808784484, "deviation-heading": 1.6098073764142418, "set_robot_commands": 0.0764259159564972, "deviation-center-line": 0.14839142624591525, "driven_lanedir_consec": 0.4280473165409451, "sim_compute_sim_state": 0.04381081759929657, "sim_compute_performance-ego": 0.0674383670091629, "sim_compute_robot_state-ego": 0.07735752761363983}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7705044685246707, "sim_physics": 0.002904794045857021, "survival_time": 2.799999999999998, "driven_lanedir": 0.319514778943256, "sim_render-ego": 0.06046055470194135, "in-drivable-lane": 1.05, "agent_compute-ego": 0.15057029468672617, "deviation-heading": 1.266099663893892, "set_robot_commands": 0.0806111650807517, "deviation-center-line": 0.07657249005240453, "driven_lanedir_consec": 0.319514778943256, "sim_compute_sim_state": 0.04090938823563712, "sim_compute_performance-ego": 0.0631860111440931, "sim_compute_robot_state-ego": 0.07660846625055585}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.4910168350063504, "sim_physics": 0.0029373498252742197, "survival_time": 9.049999999999994, "driven_lanedir": 0.703692114523236, "sim_render-ego": 0.062378078534458224, "in-drivable-lane": 4.349999999999996, "agent_compute-ego": 0.1493731493449343, "deviation-heading": 3.655032594749009, "set_robot_commands": 0.07809541370328618, "deviation-center-line": 0.21768105498084453, "driven_lanedir_consec": 0.703692114523236, "sim_compute_sim_state": 0.04142575764524344, "sim_compute_performance-ego": 0.061617026671520254, "sim_compute_robot_state-ego": 0.0732912016178363}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.43303832405777215, "sim_physics": 0.00268521092154763, "survival_time": 1.1000000000000003, "driven_lanedir": 0.14195611303236655, "sim_render-ego": 0.06052477793260054, "in-drivable-lane": 0.40000000000000013, "agent_compute-ego": 0.14678519422357733, "deviation-heading": 0.4886362551025064, "set_robot_commands": 0.08250635320490057, "deviation-center-line": 0.027720906512798266, "driven_lanedir_consec": 0.14195611303236655, "sim_compute_sim_state": 0.041995026848532936, "sim_compute_performance-ego": 0.0628415888006037, "sim_compute_robot_state-ego": 0.0757414536042647}}
set_robot_commands_max0.08250635320490057
set_robot_commands_mean0.07985167331802102
set_robot_commands_median0.0806111650807517
set_robot_commands_min0.0764259159564972
sim_compute_performance-ego_max0.06947987219866585
sim_compute_performance-ego_mean0.06491257316480917
sim_compute_performance-ego_median0.0631860111440931
sim_compute_performance-ego_min0.061617026671520254
sim_compute_robot_state-ego_max0.30516089060727286
sim_compute_robot_state-ego_mean0.1216319079387139
sim_compute_robot_state-ego_median0.07660846625055585
sim_compute_robot_state-ego_min0.0732912016178363
sim_compute_sim_state_max0.04381081759929657
sim_compute_sim_state_mean0.0423826484991365
sim_compute_sim_state_median0.041995026848532936
sim_compute_sim_state_min0.04090938823563712
sim_physics_max0.0033202916383743286
sim_physics_mean0.0029815175221330607
sim_physics_median0.0029373498252742197
sim_physics_min0.00268521092154763
sim_render-ego_max0.06820242895799525
sim_render-ego_mean0.06369254455604634
sim_render-ego_median0.062378078534458224
sim_render-ego_min0.06046055470194135
simulation-passed1
survival_time_max9.049999999999994
survival_time_mean4.069999999999997
survival_time_min1.1000000000000003
No reset possible
17115step1-simulationerrorno0:03:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible