Duckietown Challenges Home Challenges Submissions

Submission 2319

Submission2319
Competingyes
Challengeaido2_LF_r2-v4
UserFANG MEIYI 🇸🇬
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 17159
Next
User labelBaseline solution using imitation learning from logs
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17159step1-simulationsuccessyes0:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09419855929319844
survival_time_median0.65
deviation-center-line_median0.024398298032740247
in-drivable-lane_median0.09999999999999998


other stats
agent_compute-ego_max0.16524457931518555
agent_compute-ego_mean0.15472414448691807
agent_compute-ego_median0.15227554394648626
agent_compute-ego_min0.1476463187824596
deviation-center-line_max0.0628032172006529
deviation-center-line_mean0.029992680318809917
deviation-center-line_min0.007093610227727502
deviation-heading_max0.5188310793819214
deviation-heading_mean0.3329327354329177
deviation-heading_median0.28263420392485217
deviation-heading_min0.22951461988336885
driven_any_max0.5707216696146715
driven_any_mean0.3974774231962924
driven_any_median0.37412013163993807
driven_any_min0.23119697229429292
driven_lanedir_consec_max0.2667790289000642
driven_lanedir_consec_mean0.14041720895656892
driven_lanedir_consec_min0.08166532262384874
driven_lanedir_max0.3007930426776575
driven_lanedir_mean0.1669351845684384
driven_lanedir_median0.09464906999322364
driven_lanedir_min0.08166532262384874
in-drivable-lane_max0.5500000000000003
in-drivable-lane_mean0.16000000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.55479429313413, "sim_physics": 0.003348210278679343, "survival_time": 0.8500000000000002, "driven_lanedir": 0.09464906999322364, "sim_render-ego": 0.07221592173856847, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.16524457931518555, "deviation-heading": 0.24255146657121804, "set_robot_commands": 0.08178368736715878, "deviation-center-line": 0.024398298032740247, "driven_lanedir_consec": 0.09419855929319844, "sim_compute_sim_state": 0.044889393974752986, "sim_compute_performance-ego": 0.07068286222570083, "sim_compute_robot_state-ego": 0.9283556236940272}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23119697229429292, "sim_physics": 0.0035001635551452637, "survival_time": 0.4, "driven_lanedir": 0.08166532262384874, "sim_render-ego": 0.06485801935195923, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.1577812135219574, "deviation-heading": 0.22951461988336885, "set_robot_commands": 0.08149966597557068, "deviation-center-line": 0.007093610227727502, "driven_lanedir_consec": 0.08166532262384874, "sim_compute_sim_state": 0.04578918218612671, "sim_compute_performance-ego": 0.06944122910499573, "sim_compute_robot_state-ego": 0.08190849423408508}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5707216696146715, "sim_physics": 0.0031714579638312847, "survival_time": 0.8500000000000002, "driven_lanedir": 0.3007930426776575, "sim_render-ego": 0.07036398438846364, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.15067306686850154, "deviation-heading": 0.5188310793819214, "set_robot_commands": 0.08183886023128734, "deviation-center-line": 0.0628032172006529, "driven_lanedir_consec": 0.16865367531833542, "sim_compute_sim_state": 0.04437577023225672, "sim_compute_performance-ego": 0.06416763978845932, "sim_compute_robot_state-ego": 0.08258150605594411}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.37412013163993807, "sim_physics": 0.002990282498873197, "survival_time": 0.65, "driven_lanedir": 0.2667790289000642, "sim_render-ego": 0.06332643215472882, "in-drivable-lane": 0, "agent_compute-ego": 0.15227554394648626, "deviation-heading": 0.3911323074032279, "set_robot_commands": 0.07685694327721229, "deviation-center-line": 0.04135458884199785, "driven_lanedir_consec": 0.2667790289000642, "sim_compute_sim_state": 0.04291604115412785, "sim_compute_performance-ego": 0.06420073142418495, "sim_compute_robot_state-ego": 0.08287910314706656}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2565540492984296, "sim_physics": 0.003465977582064542, "survival_time": 0.5499999999999999, "driven_lanedir": 0.09078945864739783, "sim_render-ego": 0.08152075247331099, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.1476463187824596, "deviation-heading": 0.28263420392485217, "set_robot_commands": 0.07697890021584251, "deviation-center-line": 0.014313687290931076, "driven_lanedir_consec": 0.09078945864739783, "sim_compute_sim_state": 0.04537073048678311, "sim_compute_performance-ego": 0.06742349537936124, "sim_compute_robot_state-ego": 0.08544529568065297}}
set_robot_commands_max0.08183886023128734
set_robot_commands_mean0.07979161141341433
set_robot_commands_median0.08149966597557068
set_robot_commands_min0.07685694327721229
sim_compute_performance-ego_max0.07068286222570083
sim_compute_performance-ego_mean0.0671831915845404
sim_compute_performance-ego_median0.06742349537936124
sim_compute_performance-ego_min0.06416763978845932
sim_compute_robot_state-ego_max0.9283556236940272
sim_compute_robot_state-ego_mean0.2522340045623552
sim_compute_robot_state-ego_median0.08287910314706656
sim_compute_robot_state-ego_min0.08190849423408508
sim_compute_sim_state_max0.04578918218612671
sim_compute_sim_state_mean0.04466822360680947
sim_compute_sim_state_median0.044889393974752986
sim_compute_sim_state_min0.04291604115412785
sim_physics_max0.0035001635551452637
sim_physics_mean0.003295218375718726
sim_physics_median0.003348210278679343
sim_physics_min0.002990282498873197
sim_render-ego_max0.08152075247331099
sim_render-ego_mean0.07045702202140622
sim_render-ego_median0.07036398438846364
sim_render-ego_min0.06332643215472882
simulation-passed1
survival_time_max0.8500000000000002
survival_time_mean0.66
survival_time_min0.4
No reset possible
17118step1-simulationerrorno0:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17117step1-simulationerrorno0:05:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible