Duckietown Challenges Home Challenges Submissions

Submission 2320

Submission2320
Competingyes
Challengeaido2_LF_r2-v4
UserFANG MEIYI 🇸🇬
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 17157
Next
User labelBaseline solution using imitation learning from logs
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17157step1-simulationsuccessyes0:21:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.0826035668552554
survival_time_median14.950000000000076
deviation-center-line_median0.6920665931134927
in-drivable-lane_median6.850000000000027


other stats
agent_compute-ego_max0.15646264712015787
agent_compute-ego_mean0.15561155197881257
agent_compute-ego_median0.1560328801472982
agent_compute-ego_min0.15425692399342855
deviation-center-line_max1.0586552037518449
deviation-center-line_mean0.6774900803488432
deviation-center-line_min0.3342944166982624
deviation-heading_max6.550614116639727
deviation-heading_mean5.949507225407425
deviation-heading_median6.087512518690134
deviation-heading_min4.99008210433508
driven_any_max7.855303311739826
driven_any_mean7.590782657193422
driven_any_median7.781007389280656
driven_any_min6.775283589472317
driven_lanedir_consec_max-1.335664098112718
driven_lanedir_consec_mean-1.961989834906639
driven_lanedir_consec_min-2.2512643920321116
driven_lanedir_max-1.92830923111
driven_lanedir_mean-2.430497363057527
driven_lanedir_median-2.4186745303117068
driven_lanedir_min-3.009344906252766
in-drivable-lane_max7.200000000000035
in-drivable-lane_mean6.750000000000034
in-drivable-lane_min5.950000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 7.817105466874469, "sim_physics": 0.003415334224700928, "survival_time": 14.950000000000076, "driven_lanedir": -3.009344906252766, "sim_render-ego": 0.07013522783915202, "in-drivable-lane": 5.950000000000037, "agent_compute-ego": 0.15646264712015787, "deviation-heading": 6.087512518690134, "set_robot_commands": 0.07891814231872558, "deviation-center-line": 1.0586552037518449, "driven_lanedir_consec": -1.335664098112718, "sim_compute_sim_state": 0.042490349610646565, "sim_compute_performance-ego": 0.06835360129674276, "sim_compute_robot_state-ego": 0.11252054770787558}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 7.781007389280656, "sim_physics": 0.0033200860023498537, "survival_time": 14.950000000000076, "driven_lanedir": -2.4186745303117068, "sim_render-ego": 0.06935591141382853, "in-drivable-lane": 7.05000000000004, "agent_compute-ego": 0.1560328801472982, "deviation-heading": 6.11155171885218, "set_robot_commands": 0.07807398398717244, "deviation-center-line": 0.6920665931134927, "driven_lanedir_consec": -2.2121078864231096, "sim_compute_sim_state": 0.04316132465998332, "sim_compute_performance-ego": 0.06796495993932088, "sim_compute_robot_state-ego": 0.07601108948389688}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 6.775283589472317, "sim_physics": 0.003400994621160376, "survival_time": 13.100000000000051, "driven_lanedir": -1.92830923111, "sim_render-ego": 0.07210369328506121, "in-drivable-lane": 6.850000000000027, "agent_compute-ego": 0.155176434808105, "deviation-heading": 4.99008210433508, "set_robot_commands": 0.07994651794433594, "deviation-center-line": 0.3342944166982624, "driven_lanedir_consec": -1.92830923111, "sim_compute_sim_state": 0.04402116509794279, "sim_compute_performance-ego": 0.06780498628397934, "sim_compute_robot_state-ego": 0.07677944743906269}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 7.855303311739826, "sim_physics": 0.0027716167767842612, "survival_time": 14.950000000000076, "driven_lanedir": -2.501597409963625, "sim_render-ego": 0.06667540709177654, "in-drivable-lane": 6.700000000000033, "agent_compute-ego": 0.15612887382507323, "deviation-heading": 6.550614116639727, "set_robot_commands": 0.07963126579920451, "deviation-center-line": 0.6971230217525723, "driven_lanedir_consec": -2.2512643920321116, "sim_compute_sim_state": 0.04345616340637207, "sim_compute_performance-ego": 0.0650222094853719, "sim_compute_robot_state-ego": 0.0773927354812622}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 7.725213528599846, "sim_physics": 0.0027051464716593425, "survival_time": 14.950000000000076, "driven_lanedir": -2.2945607376495385, "sim_render-ego": 0.06719154357910156, "in-drivable-lane": 7.200000000000035, "agent_compute-ego": 0.15425692399342855, "deviation-heading": 6.007775668520006, "set_robot_commands": 0.07768291076024374, "deviation-center-line": 0.6053111664280433, "driven_lanedir_consec": -2.0826035668552554, "sim_compute_sim_state": 0.043597587744394935, "sim_compute_performance-ego": 0.06550826708475749, "sim_compute_robot_state-ego": 0.07884583314259846}}
set_robot_commands_max0.07994651794433594
set_robot_commands_mean0.07885056416193645
set_robot_commands_median0.07891814231872558
set_robot_commands_min0.07768291076024374
sim_compute_performance-ego_max0.06835360129674276
sim_compute_performance-ego_mean0.06693080481803447
sim_compute_performance-ego_median0.06780498628397934
sim_compute_performance-ego_min0.0650222094853719
sim_compute_robot_state-ego_max0.11252054770787558
sim_compute_robot_state-ego_mean0.08430993065093915
sim_compute_robot_state-ego_median0.0773927354812622
sim_compute_robot_state-ego_min0.07601108948389688
sim_compute_sim_state_max0.04402116509794279
sim_compute_sim_state_mean0.043345318103867936
sim_compute_sim_state_median0.04345616340637207
sim_compute_sim_state_min0.042490349610646565
sim_physics_max0.003415334224700928
sim_physics_mean0.0031226356193309523
sim_physics_median0.0033200860023498537
sim_physics_min0.0027051464716593425
sim_render-ego_max0.07210369328506121
sim_render-ego_mean0.06909235664178398
sim_render-ego_median0.06935591141382853
sim_render-ego_min0.06667540709177654
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.580000000000071
survival_time_min13.100000000000051
No reset possible
17119step1-simulationerrorno0:06:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17116step1-simulationerrorno0:03:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible