Duckietown Challenges Home Challenges Submissions

Submission 12575

Submission12575
Competingyes
Challengeaido5-LFVI-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 53443
Next
User labelstraight
Admin priority50
Blessingn/a
User priority50

53443

Click the images to see detailed statistics about the episode.

LFVI-norm-4way-000

LFVI-norm-udem1-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53443LFVIv-simsuccessyes0:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3121389743413916
survival_time_median2.9749999999999974
deviation-center-line_median0.3708299295495237
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.009934302532311642
agent_compute-ego0_mean0.009893696235887931
agent_compute-ego0_median0.009893696235887931
agent_compute-ego0_min0.009853089939464222
agent_compute-npc0_max0.04522208733992143
agent_compute-npc0_mean0.03813902031291615
agent_compute-npc0_median0.03813902031291615
agent_compute-npc0_min0.031055953285910865
agent_compute-npc1_max0.043671308141766174
agent_compute-npc1_mean0.037056512904889656
agent_compute-npc1_median0.037056512904889656
agent_compute-npc1_min0.030441717668013134
agent_compute-npc2_max0.04205731912092729
agent_compute-npc2_mean0.03583001873709939
agent_compute-npc2_median0.03583001873709939
agent_compute-npc2_min0.029602718353271485
complete-iteration_max0.954458793004354
complete-iteration_mean0.8330117341243859
complete-iteration_median0.8330117341243859
complete-iteration_min0.711564675244418
deviation-center-line_max0.4067644541949731
deviation-center-line_mean0.3708299295495237
deviation-center-line_min0.3348954049040742
deviation-heading_max0.6552731497775627
deviation-heading_mean0.6259200342264
deviation-heading_median0.6259200342264
deviation-heading_min0.5965669186752373
driven_any_max0.3648071915562534
driven_any_mean0.31928124241480316
driven_any_median0.31928124241480316
driven_any_min0.27375529327335296
driven_lanedir_consec_max0.3585211616210844
driven_lanedir_consec_mean0.3121389743413916
driven_lanedir_consec_min0.2657567870616988
driven_lanedir_max0.3585211616210844
driven_lanedir_mean0.3121389743413916
driven_lanedir_median0.3121389743413916
driven_lanedir_min0.2657567870616988
get_duckie_state_max1.534548672762784e-06
get_duckie_state_mean1.5186541008226798e-06
get_duckie_state_median1.5186541008226798e-06
get_duckie_state_min1.5027595288825757e-06
get_robot_state_max0.014045747843655672
get_robot_state_mean0.013891962441531094
get_robot_state_median0.013891962441531094
get_robot_state_min0.013738177039406515
get_state_dump_max0.009270126169378109
get_state_dump_mean0.009256471287120472
get_state_dump_median0.009256471287120472
get_state_dump_min0.009242816404862835
get_ui_image_max0.04974736733870073
get_ui_image_mean0.04831520969217474
get_ui_image_median0.04831520969217474
get_ui_image_min0.04688305204564875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.27375529327335296, "get_ui_image": 0.04974736733870073, "step_physics": 0.4676500753922896, "survival_time": 2.6999999999999984, "driven_lanedir": 0.2657567870616988, "get_state_dump": 0.009242816404862835, "get_robot_state": 0.013738177039406515, "sim_render-ego0": 0.003669669411399148, "sim_render-npc0": 0.003505377335981889, "sim_render-npc1": 0.0036240881139581855, "sim_render-npc2": 0.003731480511752042, "get_duckie_state": 1.534548672762784e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.6552731497775627, "agent_compute-ego0": 0.009853089939464222, "agent_compute-npc0": 0.031055953285910865, "agent_compute-npc1": 0.030441717668013134, "agent_compute-npc2": 0.029602718353271485, "complete-iteration": 0.711564675244418, "set_robot_commands": 0.0023591345006769354, "deviation-center-line": 0.3348954049040742, "driven_lanedir_consec": 0.2657567870616988, "sim_compute_sim_state": 0.038891753283413974, "sim_compute_performance-ego0": 0.002006920901211826, "sim_compute_performance-npc0": 0.0017809044231068005, "sim_compute_performance-npc1": 0.001988163861361417, "sim_compute_performance-npc2": 0.001987791061401367}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.3648071915562534, "get_ui_image": 0.04688305204564875, "step_physics": 0.6743904713428381, "survival_time": 3.2499999999999964, "driven_lanedir": 0.3585211616210844, "get_state_dump": 0.009270126169378109, "get_robot_state": 0.014045747843655672, "sim_render-ego0": 0.00370214202187278, "sim_render-npc0": 0.0035845330267241507, "sim_render-npc1": 0.0037272518331354313, "sim_render-npc2": 0.003730965383125074, "get_duckie_state": 1.5027595288825757e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.5965669186752373, "agent_compute-ego0": 0.009934302532311642, "agent_compute-npc0": 0.04522208733992143, "agent_compute-npc1": 0.043671308141766174, "agent_compute-npc2": 0.04205731912092729, "complete-iteration": 0.954458793004354, "set_robot_commands": 0.00216649156628233, "deviation-center-line": 0.4067644541949731, "driven_lanedir_consec": 0.3585211616210844, "sim_compute_sim_state": 0.03758673234419389, "sim_compute_performance-ego0": 0.002070383592085405, "sim_compute_performance-npc0": 0.0017839670181274414, "sim_compute_performance-npc1": 0.0019075256405454693, "sim_compute_performance-npc2": 0.0019570336197361803}}
set_robot_commands_max0.0023591345006769354
set_robot_commands_mean0.002262813033479633
set_robot_commands_median0.002262813033479633
set_robot_commands_min0.00216649156628233
sim_compute_performance-ego0_max0.002070383592085405
sim_compute_performance-ego0_mean0.002038652246648615
sim_compute_performance-ego0_median0.002038652246648615
sim_compute_performance-ego0_min0.002006920901211826
sim_compute_performance-npc0_max0.0017839670181274414
sim_compute_performance-npc0_mean0.0017824357206171208
sim_compute_performance-npc0_median0.0017824357206171208
sim_compute_performance-npc0_min0.0017809044231068005
sim_compute_performance-npc1_max0.001988163861361417
sim_compute_performance-npc1_mean0.001947844750953443
sim_compute_performance-npc1_median0.001947844750953443
sim_compute_performance-npc1_min0.0019075256405454693
sim_compute_performance-npc2_max0.001987791061401367
sim_compute_performance-npc2_mean0.0019724123405687735
sim_compute_performance-npc2_median0.0019724123405687735
sim_compute_performance-npc2_min0.0019570336197361803
sim_compute_sim_state_max0.038891753283413974
sim_compute_sim_state_mean0.038239242813803934
sim_compute_sim_state_median0.038239242813803934
sim_compute_sim_state_min0.03758673234419389
sim_render-ego0_max0.00370214202187278
sim_render-ego0_mean0.003685905716635964
sim_render-ego0_median0.003685905716635964
sim_render-ego0_min0.003669669411399148
sim_render-npc0_max0.0035845330267241507
sim_render-npc0_mean0.00354495518135302
sim_render-npc0_median0.00354495518135302
sim_render-npc0_min0.003505377335981889
sim_render-npc1_max0.0037272518331354313
sim_render-npc1_mean0.0036756699735468086
sim_render-npc1_median0.0036756699735468086
sim_render-npc1_min0.0036240881139581855
sim_render-npc2_max0.003731480511752042
sim_render-npc2_mean0.003731222947438558
sim_render-npc2_median0.003731222947438558
sim_render-npc2_min0.003730965383125074
simulation-passed1
step_physics_max0.6743904713428381
step_physics_mean0.5710202733675639
step_physics_median0.5710202733675639
step_physics_min0.4676500753922896
survival_time_max3.2499999999999964
survival_time_mean2.9749999999999974
survival_time_min2.6999999999999984
No reset possible
53390LFVIv-simabortedno0:19:29
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53335LFVIv-simabortedno0:09:22
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible