Duckietown Challenges Home Challenges Submissions

Job 34921

Job ID34921
submission9679
userBea Baselines 🐤
user labelstraight
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg04-cdd7667d8062-1
date started
date completed
duration0:29:06
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.600415295980429
survival_time_median14.050000000000065
deviation-center-line_median0.48858441008520503
in-drivable-lane_median7.10000000000001


other stats
agent_compute-ego_max0.03780879259109497
agent_compute-ego_mean0.03681147686695397
agent_compute-ego_median0.036749688404127845
agent_compute-ego_min0.035885795599683766
complete-iteration_max0.4432261093457539
complete-iteration_mean0.414506901356153
complete-iteration_median0.4107537058615151
complete-iteration_min0.3953854112981636
deviation-center-line_max0.6289467607006275
deviation-center-line_mean0.4600994128665998
deviation-center-line_min0.30179964180390495
deviation-heading_max2.304159408917883
deviation-heading_mean1.4144108056433355
deviation-heading_median1.416716347207803
deviation-heading_min0.46435470820567976
driven_any_max2.407403600555989
driven_any_mean1.9781117477727463
driven_any_median2.265643781552277
driven_any_min0.9433201151220528
driven_lanedir_consec_max2.39276724961448
driven_lanedir_consec_mean0.9682090906721778
driven_lanedir_consec_min0.3479029848353281
driven_lanedir_max2.39276724961448
driven_lanedir_mean0.9682090906721778
driven_lanedir_median0.600415295980429
driven_lanedir_min0.3479029848353281
get_state_dump_max0.03692585084496475
get_state_dump_mean0.03526888950196054
get_state_dump_median0.03501859449925365
get_state_dump_min0.034700340429941814
get_ui_image_max0.07281955798467
get_ui_image_mean0.07212696862519744
get_ui_image_median0.0721918579900839
get_ui_image_min0.07120643962513316
in-drivable-lane_max10.700000000000076
in-drivable-lane_mean5.665000000000026
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.29945636568878, "get_ui_image": 0.07199218069634787, "step_physics": 0.14770778940945137, "survival_time": 8.199999999999982, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.03692585084496475, "sim_render-ego": 0.009750844501867528, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.03743476257091615, "deviation-heading": 0.656882474004175, "complete-iteration": 0.4112035530369456, "set_robot_commands": 0.007635571607729283, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.020977985568162872, "sim_compute_performance-ego": 0.009145765769772413, "sim_compute_robot_state-ego": 0.011556006059414002, "sim_compute_robot_state-npc0": 0.011698468429286306, "sim_compute_robot_state-npc1": 0.011215316086280637, "sim_compute_robot_state-npc2": 0.011557499083077035, "sim_compute_robot_state-npc3": 0.011517441854244324, "sim_compute_robot_state-parked0": 0.011735831818929532}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.9433201151220528, "get_ui_image": 0.07120643962513316, "step_physics": 0.1552406716937861, "survival_time": 6.0499999999999865, "driven_lanedir": 0.9403789868663692, "get_state_dump": 0.03577213642025782, "sim_render-ego": 0.011594803865290873, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03603883617180438, "deviation-heading": 0.46435470820567976, "complete-iteration": 0.4103038586860846, "set_robot_commands": 0.007496349082505407, "deviation-center-line": 0.48980241394661056, "driven_lanedir_consec": 0.9403789868663692, "sim_compute_sim_state": 0.02016922265044914, "sim_compute_performance-ego": 0.006112017907386969, "sim_compute_robot_state-ego": 0.01143921899401452, "sim_compute_robot_state-npc0": 0.011060358079011776, "sim_compute_robot_state-npc1": 0.0109447664465786, "sim_compute_robot_state-npc2": 0.010817614468661222, "sim_compute_robot_state-npc3": 0.010923813197238386, "sim_compute_robot_state-parked0": 0.01117242663359839}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.387496207289894, "get_ui_image": 0.07152097128533028, "step_physics": 0.17464280370119456, "survival_time": 14.800000000000075, "driven_lanedir": 2.3822953151098836, "get_state_dump": 0.0351831582752434, "sim_render-ego": 0.008742931726816538, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03617096269452894, "deviation-heading": 0.6246959190942224, "complete-iteration": 0.42519293604670344, "set_robot_commands": 0.007294527582220129, "deviation-center-line": 0.5464362396156924, "driven_lanedir_consec": 2.3822953151098836, "sim_compute_sim_state": 0.01892110866469306, "sim_compute_performance-ego": 0.006099623602789802, "sim_compute_robot_state-ego": 0.01122474589863339, "sim_compute_robot_state-npc0": 0.011099831478015796, "sim_compute_robot_state-npc1": 0.010950635413865786, "sim_compute_robot_state-npc2": 0.010901782963726972, "sim_compute_robot_state-npc3": 0.01109308487660176, "sim_compute_robot_state-parked0": 0.011028554793950674}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.3993972968350845, "get_ui_image": 0.07259543817051332, "step_physics": 0.17650650406525994, "survival_time": 14.850000000000076, "driven_lanedir": 2.39276724961448, "get_state_dump": 0.03496350985183459, "sim_render-ego": 0.008536372521911004, "in-drivable-lane": 0.0, "agent_compute-ego": 0.035885795599683766, "deviation-heading": 0.7132262893800697, "complete-iteration": 0.4243728087004588, "set_robot_commands": 0.007011916099574028, "deviation-center-line": 0.6289467607006275, "driven_lanedir_consec": 2.39276724961448, "sim_compute_sim_state": 0.01840522795012503, "sim_compute_performance-ego": 0.006013788358129636, "sim_compute_robot_state-ego": 0.011065811420530584, "sim_compute_robot_state-npc0": 0.010763051935317942, "sim_compute_robot_state-npc1": 0.010497327605481903, "sim_compute_robot_state-npc2": 0.01051436530219184, "sim_compute_robot_state-npc3": 0.010643605029944218, "sim_compute_robot_state-parked0": 0.010653674000441428}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.2507122712214302, "get_ui_image": 0.07150311965668928, "step_physics": 0.1459218823354304, "survival_time": 13.950000000000063, "driven_lanedir": 0.6134250925103875, "get_state_dump": 0.035406429707790364, "sim_render-ego": 0.00892832885933606, "in-drivable-lane": 9.150000000000045, "agent_compute-ego": 0.036420784543492034, "deviation-heading": 2.130804073594577, "complete-iteration": 0.4000062745959101, "set_robot_commands": 0.00724495610883159, "deviation-center-line": 0.5189072793178615, "driven_lanedir_consec": 0.6134250925103875, "sim_compute_sim_state": 0.021166968943824905, "sim_compute_performance-ego": 0.006204575193398315, "sim_compute_robot_state-ego": 0.011380374217973388, "sim_compute_robot_state-npc0": 0.011081922866110306, "sim_compute_robot_state-npc1": 0.010983333792737734, "sim_compute_robot_state-npc2": 0.011201596174616113, "sim_compute_robot_state-npc3": 0.011183938672465662, "sim_compute_robot_state-parked0": 0.01106047886674122}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.2805752918831232, "get_ui_image": 0.07239153528381995, "step_physics": 0.14663124084472656, "survival_time": 14.150000000000066, "driven_lanedir": 0.5675947043573228, "get_state_dump": 0.035071547376814664, "sim_render-ego": 0.00883300144343831, "in-drivable-lane": 9.550000000000049, "agent_compute-ego": 0.036418121189616175, "deviation-heading": 2.1335627884436654, "complete-iteration": 0.3986567305170605, "set_robot_commands": 0.007106095236518779, "deviation-center-line": 0.4873664062237995, "driven_lanedir_consec": 0.5675947043573228, "sim_compute_sim_state": 0.021022572534244388, "sim_compute_performance-ego": 0.00594890328262383, "sim_compute_robot_state-ego": 0.011094600488777296, "sim_compute_robot_state-npc0": 0.010798212496214958, "sim_compute_robot_state-npc1": 0.010808012932012443, "sim_compute_robot_state-npc2": 0.010807525985232512, "sim_compute_robot_state-npc3": 0.01071152164742298, "sim_compute_robot_state-parked0": 0.010692400140391642}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.406139339379617, "get_ui_image": 0.07281955798467, "step_physics": 0.1922006138165792, "survival_time": 14.950000000000076, "driven_lanedir": 0.5869709972457224, "get_state_dump": 0.034700340429941814, "sim_render-ego": 0.008751770655314128, "in-drivable-lane": 10.600000000000076, "agent_compute-ego": 0.03780879259109497, "deviation-heading": 1.493166132952402, "complete-iteration": 0.4432261093457539, "set_robot_commands": 0.007221219539642334, "deviation-center-line": 0.32345508309186644, "driven_lanedir_consec": 0.5869709972457224, "sim_compute_sim_state": 0.0187157146135966, "sim_compute_performance-ego": 0.0059312645594278976, "sim_compute_robot_state-ego": 0.01110102891921997, "sim_compute_robot_state-npc0": 0.010725126266479493, "sim_compute_robot_state-npc1": 0.010700178941090904, "sim_compute_robot_state-npc2": 0.010787945588429769, "sim_compute_robot_state-npc3": 0.010649761358896892, "sim_compute_robot_state-parked0": 0.010796631971995036}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.407403600555989, "get_ui_image": 0.07192259550094604, "step_physics": 0.189967311223348, "survival_time": 14.950000000000076, "driven_lanedir": 0.5874054994504705, "get_state_dump": 0.034908703962961835, "sim_render-ego": 0.008936926523844401, "in-drivable-lane": 10.700000000000076, "agent_compute-ego": 0.037678100268046064, "deviation-heading": 1.340266561463204, "complete-iteration": 0.4412070457140605, "set_robot_commands": 0.007098426024119059, "deviation-center-line": 0.30179964180390495, "driven_lanedir_consec": 0.5874054994504705, "sim_compute_sim_state": 0.01869497776031494, "sim_compute_performance-ego": 0.006049397786458333, "sim_compute_robot_state-ego": 0.011033533414204917, "sim_compute_robot_state-npc0": 0.010937063694000245, "sim_compute_robot_state-npc1": 0.010822733243306478, "sim_compute_robot_state-npc2": 0.0110313614209493, "sim_compute_robot_state-npc3": 0.010918827056884763, "sim_compute_robot_state-parked0": 0.010885659853617353}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.705101879425747, "get_ui_image": 0.07277291400410305, "step_physics": 0.14982038346406457, "survival_time": 10.700000000000015, "driven_lanedir": 0.3479029848353281, "get_state_dump": 0.03479157652810355, "sim_render-ego": 0.008715048014560592, "in-drivable-lane": 7.200000000000009, "agent_compute-ego": 0.03707859226476366, "deviation-heading": 2.304159408917883, "complete-iteration": 0.3953854112981636, "set_robot_commands": 0.006870847996150222, "deviation-center-line": 0.3694589514572386, "driven_lanedir_consec": 0.3479029848353281, "sim_compute_sim_state": 0.01582789532492094, "sim_compute_performance-ego": 0.005933484184407742, "sim_compute_robot_state-ego": 0.010881273545951487, "sim_compute_robot_state-npc0": 0.010350128200566655, "sim_compute_robot_state-npc1": 0.010552151180873407, "sim_compute_robot_state-npc2": 0.01055777407138147, "sim_compute_robot_state-npc3": 0.010476117936250206, "sim_compute_robot_state-parked0": 0.010450865620764615}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.7015151103257478, "get_ui_image": 0.07254493404442156, "step_physics": 0.1493342504814757, "survival_time": 10.650000000000016, "driven_lanedir": 0.3758337411997157, "get_state_dump": 0.03496564162169264, "sim_render-ego": 0.008646769143046348, "in-drivable-lane": 7.000000000000011, "agent_compute-ego": 0.0371800207755935, "deviation-heading": 2.2829897003774757, "complete-iteration": 0.3955142856203894, "set_robot_commands": 0.006932532843289801, "deviation-center-line": 0.3905982479176758, "driven_lanedir_consec": 0.3758337411997157, "sim_compute_sim_state": 0.015790558756796965, "sim_compute_performance-ego": 0.005911115189673195, "sim_compute_robot_state-ego": 0.01066267322486555, "sim_compute_robot_state-npc0": 0.010758805163029772, "sim_compute_robot_state-npc1": 0.010799244535920766, "sim_compute_robot_state-npc2": 0.010502288039301482, "sim_compute_robot_state-npc3": 0.010640564099164076, "sim_compute_robot_state-parked0": 0.01053889144754186}}
set_robot_commands_max0.007635571607729283
set_robot_commands_mean0.007191244212058063
set_robot_commands_median0.007163657388080557
set_robot_commands_min0.006870847996150222
sim_compute_performance-ego_max0.009145765769772413
sim_compute_performance-ego_mean0.006334993583406813
sim_compute_performance-ego_median0.006031593072293985
sim_compute_performance-ego_min0.005911115189673195
sim_compute_robot_state-ego_max0.011556006059414002
sim_compute_robot_state-ego_mean0.011143926618358512
sim_compute_robot_state-ego_median0.011097814703998631
sim_compute_robot_state-ego_min0.01066267322486555
sim_compute_robot_state-npc0_max0.011698468429286306
sim_compute_robot_state-npc0_mean0.010927296860803326
sim_compute_robot_state-npc0_median0.0108676380951076
sim_compute_robot_state-npc0_min0.010350128200566655
sim_compute_robot_state-npc1_max0.011215316086280637
sim_compute_robot_state-npc1_mean0.010827370017814869
sim_compute_robot_state-npc1_median0.01081537308765946
sim_compute_robot_state-npc1_min0.010497327605481903
sim_compute_robot_state-npc2_max0.011557499083077035
sim_compute_robot_state-npc2_mean0.010867975309756773
sim_compute_robot_state-npc2_median0.010812570226946868
sim_compute_robot_state-npc2_min0.010502288039301482
sim_compute_robot_state-npc3_max0.011517441854244324
sim_compute_robot_state-npc3_mean0.010875867572911329
sim_compute_robot_state-npc3_median0.010815174352153872
sim_compute_robot_state-npc3_min0.010476117936250206
sim_compute_robot_state-parked0_max0.011735831818929532
sim_compute_robot_state-parked0_mean0.010901541514797174
sim_compute_robot_state-parked0_median0.010841145912806192
sim_compute_robot_state-parked0_min0.010450865620764615
sim_compute_sim_state_max0.021166968943824905
sim_compute_sim_state_mean0.01896922327671288
sim_compute_sim_state_median0.018818411639144828
sim_compute_sim_state_min0.015790558756796965
sim_render-ego_max0.011594803865290873
sim_render-ego_mean0.00914367972554258
sim_render-ego_median0.00879238604937622
sim_render-ego_min0.008536372521911004
simulation-passed1
step_physics_max0.1922006138165792
step_physics_mean0.1627973451035316
step_physics_median0.15253052757892532
step_physics_min0.1459218823354304
survival_time_max14.950000000000076
survival_time_mean12.325000000000044
survival_time_min6.0499999999999865

Highlights

34921

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.