Duckietown Challenges Home Challenges Submissions

Job 33215

Job ID33215
submission6704
userBea Baselines 🐤
user labelstraight
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:16:26
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5893872065550856
survival_time_median3.999999999999994
deviation-center-line_median0.3405671835636827
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.04301928390156139
agent_compute-ego_mean0.03822534153340209
agent_compute-ego_median0.036977876628123005
agent_compute-ego_min0.03624441330892998
complete-iteration_max0.4726510137319565
complete-iteration_mean0.4449269435540524
complete-iteration_median0.4462159986374383
complete-iteration_min0.4162802403433281
deviation-center-line_max1.204564896286383
deviation-center-line_mean0.46342895834512055
deviation-center-line_min0.2306504788229662
deviation-heading_max1.0666503211617828
deviation-heading_mean0.6841002310548957
deviation-heading_median0.6026148433870786
deviation-heading_min0.5362992461648963
driven_any_max2.4156341932144825
driven_any_mean0.9525504452763264
driven_any_median0.604992967293315
driven_any_min0.2806891286227591
driven_lanedir_consec_max2.40677402316276
driven_lanedir_consec_mean0.9432381449358144
driven_lanedir_consec_min0.27031654540087136
driven_lanedir_max2.40677402316276
driven_lanedir_mean0.9432381449358144
driven_lanedir_median0.5893872065550856
driven_lanedir_min0.27031654540087136
get_state_dump_max0.03853902402131454
get_state_dump_mean0.038123404492911184
get_state_dump_median0.038036264074575735
get_state_dump_min0.03782304016860215
get_ui_image_max0.07547081767262279
get_ui_image_mean0.07283958154726097
get_ui_image_median0.07272219237919422
get_ui_image_min0.07069597746196546
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.8934118820748456, "get_ui_image": 0.07346496789351753, "step_physics": 0.158065592724344, "survival_time": 5.749999999999988, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.03853902402131454, "sim_render-ego": 0.007594419562298319, "in-drivable-lane": 0.0, "agent_compute-ego": 0.036798437781955885, "deviation-heading": 0.656882474004175, "complete-iteration": 0.42019405572310736, "set_robot_commands": 0.006341223094774329, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.029325253030528194, "sim_compute_performance-ego": 0.006162000739056131, "sim_compute_robot_state-ego": 0.010293552149897037, "sim_compute_robot_state-npc0": 0.010918824569038725, "sim_compute_robot_state-npc1": 0.010610279829605766, "sim_compute_robot_state-npc2": 0.010568575237108314, "sim_compute_robot_state-npc3": 0.010643289400183636, "sim_compute_robot_state-parked0": 0.01053122437518576}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.1243354067077638, "get_ui_image": 0.07547081767262279, "step_physics": 0.15517158775062828, "survival_time": 7.149999999999983, "driven_lanedir": 1.1195998711110968, "get_state_dump": 0.03782304016860215, "sim_render-ego": 0.00822760508610652, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03715731547429012, "deviation-heading": 0.6505142251604797, "complete-iteration": 0.4339005963785665, "set_robot_commands": 0.007696436835335685, "deviation-center-line": 0.7211564287113507, "driven_lanedir_consec": 1.1195998711110968, "sim_compute_sim_state": 0.031431651615596315, "sim_compute_performance-ego": 0.007151218561025767, "sim_compute_robot_state-ego": 0.012545355550059072, "sim_compute_robot_state-npc0": 0.012422695026531086, "sim_compute_robot_state-npc1": 0.012101046688906795, "sim_compute_robot_state-npc2": 0.01209567143366887, "sim_compute_robot_state-npc3": 0.012226303140600244, "sim_compute_robot_state-parked0": 0.01204503666270863}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.4128012814861064, "get_ui_image": 0.07496289173762004, "step_physics": 0.17637296438217162, "survival_time": 14.950000000000076, "driven_lanedir": 2.40677402316276, "get_state_dump": 0.03798940340677897, "sim_render-ego": 0.008420841693878174, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0371709926923116, "deviation-heading": 0.5547154616136774, "complete-iteration": 0.457258505821228, "set_robot_commands": 0.008121035893758137, "deviation-center-line": 0.4847719485949659, "driven_lanedir_consec": 2.40677402316276, "sim_compute_sim_state": 0.030805866718292236, "sim_compute_performance-ego": 0.007147540251413981, "sim_compute_robot_state-ego": 0.012978627681732175, "sim_compute_robot_state-npc0": 0.012720514138539632, "sim_compute_robot_state-npc1": 0.012421352863311768, "sim_compute_robot_state-npc2": 0.012665448188781738, "sim_compute_robot_state-npc3": 0.012447310288747153, "sim_compute_robot_state-parked0": 0.012692334651947022}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.4156341932144825, "get_ui_image": 0.07199157079060872, "step_physics": 0.1756389053662618, "survival_time": 14.950000000000076, "driven_lanedir": 2.404472913649839, "get_state_dump": 0.03840459664662679, "sim_render-ego": 0.008120644887288411, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03647266149520874, "deviation-heading": 1.0666503211617828, "complete-iteration": 0.44882164080937703, "set_robot_commands": 0.007843364874521891, "deviation-center-line": 1.204564896286383, "driven_lanedir_consec": 2.404472913649839, "sim_compute_sim_state": 0.030249040126800537, "sim_compute_performance-ego": 0.006820090611775716, "sim_compute_robot_state-ego": 0.012564577261606851, "sim_compute_robot_state-npc0": 0.012200055917104083, "sim_compute_robot_state-npc1": 0.011948754787445068, "sim_compute_robot_state-npc2": 0.012007861137390136, "sim_compute_robot_state-npc3": 0.012151420911153158, "sim_compute_robot_state-parked0": 0.01207829793294271}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.41831076963724223, "get_ui_image": 0.07069597746196546, "step_physics": 0.16073002313312731, "survival_time": 2.849999999999998, "driven_lanedir": 0.4108296893928962, "get_state_dump": 0.038026709305612666, "sim_render-ego": 0.007422836203324168, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03624441330892998, "deviation-heading": 0.5362992461648963, "complete-iteration": 0.4162802403433281, "set_robot_commands": 0.0063934284344054106, "deviation-center-line": 0.3203305456326069, "driven_lanedir_consec": 0.4108296893928962, "sim_compute_sim_state": 0.02820688381529691, "sim_compute_performance-ego": 0.005989175093801398, "sim_compute_robot_state-ego": 0.009904681590565465, "sim_compute_robot_state-npc0": 0.010501552046391, "sim_compute_robot_state-npc1": 0.010320830763432017, "sim_compute_robot_state-npc2": 0.010434548060099283, "sim_compute_robot_state-npc3": 0.01038687270984315, "sim_compute_robot_state-parked0": 0.010703061756334809}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.4639699794262689, "get_ui_image": 0.07301667001512316, "step_physics": 0.16119879768008277, "survival_time": 3.149999999999997, "driven_lanedir": 0.45722302793598546, "get_state_dump": 0.0380458188435388, "sim_render-ego": 0.007890356911553277, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03679212312849741, "deviation-heading": 0.5406113448810147, "complete-iteration": 0.4356044247036889, "set_robot_commands": 0.007717363418094696, "deviation-center-line": 0.36080382149475854, "driven_lanedir_consec": 0.45722302793598546, "sim_compute_sim_state": 0.02968417273627387, "sim_compute_performance-ego": 0.00670450074332101, "sim_compute_robot_state-ego": 0.012703044073922294, "sim_compute_robot_state-npc0": 0.012421055445595392, "sim_compute_robot_state-npc1": 0.011953966958182198, "sim_compute_robot_state-npc2": 0.012228893855261424, "sim_compute_robot_state-npc3": 0.012512021594577365, "sim_compute_robot_state-parked0": 0.012402337694924976}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 0.6050241766780463, "get_ui_image": 0.07131786048412322, "step_physics": 0.20316303074359893, "survival_time": 3.999999999999994, "driven_lanedir": 0.589507844236246, "get_state_dump": 0.0378998190164566, "sim_render-ego": 0.007991483807563782, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03673337996006012, "deviation-heading": 0.8642733412663441, "complete-iteration": 0.4726510137319565, "set_robot_commands": 0.007432419061660767, "deviation-center-line": 0.2576256594799858, "driven_lanedir_consec": 0.589507844236246, "sim_compute_sim_state": 0.03182883560657501, "sim_compute_performance-ego": 0.006588810682296753, "sim_compute_robot_state-ego": 0.01175656020641327, "sim_compute_robot_state-npc0": 0.011574521660804749, "sim_compute_robot_state-npc1": 0.0115471214056015, "sim_compute_robot_state-npc2": 0.011491751670837404, "sim_compute_robot_state-npc3": 0.011389252543449404, "sim_compute_robot_state-parked0": 0.01161060631275177}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.6049617579085835, "get_ui_image": 0.07187071144580841, "step_physics": 0.2049642086029053, "survival_time": 3.999999999999994, "driven_lanedir": 0.5892665688739251, "get_state_dump": 0.037825155258178714, "sim_render-ego": 0.0074654161930084225, "in-drivable-lane": 0.0, "agent_compute-ego": 0.04224919974803924, "deviation-heading": 0.8657135393860103, "complete-iteration": 0.4721269607543946, "set_robot_commands": 0.0062381505966186525, "deviation-center-line": 0.2579568712120166, "driven_lanedir_consec": 0.5892665688739251, "sim_compute_sim_state": 0.03261967897415161, "sim_compute_performance-ego": 0.006286457180976868, "sim_compute_robot_state-ego": 0.01003144383430481, "sim_compute_robot_state-npc0": 0.010540485382080078, "sim_compute_robot_state-npc1": 0.010322678089141843, "sim_compute_robot_state-npc2": 0.01029217839241028, "sim_compute_robot_state-npc3": 0.010505107045173646, "sim_compute_robot_state-parked0": 0.010597482323646544}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.2806891286227591, "get_ui_image": 0.07242771474326529, "step_physics": 0.17709761712609268, "survival_time": 2.0500000000000007, "driven_lanedir": 0.27031654540087136, "get_state_dump": 0.03816599962187976, "sim_render-ego": 0.007858700868560047, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03961560784316645, "deviation-heading": 0.5535604282281631, "complete-iteration": 0.4474342043806867, "set_robot_commands": 0.007517076120143984, "deviation-center-line": 0.2306504788229662, "driven_lanedir_consec": 0.27031654540087136, "sim_compute_sim_state": 0.028346044261281084, "sim_compute_performance-ego": 0.0064293407812351135, "sim_compute_robot_state-ego": 0.011938723122201317, "sim_compute_robot_state-npc0": 0.011718249902492615, "sim_compute_robot_state-npc1": 0.011238237706626334, "sim_compute_robot_state-npc2": 0.01158231060679366, "sim_compute_robot_state-npc3": 0.011641450044585435, "sim_compute_robot_state-parked0": 0.011527840684099896}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.30636587700716567, "get_ui_image": 0.07317663322795522, "step_physics": 0.17947604981335727, "survival_time": 2.2, "driven_lanedir": 0.29687463006242387, "get_state_dump": 0.03851447864012285, "sim_render-ego": 0.007572385397824374, "in-drivable-lane": 0.0, "agent_compute-ego": 0.04301928390156139, "deviation-heading": 0.5517819286824133, "complete-iteration": 0.44499779289419, "set_robot_commands": 0.006598022851076993, "deviation-center-line": 0.2522058286254507, "driven_lanedir_consec": 0.29687463006242387, "sim_compute_sim_state": 0.028507882898504085, "sim_compute_performance-ego": 0.005912786180322821, "sim_compute_robot_state-ego": 0.010006205602125689, "sim_compute_robot_state-npc0": 0.010469106110659512, "sim_compute_robot_state-npc1": 0.01050389896739613, "sim_compute_robot_state-npc2": 0.010362641377882524, "sim_compute_robot_state-npc3": 0.010156452655792236, "sim_compute_robot_state-parked0": 0.01039587909525091}}
set_robot_commands_max0.008121035893758137
set_robot_commands_mean0.007189852118039056
set_robot_commands_median0.007474747590902375
set_robot_commands_min0.0062381505966186525
sim_compute_performance-ego_max0.007151218561025767
sim_compute_performance-ego_mean0.006519192082522556
sim_compute_performance-ego_median0.006509075731765933
sim_compute_performance-ego_min0.005912786180322821
sim_compute_robot_state-ego_max0.012978627681732175
sim_compute_robot_state-ego_mean0.011472277107282798
sim_compute_robot_state-ego_median0.011847641664307292
sim_compute_robot_state-ego_min0.009904681590565465
sim_compute_robot_state-npc0_max0.012720514138539632
sim_compute_robot_state-npc0_mean0.011548706019923688
sim_compute_robot_state-npc0_median0.011646385781648682
sim_compute_robot_state-npc0_min0.010469106110659512
sim_compute_robot_state-npc1_max0.012421352863311768
sim_compute_robot_state-npc1_mean0.011296816805964944
sim_compute_robot_state-npc1_median0.011392679556113918
sim_compute_robot_state-npc1_min0.010320830763432017
sim_compute_robot_state-npc2_max0.012665448188781738
sim_compute_robot_state-npc2_mean0.011372987996023362
sim_compute_robot_state-npc2_median0.011537031138815532
sim_compute_robot_state-npc2_min0.01029217839241028
sim_compute_robot_state-npc3_max0.012512021594577365
sim_compute_robot_state-npc3_mean0.011405948033410544
sim_compute_robot_state-npc3_median0.01151535129401742
sim_compute_robot_state-npc3_min0.010156452655792236
sim_compute_robot_state-parked0_max0.012692334651947022
sim_compute_robot_state-parked0_mean0.011458410148979303
sim_compute_robot_state-parked0_median0.011569223498425832
sim_compute_robot_state-parked0_min0.01039587909525091
sim_compute_sim_state_max0.03261967897415161
sim_compute_sim_state_mean0.030100530978329987
sim_compute_sim_state_median0.0299666064315372
sim_compute_sim_state_min0.02820688381529691
sim_render-ego_max0.008420841693878174
sim_render-ego_mean0.00785646906114055
sim_render-ego_median0.007874528890056662
sim_render-ego_min0.007422836203324168
simulation-passed1
step_physics_max0.2049642086029053
step_physics_mean0.175187877732257
step_physics_median0.17600593487421673
step_physics_min0.15517158775062828
survival_time_max14.950000000000076
survival_time_mean6.105000000000011
survival_time_min2.0500000000000007

Highlights

33215

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.