Duckietown Challenges Home Challenges Submissions

Job 34395

Job ID34395
submission9193
userBea Baselines 🐤
user labeltemplate-random
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg08-fd2514711e93-1
date started
date completed
duration0:29:03
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7282213398076968
survival_time_median9.725000000000003
deviation-center-line_median0.4048688467217387
in-drivable-lane_median2.649999999999993


other stats
agent_compute-ego_max0.0640950176001942
agent_compute-ego_mean0.058897230822230605
agent_compute-ego_median0.05872464376083319
agent_compute-ego_min0.05231039313709035
complete-iteration_max0.5415153697780941
complete-iteration_mean0.5036875542526145
complete-iteration_median0.49904978747461354
complete-iteration_min0.4850730419158936
deviation-center-line_max1.3577260570052998
deviation-center-line_mean0.5140876093112465
deviation-center-line_min0.0808645438106506
deviation-heading_max4.720467139433653
deviation-heading_mean1.9429100066744431
deviation-heading_median1.5871091791035978
deviation-heading_min0.7487117300841261
driven_any_max1.9395273204227776
driven_any_mean1.2917963118311395
driven_any_median1.246137565521821
driven_any_min0.32668651559123163
driven_lanedir_consec_max1.2765990337546176
driven_lanedir_consec_mean0.7143001105281791
driven_lanedir_consec_min0.17223745777569557
driven_lanedir_max1.2765990337546176
driven_lanedir_mean0.7143001105281791
driven_lanedir_median0.7282213398076968
driven_lanedir_min0.17223745777569557
get_state_dump_max0.03547819932301839
get_state_dump_mean0.034825123858722995
get_state_dump_median0.03475650379222878
get_state_dump_min0.034643369879426254
get_ui_image_max0.09081536180832808
get_ui_image_mean0.08685752664072101
get_ui_image_median0.08673148638096409
get_ui_image_min0.0853143477624701
in-drivable-lane_max9.30000000000009
in-drivable-lane_mean3.660000000000024
in-drivable-lane_min0.4000000000000057
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.400037977366002, "get_ui_image": 0.09081536180832808, "step_physics": 0.21645250039942124, "survival_time": 3.399999999999996, "driven_lanedir": 0.2459498723986755, "get_state_dump": 0.03480492619907155, "sim_render-ego": 0.007363273816950181, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.05231039313709035, "deviation-heading": 1.0359230292961192, "complete-iteration": 0.4975382335045758, "set_robot_commands": 0.006489329478319953, "deviation-center-line": 0.0808645438106506, "driven_lanedir_consec": 0.2459498723986755, "sim_compute_sim_state": 0.0226670643862556, "sim_compute_performance-ego": 0.005875240353976979, "sim_compute_robot_state-ego": 0.009916905094595516, "sim_compute_robot_state-npc0": 0.010227000012117274, "sim_compute_robot_state-npc1": 0.009974984561695772, "sim_compute_robot_state-npc2": 0.009994766291450052, "sim_compute_robot_state-npc3": 0.010222371886758244, "sim_compute_robot_state-parked0": 0.0100860876195571}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.32668651559123163, "get_ui_image": 0.08552644082478114, "step_physics": 0.20720964244433812, "survival_time": 2.799999999999998, "driven_lanedir": 0.17223745777569557, "get_state_dump": 0.03468787244388035, "sim_render-ego": 0.00712236762046814, "in-drivable-lane": 0.4999999999999998, "agent_compute-ego": 0.05567587699208941, "deviation-heading": 1.619385255895981, "complete-iteration": 0.4890846993241991, "set_robot_commands": 0.007000599588666644, "deviation-center-line": 0.21898431613360175, "driven_lanedir_consec": 0.17223745777569557, "sim_compute_sim_state": 0.022029880966459, "sim_compute_performance-ego": 0.006215431860515049, "sim_compute_robot_state-ego": 0.010683698313576837, "sim_compute_robot_state-npc0": 0.01103079319000244, "sim_compute_robot_state-npc1": 0.010411326374326431, "sim_compute_robot_state-npc2": 0.010066373007638114, "sim_compute_robot_state-npc3": 0.010917442185538155, "sim_compute_robot_state-parked0": 0.01019577043397086}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.1764412972845335, "get_ui_image": 0.08677811078403307, "step_physics": 0.259735195533089, "survival_time": 9.199999999999996, "driven_lanedir": 0.9681135616778308, "get_state_dump": 0.03472343605497609, "sim_render-ego": 0.0074636767739834995, "in-drivable-lane": 1.0000000000000029, "agent_compute-ego": 0.05766214365544527, "deviation-heading": 1.5548331023112147, "complete-iteration": 0.5415153697780941, "set_robot_commands": 0.00670957176581673, "deviation-center-line": 0.4169512104391275, "driven_lanedir_consec": 0.9681135616778308, "sim_compute_sim_state": 0.019089675467947258, "sim_compute_performance-ego": 0.006095080272011135, "sim_compute_robot_state-ego": 0.010525652895803038, "sim_compute_robot_state-npc0": 0.010415025379346764, "sim_compute_robot_state-npc1": 0.010813825804254284, "sim_compute_robot_state-npc2": 0.010403266419535095, "sim_compute_robot_state-npc3": 0.010167593541352646, "sim_compute_robot_state-parked0": 0.010605536077333532}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.8112748583634708, "get_ui_image": 0.0853143477624701, "step_physics": 0.24688189898350443, "survival_time": 6.449999999999985, "driven_lanedir": 0.5851328070797837, "get_state_dump": 0.03479495344235915, "sim_render-ego": 0.00746787241262983, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.05713911019554434, "deviation-heading": 0.7487117300841261, "complete-iteration": 0.5263194575790286, "set_robot_commands": 0.006452288738516874, "deviation-center-line": 0.21713542153212145, "driven_lanedir_consec": 0.5851328070797837, "sim_compute_sim_state": 0.01834285721298336, "sim_compute_performance-ego": 0.006144813788953677, "sim_compute_robot_state-ego": 0.01073386133179184, "sim_compute_robot_state-npc0": 0.010694524114446125, "sim_compute_robot_state-npc1": 0.01058927062869996, "sim_compute_robot_state-npc2": 0.010619486949240515, "sim_compute_robot_state-npc3": 0.01064357646675997, "sim_compute_robot_state-parked0": 0.010059327118156491}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.9392460017812905, "get_ui_image": 0.0866848619778951, "step_physics": 0.20238865772883097, "survival_time": 14.950000000000076, "driven_lanedir": 0.7405826473527495, "get_state_dump": 0.034656747976938886, "sim_render-ego": 0.007224572499593099, "in-drivable-lane": 6.950000000000057, "agent_compute-ego": 0.05729456265767415, "deviation-heading": 4.720467139433653, "complete-iteration": 0.48684047142664594, "set_robot_commands": 0.00676289161046346, "deviation-center-line": 0.7217184492819888, "driven_lanedir_consec": 0.7405826473527495, "sim_compute_sim_state": 0.02251267194747925, "sim_compute_performance-ego": 0.005969358285268148, "sim_compute_robot_state-ego": 0.010536952018737791, "sim_compute_robot_state-npc0": 0.010469058354695636, "sim_compute_robot_state-npc1": 0.010635145505269368, "sim_compute_robot_state-npc2": 0.010568819840749104, "sim_compute_robot_state-npc3": 0.010469598770141602, "sim_compute_robot_state-parked0": 0.010355862776438397}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.3158338337591085, "get_ui_image": 0.0863384130524426, "step_physics": 0.22632389650112245, "survival_time": 10.25000000000001, "driven_lanedir": 0.770809166387211, "get_state_dump": 0.03478957152948147, "sim_render-ego": 0.007655684540911418, "in-drivable-lane": 3.8499999999999903, "agent_compute-ego": 0.06095107473978182, "deviation-heading": 0.9257395614074484, "complete-iteration": 0.5120430888199224, "set_robot_commands": 0.006585089753313763, "deviation-center-line": 0.8832277362961596, "driven_lanedir_consec": 0.770809166387211, "sim_compute_sim_state": 0.019818732796645745, "sim_compute_performance-ego": 0.006172166219571742, "sim_compute_robot_state-ego": 0.010611819057929808, "sim_compute_robot_state-npc0": 0.010519123077392578, "sim_compute_robot_state-npc1": 0.010551617785197932, "sim_compute_robot_state-npc2": 0.01036932061358196, "sim_compute_robot_state-npc3": 0.01047592744594667, "sim_compute_robot_state-parked0": 0.01056675910949707}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.9395273204227776, "get_ui_image": 0.08687515258789062, "step_physics": 0.21757961908976237, "survival_time": 14.950000000000076, "driven_lanedir": 0.715860032262644, "get_state_dump": 0.03499216318130493, "sim_render-ego": 0.0076763200759887695, "in-drivable-lane": 8.400000000000075, "agent_compute-ego": 0.05978714386622111, "deviation-heading": 2.2967172570058136, "complete-iteration": 0.5005613414446513, "set_robot_commands": 0.00658080259958903, "deviation-center-line": 0.35462170013874406, "driven_lanedir_consec": 0.715860032262644, "sim_compute_sim_state": 0.01828390041987101, "sim_compute_performance-ego": 0.006060471534729004, "sim_compute_robot_state-ego": 0.010386111736297608, "sim_compute_robot_state-npc0": 0.010605437755584717, "sim_compute_robot_state-npc1": 0.010154799620310464, "sim_compute_robot_state-npc2": 0.010321552753448489, "sim_compute_robot_state-npc3": 0.010426604747772216, "sim_compute_robot_state-parked0": 0.010525299708048502}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.939470284220329, "get_ui_image": 0.08810405890146891, "step_physics": 0.21626540819803872, "survival_time": 14.950000000000076, "driven_lanedir": 0.6369446690473461, "get_state_dump": 0.03467999855677287, "sim_render-ego": 0.007442301909128825, "in-drivable-lane": 9.30000000000009, "agent_compute-ego": 0.06230173110961914, "deviation-heading": 1.7369005322315267, "complete-iteration": 0.5012871201833089, "set_robot_commands": 0.006386544704437256, "deviation-center-line": 0.3927864830043499, "driven_lanedir_consec": 0.6369446690473461, "sim_compute_sim_state": 0.017956754366556804, "sim_compute_performance-ego": 0.006175916989644368, "sim_compute_robot_state-ego": 0.010327541828155515, "sim_compute_robot_state-npc0": 0.01023882786432902, "sim_compute_robot_state-npc1": 0.010244682629903155, "sim_compute_robot_state-npc2": 0.010397433439890543, "sim_compute_robot_state-npc3": 0.010308192571004232, "sim_compute_robot_state-parked0": 0.010163089434305828}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.129974219735419, "get_ui_image": 0.08680143059983765, "step_physics": 0.21062362934909973, "survival_time": 8.84999999999999, "driven_lanedir": 1.0307718575452371, "get_state_dump": 0.034643369879426254, "sim_render-ego": 0.007496105075556006, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.0640950176001942, "deviation-heading": 1.5209864804603754, "complete-iteration": 0.49661271854982536, "set_robot_commands": 0.0065642857955674, "deviation-center-line": 0.4968601754704223, "driven_lanedir_consec": 1.0307718575452371, "sim_compute_sim_state": 0.017908587967608608, "sim_compute_performance-ego": 0.006303740086528541, "sim_compute_robot_state-ego": 0.010893396065060028, "sim_compute_robot_state-npc0": 0.01035552240360928, "sim_compute_robot_state-npc1": 0.010040912251014496, "sim_compute_robot_state-npc2": 0.010247606342121704, "sim_compute_robot_state-npc3": 0.010084864783421748, "sim_compute_robot_state-parked0": 0.010253553336623023}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.939470809787231, "get_ui_image": 0.08533708810806274, "step_physics": 0.20212416092554727, "survival_time": 14.950000000000076, "driven_lanedir": 1.2765990337546176, "get_state_dump": 0.03547819932301839, "sim_render-ego": 0.007607033252716064, "in-drivable-lane": 4.000000000000031, "agent_compute-ego": 0.06175525426864624, "deviation-heading": 3.2694359786181733, "complete-iteration": 0.4850730419158936, "set_robot_commands": 0.006593924363454183, "deviation-center-line": 1.3577260570052998, "driven_lanedir_consec": 1.2765990337546176, "sim_compute_sim_state": 0.01705563465754191, "sim_compute_performance-ego": 0.006141380469004313, "sim_compute_robot_state-ego": 0.010878721872965494, "sim_compute_robot_state-npc0": 0.010457600752512614, "sim_compute_robot_state-npc1": 0.010405405362447105, "sim_compute_robot_state-npc2": 0.010274372895558674, "sim_compute_robot_state-npc3": 0.010254925886789956, "sim_compute_robot_state-parked0": 0.010398223400115966}}
set_robot_commands_max0.007000599588666644
set_robot_commands_mean0.0066125328398145295
set_robot_commands_median0.006582946176451396
set_robot_commands_min0.006386544704437256
sim_compute_performance-ego_max0.006303740086528541
sim_compute_performance-ego_mean0.0061153599860202966
sim_compute_performance-ego_median0.006143097128978995
sim_compute_performance-ego_min0.005875240353976979
sim_compute_robot_state-ego_max0.010893396065060028
sim_compute_robot_state-ego_mean0.010549466021491347
sim_compute_robot_state-ego_median0.0105743855383338
sim_compute_robot_state-ego_min0.009916905094595516
sim_compute_robot_state-npc0_max0.01103079319000244
sim_compute_robot_state-npc0_mean0.010501291290403643
sim_compute_robot_state-npc0_median0.010463329553604125
sim_compute_robot_state-npc0_min0.010227000012117274
sim_compute_robot_state-npc1_max0.010813825804254284
sim_compute_robot_state-npc1_mean0.010382197052311895
sim_compute_robot_state-npc1_median0.010408365868386768
sim_compute_robot_state-npc1_min0.009974984561695772
sim_compute_robot_state-npc2_max0.010619486949240515
sim_compute_robot_state-npc2_mean0.010326299855321424
sim_compute_robot_state-npc2_median0.010345436683515225
sim_compute_robot_state-npc2_min0.009994766291450052
sim_compute_robot_state-npc3_max0.010917442185538155
sim_compute_robot_state-npc3_mean0.010397109828548544
sim_compute_robot_state-npc3_median0.010367398659388224
sim_compute_robot_state-npc3_min0.010084864783421748
sim_compute_robot_state-parked0_max0.010605536077333532
sim_compute_robot_state-parked0_mean0.010320950901404675
sim_compute_robot_state-parked0_median0.01030470805653071
sim_compute_robot_state-parked0_min0.010059327118156491
sim_compute_sim_state_max0.0226670643862556
sim_compute_sim_state_mean0.019566576018934856
sim_compute_sim_state_median0.018716266340465307
sim_compute_sim_state_min0.01705563465754191
sim_render-ego_max0.0076763200759887695
sim_render-ego_mean0.007451920797792584
sim_render-ego_median0.007465774593306665
sim_render-ego_min0.00712236762046814
simulation-passed1
step_physics_max0.259735195533089
step_physics_mean0.2205584609152754
step_physics_median0.21635895429873
step_physics_min0.20212416092554727
survival_time_max14.950000000000076
survival_time_mean10.075000000000028
survival_time_min2.799999999999998

Highlights

34395

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.