Duckietown Challenges Home Challenges Submissions

Evaluator 536

ID536
evaluatoridsc-rudolf-14710
ownerAndrea CensiΒ πŸ‡¨πŸ‡­
machineidsc-rudolf
processidsc-rudolf-14710
versiond-c:4.0.7;d-c-r:4.0.9;d-s:4.0.10
first heard
last heard
statusinactive
# evaluating
# success5 17126
# timeout
# failed
# error9 17116
# aborted1 17161
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
171932328Konstantin ChaikaMinimal agentaido2_LFV_r1-v4step1-simulationsuccessyesidsc-rudolf-147100:11:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.15795698620024182
agent_compute-ego_mean0.15102817429671306
agent_compute-ego_median0.1501464476952186
agent_compute-ego_min0.14647515731699326
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003071048680473777, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.05848222970962525, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14647515731699326, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07566538628409891, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.032386783291311824, "sim_compute_performance-ego": 0.057791457456700945, "sim_compute_robot_state-ego": 0.24746328592300415, "sim_compute_robot_state-npc0": 0.07140189759871539, "sim_compute_robot_state-npc1": 0.061660461566027475, "sim_compute_robot_state-npc2": 0.05880205420886769, "sim_compute_robot_state-npc3": 0.05908383692012114}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.003188549526154049, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.061942108093746125, "in-drivable-lane": 0, "agent_compute-ego": 0.15795698620024182, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07723188400268555, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.03231135247245667, "sim_compute_performance-ego": 0.06035579196990482, "sim_compute_robot_state-ego": 0.07719072841462635, "sim_compute_robot_state-npc0": 0.07427268936520531, "sim_compute_robot_state-npc1": 0.0647933975098625, "sim_compute_robot_state-npc2": 0.06244606820363847, "sim_compute_robot_state-npc3": 0.06088092213585263}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.003089303236741286, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.059612362201397234, "in-drivable-lane": 0, "agent_compute-ego": 0.1501464476952186, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07637227865365835, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.0337443315065824, "sim_compute_performance-ego": 0.06052375206580529, "sim_compute_robot_state-ego": 0.07541304735036997, "sim_compute_robot_state-npc0": 0.0707864834712102, "sim_compute_robot_state-npc1": 0.06323108673095704, "sim_compute_robot_state-npc2": 0.06075441653911884, "sim_compute_robot_state-npc3": 0.06142604534442608}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003121794723882908, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.05836812461294779, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14900673017269228, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07764499071167737, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.03262964399849496, "sim_compute_performance-ego": 0.05995242479370862, "sim_compute_robot_state-ego": 0.0757583234368301, "sim_compute_robot_state-npc0": 0.07022844000560481, "sim_compute_robot_state-npc1": 0.06183791160583496, "sim_compute_robot_state-npc2": 0.06046853705150325, "sim_compute_robot_state-npc3": 0.060115244330429446}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0029378366470336915, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.05921672344207764, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1515555500984192, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07852548599243164, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.03203061580657959, "sim_compute_performance-ego": 0.059820151329040526, "sim_compute_robot_state-ego": 0.07467261075973511, "sim_compute_robot_state-npc0": 0.07048568725585938, "sim_compute_robot_state-npc1": 0.06404245376586915, "sim_compute_robot_state-npc2": 0.05966479301452637, "sim_compute_robot_state-npc3": 0.05932865619659424}}
set_robot_commands_max0.07852548599243164
set_robot_commands_mean0.07708800512891037
set_robot_commands_median0.07723188400268555
set_robot_commands_min0.07566538628409891
sim_compute_performance-ego_max0.06052375206580529
sim_compute_performance-ego_mean0.05968871552303203
sim_compute_performance-ego_median0.05995242479370862
sim_compute_performance-ego_min0.057791457456700945
sim_compute_robot_state-ego_max0.24746328592300415
sim_compute_robot_state-ego_mean0.11009959917691314
sim_compute_robot_state-ego_median0.0757583234368301
sim_compute_robot_state-ego_min0.07467261075973511
sim_compute_robot_state-npc0_max0.07427268936520531
sim_compute_robot_state-npc0_mean0.07143503953931903
sim_compute_robot_state-npc0_median0.0707864834712102
sim_compute_robot_state-npc0_min0.07022844000560481
sim_compute_robot_state-npc1_max0.0647933975098625
sim_compute_robot_state-npc1_mean0.06311306223571023
sim_compute_robot_state-npc1_median0.06323108673095704
sim_compute_robot_state-npc1_min0.061660461566027475
sim_compute_robot_state-npc2_max0.06244606820363847
sim_compute_robot_state-npc2_mean0.06042717380353092
sim_compute_robot_state-npc2_median0.06046853705150325
sim_compute_robot_state-npc2_min0.05880205420886769
sim_compute_robot_state-npc3_max0.06142604534442608
sim_compute_robot_state-npc3_mean0.06016694098548471
sim_compute_robot_state-npc3_median0.060115244330429446
sim_compute_robot_state-npc3_min0.05908383692012114
sim_compute_sim_state_max0.0337443315065824
sim_compute_sim_state_mean0.03262054541508509
sim_compute_sim_state_median0.032386783291311824
sim_compute_sim_state_min0.03203061580657959
sim_physics_max0.003188549526154049
sim_physics_mean0.003081706562857142
sim_physics_median0.003089303236741286
sim_physics_min0.0029378366470336915
sim_render-ego_max0.061942108093746125
sim_render-ego_mean0.0595243096119588
sim_render-ego_median0.05921672344207764
sim_render-ego_min0.05836812461294779
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171892251Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-147100:00:38
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171872259Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-147100:00:48
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171842260Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-147100:00:37
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171792274Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-147100:07:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.15802546826804556
agent_compute-ego_mean0.15400796075210005
agent_compute-ego_median0.15507365740262546
agent_compute-ego_min0.15029484272003174
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0035273082116070915, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07074875340742223, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15510188130771413, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07960655408747055, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.043531954288482666, "sim_compute_performance-ego": 0.06995923378888298, "sim_compute_robot_state-ego": 0.2672942701508017}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0033820394485715834, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07048966392638191, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.1515439540620834, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07791074117024739, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04336022952246287, "sim_compute_performance-ego": 0.06992990251571413, "sim_compute_robot_state-ego": 0.07747689126029847}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.003409741475031926, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07316273909348708, "in-drivable-lane": 0, "agent_compute-ego": 0.15507365740262546, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07968624921945425, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04469312887925368, "sim_compute_performance-ego": 0.07166186112623948, "sim_compute_robot_state-ego": 0.08088872982905461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003636935862099252, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07109042493308462, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15802546826804556, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07895466467229331, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.043736719503635314, "sim_compute_performance-ego": 0.07222929524212349, "sim_compute_robot_state-ego": 0.08159367340367014}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003357553482055664, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.0714106273651123, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15029484272003174, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.0775247859954834, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04196627140045166, "sim_compute_performance-ego": 0.06776957035064697, "sim_compute_robot_state-ego": 0.07649435043334961}}
set_robot_commands_max0.07968624921945425
set_robot_commands_mean0.07873659902898979
set_robot_commands_median0.07895466467229331
set_robot_commands_min0.0775247859954834
sim_compute_performance-ego_max0.07222929524212349
sim_compute_performance-ego_mean0.07030997260472141
sim_compute_performance-ego_median0.06995923378888298
sim_compute_performance-ego_min0.06776957035064697
sim_compute_robot_state-ego_max0.2672942701508017
sim_compute_robot_state-ego_mean0.11674958301543492
sim_compute_robot_state-ego_median0.08088872982905461
sim_compute_robot_state-ego_min0.07649435043334961
sim_compute_sim_state_max0.04469312887925368
sim_compute_sim_state_mean0.04345766071885724
sim_compute_sim_state_median0.043531954288482666
sim_compute_sim_state_min0.04196627140045166
sim_physics_max0.003636935862099252
sim_physics_mean0.003462715695873104
sim_physics_median0.003409741475031926
sim_physics_min0.003357553482055664
sim_render-ego_max0.07316273909348708
sim_render-ego_mean0.07138044174509764
sim_render-ego_median0.07109042493308462
sim_render-ego_min0.07048966392638191
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171732287Andrea CensiΒ πŸ‡¨πŸ‡­Minimal agentaido2_LFV_r1-v4step1-simulationsuccessyesidsc-rudolf-147100:12:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.1636971973237537
agent_compute-ego_mean0.15843592058021802
agent_compute-ego_median0.1579430543459379
agent_compute-ego_min0.15373497500139124
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003246808753294103, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07113661836175357, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15373497500139124, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07629096508026123, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.03857779152253095, "sim_compute_performance-ego": 0.06616872549057007, "sim_compute_robot_state-ego": 0.2596869714119855, "sim_compute_robot_state-npc0": 0.07560201252208036, "sim_compute_robot_state-npc1": 0.06906621596392463, "sim_compute_robot_state-npc2": 0.06800340203677907, "sim_compute_robot_state-npc3": 0.06700613919426412}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0035517367105635388, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.07077924788944305, "in-drivable-lane": 0, "agent_compute-ego": 0.1636971973237537, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.0791312020922464, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.04094453085036505, "sim_compute_performance-ego": 0.0694576482924204, "sim_compute_robot_state-ego": 0.08746650862315344, "sim_compute_robot_state-npc0": 0.07449008926512703, "sim_compute_robot_state-npc1": 0.07143374851771764, "sim_compute_robot_state-npc2": 0.06991424257793123, "sim_compute_robot_state-npc3": 0.07114928109305245}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0035014702723576473, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.07386067463801457, "in-drivable-lane": 0, "agent_compute-ego": 0.1579430543459379, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07788833471444936, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.04143975698030912, "sim_compute_performance-ego": 0.0708040714263916, "sim_compute_robot_state-ego": 0.08597372862008902, "sim_compute_robot_state-npc0": 0.07513786829434908, "sim_compute_robot_state-npc1": 0.07241366092975322, "sim_compute_robot_state-npc2": 0.07348304161658654, "sim_compute_robot_state-npc3": 0.07320134089543269}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0034508414384795396, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07187300484354903, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16172442494369135, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.0782162590724666, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04040067079590588, "sim_compute_performance-ego": 0.06656036435103999, "sim_compute_robot_state-ego": 0.08112279380240091, "sim_compute_robot_state-npc0": 0.07637807218039908, "sim_compute_robot_state-npc1": 0.07261875780617319, "sim_compute_robot_state-npc2": 0.07053420311067163, "sim_compute_robot_state-npc3": 0.0710057688922417}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.003428969383239746, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.07066843748092651, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1550799512863159, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07740355968475342, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.03966011047363281, "sim_compute_performance-ego": 0.06839191675186157, "sim_compute_robot_state-ego": 0.08190892457962036, "sim_compute_robot_state-npc0": 0.07668123483657836, "sim_compute_robot_state-npc1": 0.07277400016784669, "sim_compute_robot_state-npc2": 0.07021082401275634, "sim_compute_robot_state-npc3": 0.06952412366867065}}
set_robot_commands_max0.0791312020922464
set_robot_commands_mean0.0777860641288354
set_robot_commands_median0.07788833471444936
set_robot_commands_min0.07629096508026123
sim_compute_performance-ego_max0.0708040714263916
sim_compute_performance-ego_mean0.06827654526245673
sim_compute_performance-ego_median0.06839191675186157
sim_compute_performance-ego_min0.06616872549057007
sim_compute_robot_state-ego_max0.2596869714119855
sim_compute_robot_state-ego_mean0.11923178540744986
sim_compute_robot_state-ego_median0.08597372862008902
sim_compute_robot_state-ego_min0.08112279380240091
sim_compute_robot_state-npc0_max0.07668123483657836
sim_compute_robot_state-npc0_mean0.0756578554197068
sim_compute_robot_state-npc0_median0.07560201252208036
sim_compute_robot_state-npc0_min0.07449008926512703
sim_compute_robot_state-npc1_max0.07277400016784669
sim_compute_robot_state-npc1_mean0.07166127667708308
sim_compute_robot_state-npc1_median0.07241366092975322
sim_compute_robot_state-npc1_min0.06906621596392463
sim_compute_robot_state-npc2_max0.07348304161658654
sim_compute_robot_state-npc2_mean0.07042914267094495
sim_compute_robot_state-npc2_median0.07021082401275634
sim_compute_robot_state-npc2_min0.06800340203677907
sim_compute_robot_state-npc3_max0.07320134089543269
sim_compute_robot_state-npc3_mean0.07037733074873233
sim_compute_robot_state-npc3_median0.0710057688922417
sim_compute_robot_state-npc3_min0.06700613919426412
sim_compute_sim_state_max0.04143975698030912
sim_compute_sim_state_mean0.04020457212454877
sim_compute_sim_state_median0.04040067079590588
sim_compute_sim_state_min0.03857779152253095
sim_physics_max0.0035517367105635388
sim_physics_mean0.003435965311586915
sim_physics_median0.0034508414384795396
sim_physics_min0.003246808753294103
sim_render-ego_max0.07386067463801457
sim_render-ego_mean0.07166359664273735
sim_render-ego_median0.07113661836175357
sim_render-ego_min0.07066843748092651
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171632278Peter AlmasiΒ πŸ‡­πŸ‡ΊPyTorch templateaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-147100:30:39
Timeout: Waited 180 [...]
Timeout:

Waited 1800.5973994731903 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171612317Julian ZillyBaseline solution using imitation learning from logsaido2_LFV_r1-v4step1-simulationabortedyesidsc-rudolf-147100:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18482147694429377
survival_time_median1.3500000000000003
deviation-center-line_median0.07930110646342275
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20802868264062063
agent_compute-ego_mean0.20466805170549815
agent_compute-ego_median0.2053148393277769
agent_compute-ego_min0.19809741444057888
deviation-center-line_max0.08127908680916048
deviation-center-line_mean0.07918150249538727
deviation-center-line_min0.07737627556794356
deviation-heading_max0.7560020895565267
deviation-heading_mean0.711349846335019
deviation-heading_median0.7041554170496334
deviation-heading_min0.6682793112362134
driven_any_max0.2352841531174228
driven_any_mean0.22743933786850615
driven_any_median0.22767271249920948
driven_any_min0.2212341045831002
driven_lanedir_consec_max0.19496743190808097
driven_lanedir_consec_mean0.18342031941798145
driven_lanedir_consec_min0.17277119420330234
driven_lanedir_max0.19496743190808097
driven_lanedir_mean0.18342031941798145
driven_lanedir_median0.18482147694429377
driven_lanedir_min0.17277119420330234
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22865935960749104, "sim_physics": 0.0031164884567260742, "survival_time": 1.3000000000000005, "driven_lanedir": 0.18709291320561183, "sim_render-ego": 0.059344777694115274, "in-drivable-lane": 0, "agent_compute-ego": 0.20484454815204328, "deviation-heading": 0.6682793112362134, "set_robot_commands": 0.07583436599144569, "deviation-center-line": 0.07737627556794356, "driven_lanedir_consec": 0.18709291320561183, "sim_compute_sim_state": 0.030993076471182015, "sim_compute_performance-ego": 0.05991734908177303, "sim_compute_robot_state-ego": 0.5231165060630212, "sim_compute_robot_state-npc0": 0.07049338634197529, "sim_compute_robot_state-npc1": 0.06447376654698299, "sim_compute_robot_state-npc2": 0.06049237801478459, "sim_compute_robot_state-npc3": 0.059898706582876354}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2352841531174228, "sim_physics": 0.002974910395486014, "survival_time": 1.4000000000000006, "driven_lanedir": 0.19496743190808097, "sim_render-ego": 0.06001504829951695, "in-drivable-lane": 0, "agent_compute-ego": 0.20802868264062063, "deviation-heading": 0.6849903779871328, "set_robot_commands": 0.07754295212881905, "deviation-center-line": 0.07832944540898547, "driven_lanedir_consec": 0.19496743190808097, "sim_compute_sim_state": 0.03319082089832851, "sim_compute_performance-ego": 0.06218096188136509, "sim_compute_robot_state-ego": 0.0769677928515843, "sim_compute_robot_state-npc0": 0.07446396350860596, "sim_compute_robot_state-npc1": 0.06416330167225429, "sim_compute_robot_state-npc2": 0.0648206387247358, "sim_compute_robot_state-npc3": 0.06535436425890241}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22767271249920948, "sim_physics": 0.003262422702930592, "survival_time": 1.3500000000000003, "driven_lanedir": 0.18482147694429377, "sim_render-ego": 0.06128157509697808, "in-drivable-lane": 0, "agent_compute-ego": 0.20705477396647137, "deviation-heading": 0.7041554170496334, "set_robot_commands": 0.08021480065804941, "deviation-center-line": 0.07930110646342275, "driven_lanedir_consec": 0.18482147694429377, "sim_compute_sim_state": 0.03338091461746781, "sim_compute_performance-ego": 0.06085843510097928, "sim_compute_robot_state-ego": 0.07907555721424243, "sim_compute_robot_state-npc0": 0.07247027644404659, "sim_compute_robot_state-npc1": 0.06398753766660337, "sim_compute_robot_state-npc2": 0.06067716633832013, "sim_compute_robot_state-npc3": 0.06162038555851689}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2212341045831002, "sim_physics": 0.003059722759105541, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17277119420330234, "sim_render-ego": 0.05862428523876049, "in-drivable-lane": 0, "agent_compute-ego": 0.2053148393277769, "deviation-heading": 0.7560020895565267, "set_robot_commands": 0.07702516626428675, "deviation-center-line": 0.0796215982274241, "driven_lanedir_consec": 0.17277119420330234, "sim_compute_sim_state": 0.0320688353644477, "sim_compute_performance-ego": 0.05975359457510489, "sim_compute_robot_state-ego": 0.08256358570522732, "sim_compute_robot_state-npc0": 0.07099843908239294, "sim_compute_robot_state-npc1": 0.06265450406957555, "sim_compute_robot_state-npc2": 0.060212930043538414, "sim_compute_robot_state-npc3": 0.06015416427894875}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22434635953530724, "sim_physics": 0.0031121660161901404, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17744858082861825, "sim_render-ego": 0.0653892887963189, "in-drivable-lane": 0, "agent_compute-ego": 0.19809741444057888, "deviation-heading": 0.7433220358455889, "set_robot_commands": 0.07544015955041956, "deviation-center-line": 0.08127908680916048, "driven_lanedir_consec": 0.17744858082861825, "sim_compute_sim_state": 0.03358817983556677, "sim_compute_performance-ego": 0.06119290987650553, "sim_compute_robot_state-ego": 0.07575459833498355, "sim_compute_robot_state-npc0": 0.07718936602274577, "sim_compute_robot_state-npc1": 0.06608495005854854, "sim_compute_robot_state-npc2": 0.0616367569676152, "sim_compute_robot_state-npc3": 0.06104056923477738}}
set_robot_commands_max0.08021480065804941
set_robot_commands_mean0.07721148891860409
set_robot_commands_median0.07702516626428675
set_robot_commands_min0.07544015955041956
sim_compute_performance-ego_max0.06218096188136509
sim_compute_performance-ego_mean0.06078065010314556
sim_compute_performance-ego_median0.06085843510097928
sim_compute_performance-ego_min0.05975359457510489
sim_compute_robot_state-ego_max0.5231165060630212
sim_compute_robot_state-ego_mean0.16749560803381175
sim_compute_robot_state-ego_median0.07907555721424243
sim_compute_robot_state-ego_min0.07575459833498355
sim_compute_robot_state-npc0_max0.07718936602274577
sim_compute_robot_state-npc0_mean0.07312308627995331
sim_compute_robot_state-npc0_median0.07247027644404659
sim_compute_robot_state-npc0_min0.07049338634197529
sim_compute_robot_state-npc1_max0.06608495005854854
sim_compute_robot_state-npc1_mean0.06427281200279295
sim_compute_robot_state-npc1_median0.06416330167225429
sim_compute_robot_state-npc1_min0.06265450406957555
sim_compute_robot_state-npc2_max0.0648206387247358
sim_compute_robot_state-npc2_mean0.06156797401779883
sim_compute_robot_state-npc2_median0.06067716633832013
sim_compute_robot_state-npc2_min0.060212930043538414
sim_compute_robot_state-npc3_max0.06535436425890241
sim_compute_robot_state-npc3_mean0.06161363798280437
sim_compute_robot_state-npc3_median0.06104056923477738
sim_compute_robot_state-npc3_min0.059898706582876354
sim_compute_sim_state_max0.03358817983556677
sim_compute_sim_state_mean0.032644365437398556
sim_compute_sim_state_median0.03319082089832851
sim_compute_sim_state_min0.030993076471182015
sim_physics_max0.003262422702930592
sim_physics_mean0.0031051420660876726
sim_physics_median0.0031121660161901404
sim_physics_min0.002974910395486014
sim_render-ego_max0.0653892887963189
sim_render-ego_mean0.060930995025137935
sim_render-ego_median0.06001504829951695
sim_render-ego_min0.05862428523876049
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.3500000000000003
survival_time_min1.3000000000000005
No reset possible
171592319FANG MEIYIΒ πŸ‡ΈπŸ‡¬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-147100:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09419855929319844
survival_time_median0.65
deviation-center-line_median0.024398298032740247
in-drivable-lane_median0.09999999999999998


other stats
agent_compute-ego_max0.16524457931518555
agent_compute-ego_mean0.15472414448691807
agent_compute-ego_median0.15227554394648626
agent_compute-ego_min0.1476463187824596
deviation-center-line_max0.0628032172006529
deviation-center-line_mean0.029992680318809917
deviation-center-line_min0.007093610227727502
deviation-heading_max0.5188310793819214
deviation-heading_mean0.3329327354329177
deviation-heading_median0.28263420392485217
deviation-heading_min0.22951461988336885
driven_any_max0.5707216696146715
driven_any_mean0.3974774231962924
driven_any_median0.37412013163993807
driven_any_min0.23119697229429292
driven_lanedir_consec_max0.2667790289000642
driven_lanedir_consec_mean0.14041720895656892
driven_lanedir_consec_min0.08166532262384874
driven_lanedir_max0.3007930426776575
driven_lanedir_mean0.1669351845684384
driven_lanedir_median0.09464906999322364
driven_lanedir_min0.08166532262384874
in-drivable-lane_max0.5500000000000003
in-drivable-lane_mean0.16000000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.55479429313413, "sim_physics": 0.003348210278679343, "survival_time": 0.8500000000000002, "driven_lanedir": 0.09464906999322364, "sim_render-ego": 0.07221592173856847, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.16524457931518555, "deviation-heading": 0.24255146657121804, "set_robot_commands": 0.08178368736715878, "deviation-center-line": 0.024398298032740247, "driven_lanedir_consec": 0.09419855929319844, "sim_compute_sim_state": 0.044889393974752986, "sim_compute_performance-ego": 0.07068286222570083, "sim_compute_robot_state-ego": 0.9283556236940272}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23119697229429292, "sim_physics": 0.0035001635551452637, "survival_time": 0.4, "driven_lanedir": 0.08166532262384874, "sim_render-ego": 0.06485801935195923, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.1577812135219574, "deviation-heading": 0.22951461988336885, "set_robot_commands": 0.08149966597557068, "deviation-center-line": 0.007093610227727502, "driven_lanedir_consec": 0.08166532262384874, "sim_compute_sim_state": 0.04578918218612671, "sim_compute_performance-ego": 0.06944122910499573, "sim_compute_robot_state-ego": 0.08190849423408508}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5707216696146715, "sim_physics": 0.0031714579638312847, "survival_time": 0.8500000000000002, "driven_lanedir": 0.3007930426776575, "sim_render-ego": 0.07036398438846364, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.15067306686850154, "deviation-heading": 0.5188310793819214, "set_robot_commands": 0.08183886023128734, "deviation-center-line": 0.0628032172006529, "driven_lanedir_consec": 0.16865367531833542, "sim_compute_sim_state": 0.04437577023225672, "sim_compute_performance-ego": 0.06416763978845932, "sim_compute_robot_state-ego": 0.08258150605594411}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.37412013163993807, "sim_physics": 0.002990282498873197, "survival_time": 0.65, "driven_lanedir": 0.2667790289000642, "sim_render-ego": 0.06332643215472882, "in-drivable-lane": 0, "agent_compute-ego": 0.15227554394648626, "deviation-heading": 0.3911323074032279, "set_robot_commands": 0.07685694327721229, "deviation-center-line": 0.04135458884199785, "driven_lanedir_consec": 0.2667790289000642, "sim_compute_sim_state": 0.04291604115412785, "sim_compute_performance-ego": 0.06420073142418495, "sim_compute_robot_state-ego": 0.08287910314706656}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2565540492984296, "sim_physics": 0.003465977582064542, "survival_time": 0.5499999999999999, "driven_lanedir": 0.09078945864739783, "sim_render-ego": 0.08152075247331099, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.1476463187824596, "deviation-heading": 0.28263420392485217, "set_robot_commands": 0.07697890021584251, "deviation-center-line": 0.014313687290931076, "driven_lanedir_consec": 0.09078945864739783, "sim_compute_sim_state": 0.04537073048678311, "sim_compute_performance-ego": 0.06742349537936124, "sim_compute_robot_state-ego": 0.08544529568065297}}
set_robot_commands_max0.08183886023128734
set_robot_commands_mean0.07979161141341433
set_robot_commands_median0.08149966597557068
set_robot_commands_min0.07685694327721229
sim_compute_performance-ego_max0.07068286222570083
sim_compute_performance-ego_mean0.0671831915845404
sim_compute_performance-ego_median0.06742349537936124
sim_compute_performance-ego_min0.06416763978845932
sim_compute_robot_state-ego_max0.9283556236940272
sim_compute_robot_state-ego_mean0.2522340045623552
sim_compute_robot_state-ego_median0.08287910314706656
sim_compute_robot_state-ego_min0.08190849423408508
sim_compute_sim_state_max0.04578918218612671
sim_compute_sim_state_mean0.04466822360680947
sim_compute_sim_state_median0.044889393974752986
sim_compute_sim_state_min0.04291604115412785
sim_physics_max0.0035001635551452637
sim_physics_mean0.003295218375718726
sim_physics_median0.003348210278679343
sim_physics_min0.002990282498873197
sim_render-ego_max0.08152075247331099
sim_render-ego_mean0.07045702202140622
sim_render-ego_median0.07036398438846364
sim_render-ego_min0.06332643215472882
simulation-passed1
survival_time_max0.8500000000000002
survival_time_mean0.66
survival_time_min0.4
No reset possible
171472332Konstantin ChaikaROS-based Lane Followingaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-147100:30:42
Timeout: Waited 180 [...]
Timeout:

Waited 1803.9206442832947 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171342332Konstantin ChaikaROS-based Lane Followingaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-147100:30:38
Timeout: Waited 180 [...]
Timeout:

Waited 1800.1963920593262 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171272332Konstantin ChaikaROS-based Lane Followingaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-147100:31:40
Timeout: Waited 180 [...]
Timeout:

Waited 1803.929328918457 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171262326Konstantin ChaikaPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-147100:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10783251262778495
error_L20.01920160032484337


No reset possible
171212331Egor ZamotaevTemplate for ROS Submissionaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-147100:01:28
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171162320FANG MEIYIΒ πŸ‡ΈπŸ‡¬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-147100:03:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible