Duckietown Challenges Home Challenges Submissions

Evaluator 811

ID811
evaluatoridsc-rudolf-11988
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-11988
versiond-c:4.0.18;d-c-r:4.0.28;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success3 20655
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
206833089Claudio RuchJava template from Webinaraido2-AMOD-efficiencystep1-simulationsuccessyesidsc-rudolf-119880:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
206803087Claudio RuchPython templateaido2-AMOD-service_qualitystep2-scoringsuccessyesidsc-rudolf-119880:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-32.494135912330385


other stats
efficiency-63.403583649319
fleet_size-1000000000
No reset possible
206553071Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-119880:13:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6282056539209542
survival_time_median10.90000000000002
deviation-center-line_median0.5384078179782323
in-drivable-lane_median1.4499999999999984


other stats
agent_compute-ego_max0.20957313013858483
agent_compute-ego_mean0.20537843401027311
agent_compute-ego_median0.20552285899103215
agent_compute-ego_min0.20036268671718213
deviation-center-line_max0.9470264608408818
deviation-center-line_mean0.6175214338840148
deviation-center-line_min0.37450232842301423
deviation-heading_max3.705553267616144
deviation-heading_mean1.5919324628954925
deviation-heading_median1.0297600697995035
deviation-heading_min0.7229619238029581
driven_any_max1.3742100800015038
driven_any_mean0.8473836996651887
driven_any_median0.9927745445439584
driven_any_min0.2972558039801085
driven_lanedir_consec_max0.8047275709139564
driven_lanedir_consec_mean0.5985992641601221
driven_lanedir_consec_min0.2911135313982012
driven_lanedir_max0.8047275709139564
driven_lanedir_mean0.5985992641601221
driven_lanedir_median0.6282056539209542
driven_lanedir_min0.2911135313982012
in-drivable-lane_max6.6500000000000945
in-drivable-lane_mean2.3500000000000263
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9927745445439584, "sim_physics": 0.06207760758356217, "survival_time": 10.90000000000002, "driven_lanedir": 0.6282056539209542, "sim_render-ego": 0.06647896219830994, "in-drivable-lane": 3.6500000000000377, "agent_compute-ego": 0.20036268671718213, "deviation-heading": 1.0297600697995035, "set_robot_commands": 0.07829577988440838, "deviation-center-line": 0.5384078179782323, "driven_lanedir_consec": 0.6282056539209542, "sim_compute_sim_state": 0.04345586103036863, "sim_compute_performance-ego": 0.06896222622022716, "sim_compute_robot_state-ego": 0.06563703729472029}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0304377588728757, "sim_physics": 0.05949206373332877, "survival_time": 11.300000000000026, "driven_lanedir": 0.8047275709139564, "sim_render-ego": 0.06746272703187656, "in-drivable-lane": 1.4499999999999984, "agent_compute-ego": 0.20552285899103215, "deviation-heading": 3.705553267616144, "set_robot_commands": 0.07913150618561601, "deviation-center-line": 0.9470264608408818, "driven_lanedir_consec": 0.8047275709139564, "sim_compute_sim_state": 0.043453183849300955, "sim_compute_performance-ego": 0.06737815911790966, "sim_compute_robot_state-ego": 0.06417326062126497}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2972558039801085, "sim_physics": 0.05150270121438163, "survival_time": 3.4999999999999956, "driven_lanedir": 0.2911135313982012, "sim_render-ego": 0.06643030302865165, "in-drivable-lane": 0, "agent_compute-ego": 0.20649937561580112, "deviation-heading": 0.7229619238029581, "set_robot_commands": 0.07814361708504813, "deviation-center-line": 0.37450232842301423, "driven_lanedir_consec": 0.2911135313982012, "sim_compute_sim_state": 0.04388958386012486, "sim_compute_performance-ego": 0.06766539982386997, "sim_compute_robot_state-ego": 0.06544362817491804}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5422403109274971, "sim_physics": 0.05913476670374636, "survival_time": 6.099999999999986, "driven_lanedir": 0.525663595621864, "sim_render-ego": 0.06763219637948958, "in-drivable-lane": 0, "agent_compute-ego": 0.20957313013858483, "deviation-heading": 1.5211104268059048, "set_robot_commands": 0.07900928669288511, "deviation-center-line": 0.440938382172192, "driven_lanedir_consec": 0.525663595621864, "sim_compute_sim_state": 0.043851670671681886, "sim_compute_performance-ego": 0.06982422852125324, "sim_compute_robot_state-ego": 0.06686623760911285}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3742100800015038, "sim_physics": 0.06256207784016928, "survival_time": 14.950000000000076, "driven_lanedir": 0.7432859689456346, "sim_render-ego": 0.06800455411275227, "in-drivable-lane": 6.6500000000000945, "agent_compute-ego": 0.20493411858876545, "deviation-heading": 0.9802766264529508, "set_robot_commands": 0.07825360218683879, "deviation-center-line": 0.7867321800057536, "driven_lanedir_consec": 0.7432859689456346, "sim_compute_sim_state": 0.04430214166641235, "sim_compute_performance-ego": 0.06822563966115315, "sim_compute_robot_state-ego": 0.06451705694198609}}
set_robot_commands_max0.07913150618561601
set_robot_commands_mean0.07856675840695929
set_robot_commands_median0.07829577988440838
set_robot_commands_min0.07814361708504813
sim_compute_performance-ego_max0.06982422852125324
sim_compute_performance-ego_mean0.06841113066888263
sim_compute_performance-ego_median0.06822563966115315
sim_compute_performance-ego_min0.06737815911790966
sim_compute_robot_state-ego_max0.06686623760911285
sim_compute_robot_state-ego_mean0.06532744412840046
sim_compute_robot_state-ego_median0.06544362817491804
sim_compute_robot_state-ego_min0.06417326062126497
sim_compute_sim_state_max0.04430214166641235
sim_compute_sim_state_mean0.04379048821557774
sim_compute_sim_state_median0.043851670671681886
sim_compute_sim_state_min0.043453183849300955
sim_physics_max0.06256207784016928
sim_physics_mean0.058953843415037635
sim_physics_median0.05949206373332877
sim_physics_min0.05150270121438163
sim_render-ego_max0.06800455411275227
sim_render-ego_mean0.06720174855021602
sim_render-ego_median0.06746272703187656
sim_render-ego_min0.06643030302865165
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.35000000000002
survival_time_min3.4999999999999956
No reset possible