Duckietown Challenges Home Challenges Submissions

Evaluator 2233

ID2233
evaluatormont04-f6dcae3b60c2-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont04-f6dcae3b60c2-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 39911
# timeout
# failed
# error
# aborted1 39917
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3991711222Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simabortednomont04-f6dcae3b60c2-10:03:29
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3991110910Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont04-f6dcae3b60c2-10:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.018191243012746175
agent_compute-ego_mean0.017534202734629314
agent_compute-ego_median0.01741892377535502
agent_compute-ego_min0.017107720375061034
complete-iteration_max0.2264983344078064
complete-iteration_mean0.21414500574270884
complete-iteration_median0.21062331318855287
complete-iteration_min0.2088350621859233
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.5955835978190104e-06
get_duckie_state_mean2.5029977162679036e-06
get_duckie_state_median2.482732137044271e-06
get_duckie_state_min2.4509429931640623e-06
get_robot_state_max0.016611040433247883
get_robot_state_mean0.01627071738243103
get_robot_state_median0.016275955041249592
get_robot_state_min0.01591991901397705
get_state_dump_max0.013850529193878174
get_state_dump_mean0.01369659463564555
get_state_dump_median0.01366534233093262
get_state_dump_min0.013605164686838783
get_ui_image_max0.03789460023244222
get_ui_image_mean0.03743672450383504
get_ui_image_median0.03748281558354696
get_ui_image_min0.03688666661580404
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.03688666661580404, "step_physics": 0.08710877418518066, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.013669799168904625, "sim_render-ego": 0.006304930051167806, "get_robot_state": 0.01591991901397705, "get_duckie_state": 2.487500508626302e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017214423020680745, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.20989145596822104, "set_robot_commands": 0.0049495244026184085, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.023464066982269285, "sim_compute_performance-ego": 0.00421728769938151}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.03789460023244222, "step_physics": 0.08587769826253255, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.013605164686838783, "sim_render-ego": 0.006455297470092773, "get_robot_state": 0.016217151482899983, "get_duckie_state": 2.477963765462239e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017107720375061034, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2088350621859233, "set_robot_commands": 0.004944851398468017, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.022292813460032142, "sim_compute_performance-ego": 0.004280349413553874}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.03728782415390015, "step_physics": 0.08617502371470133, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.013660885492960613, "sim_render-ego": 0.0064535045623779295, "get_robot_state": 0.016611040433247883, "get_duckie_state": 2.5955835978190104e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.018191243012746175, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.21135517040888468, "set_robot_commands": 0.004983117580413818, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.023572267691294353, "sim_compute_performance-ego": 0.004258071581522624}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.037677807013193766, "step_physics": 0.09839449803034464, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.013850529193878174, "sim_render-ego": 0.0065157286326090495, "get_robot_state": 0.0163347585995992, "get_duckie_state": 2.4509429931640623e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017623424530029297, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2264983344078064, "set_robot_commands": 0.004924002488454183, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.026673464775085448, "sim_compute_performance-ego": 0.00434331734975179}}
set_robot_commands_max0.004983117580413818
set_robot_commands_mean0.004950373967488607
set_robot_commands_median0.004947187900543213
set_robot_commands_min0.004924002488454183
sim_compute_performance-ego_max0.00434331734975179
sim_compute_performance-ego_mean0.00427475651105245
sim_compute_performance-ego_median0.004269210497538249
sim_compute_performance-ego_min0.00421728769938151
sim_compute_sim_state_max0.026673464775085448
sim_compute_sim_state_mean0.024000653227170307
sim_compute_sim_state_median0.023518167336781817
sim_compute_sim_state_min0.022292813460032142
sim_render-ego_max0.0065157286326090495
sim_render-ego_mean0.00643236517906189
sim_render-ego_median0.006454401016235352
sim_render-ego_min0.006304930051167806
simulation-passed1
step_physics_max0.09839449803034464
step_physics_mean0.0893889985481898
step_physics_median0.086641898949941
step_physics_min0.08587769826253255
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible