Duckietown Challenges Home Challenges Submissions

Evaluator 2227

ID2227
evaluatormont05-51e4a88584f1-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont05-51e4a88584f1-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 39908
# timeout
# failed
# error
# aborted1 39916
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3991611130Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednomont05-51e4a88584f1-10:01:16
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3990810910Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont05-51e4a88584f1-10:10:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.0175688370068868
agent_compute-ego_mean0.017309059699376423
agent_compute-ego_median0.017264537811279297
agent_compute-ego_min0.017138326168060304
complete-iteration_max0.2221984593073527
complete-iteration_mean0.2089003547032674
complete-iteration_median0.20505273302396135
complete-iteration_min0.2032974934577942
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.762476603190104e-06
get_duckie_state_mean2.685983975728353e-06
get_duckie_state_median2.6937325795491533e-06
get_duckie_state_min2.593994140625e-06
get_robot_state_max0.01592012087504069
get_robot_state_mean0.015644937952359515
get_robot_state_median0.01557342569033305
get_robot_state_min0.015512779553731282
get_state_dump_max0.013552425702412925
get_state_dump_mean0.013451447089513142
get_state_dump_median0.013460375865300496
get_state_dump_min0.013332610925038657
get_ui_image_max0.038005355993906656
get_ui_image_mean0.03713533699512482
get_ui_image_median0.037220750649770096
get_ui_image_min0.03609449068705241
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.03609449068705241, "step_physics": 0.08384584426879883, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.013423090775807698, "sim_render-ego": 0.006059301694234212, "get_robot_state": 0.015512779553731282, "get_duckie_state": 2.649625142415365e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01734893560409546, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.20450068553288775, "set_robot_commands": 0.004806927045186361, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02311073859532674, "sim_compute_performance-ego": 0.004150772094726562}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.03745339234670003, "step_physics": 0.08245384454727173, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.013332610925038657, "sim_render-ego": 0.006200901667277018, "get_robot_state": 0.015609731674194336, "get_duckie_state": 2.7378400166829425e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017138326168060304, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2032974934577942, "set_robot_commands": 0.004785315990447998, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.022024606863657634, "sim_compute_performance-ego": 0.004145458539326985}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.03698810895284017, "step_physics": 0.08283109029134114, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.013497660954793296, "sim_render-ego": 0.006318716208140055, "get_robot_state": 0.01592012087504069, "get_duckie_state": 2.593994140625e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0175688370068868, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.205604780515035, "set_robot_commands": 0.004866679509480794, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.02318260113398234, "sim_compute_performance-ego": 0.00427642822265625}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.038005355993906656, "step_physics": 0.09657639741897583, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.013552425702412925, "sim_render-ego": 0.006136752764383952, "get_robot_state": 0.015537119706471762, "get_duckie_state": 2.762476603190104e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017180140018463134, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2221984593073527, "set_robot_commands": 0.004784259001413981, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02610070784886678, "sim_compute_performance-ego": 0.0041692010561625165}}
set_robot_commands_max0.004866679509480794
set_robot_commands_mean0.004810795386632283
set_robot_commands_median0.004796121517817179
set_robot_commands_min0.004784259001413981
sim_compute_performance-ego_max0.00427642822265625
sim_compute_performance-ego_mean0.0041854649782180784
sim_compute_performance-ego_median0.004159986575444539
sim_compute_performance-ego_min0.004145458539326985
sim_compute_sim_state_max0.02610070784886678
sim_compute_sim_state_mean0.023604663610458373
sim_compute_sim_state_median0.02314666986465454
sim_compute_sim_state_min0.022024606863657634
sim_render-ego_max0.006318716208140055
sim_render-ego_mean0.0061789180835088095
sim_render-ego_median0.006168827215830485
sim_render-ego_min0.006059301694234212
simulation-passed1
step_physics_max0.09657639741897583
step_physics_mean0.08642679413159687
step_physics_median0.08333846728007
step_physics_min0.08245384454727173
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible