Duckietown Challenges Home Challenges Submissions

Evaluator 1569

ID1569
evaluatoridsc-rudolf-7957
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-7957
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success1 24260
# timeout1 24264
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
242644126Andrea Censi 🇨🇭rotationaido3-LF-sim-validationstep1-simulationtimeoutnoidsc-rudolf-79571:05:59
I can see how the jo [...]
I can see how the job 24264 is timeout because passed 3959 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242604130Andrea Censi 🇨🇭rotationaido3-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-79570:31:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.000305044676884636
survival_time_median14.950000000000076
deviation-center-line_median0.4891046565937845
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.16235169490178425
agent_compute-ego_mean0.1581437513033549
agent_compute-ego_median0.1576659115155538
agent_compute-ego_min0.15486369132995606
deviation-center-line_max0.6113246250082045
deviation-center-line_mean0.4225460275157091
deviation-center-line_min0.020737627062439232
deviation-heading_max5.830135897709594
deviation-heading_mean5.684570550707688
deviation-heading_median5.657649106857694
deviation-heading_min5.536662996854866
driven_any_max0.02647867283405392
driven_any_mean0.024864239592253624
driven_any_median0.02593019554120814
driven_any_min0.02216545266138003
driven_lanedir_consec_max0.002162616049345756
driven_lanedir_consec_mean-0.0004886462276792348
driven_lanedir_consec_min-0.0036402347654349576
driven_lanedir_max0.002162616049345756
driven_lanedir_mean-0.0004886462276792348
driven_lanedir_median0.000305044676884636
driven_lanedir_min-0.0036402347654349576
in-drivable-lane_max7.650000000000043
in-drivable-lane_mean7.600000000000042
in-drivable-lane_min7.550000000000044
per-episodes
details{"udem1-0-0": {"driven_any": 0.02647867283405392, "sim_physics": 0.1305420668919881, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.07133201281229655, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.16235169490178425, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.07960545778274536, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.04392107327779134, "sim_compute_performance-ego": 0.07122091213862101, "sim_compute_robot_state-ego": 0.06667611757914226, "sim_compute_robot_state-npc0": 0.07881128072738647, "sim_compute_robot_state-npc1": 0.07607035795847575, "sim_compute_robot_state-npc2": 0.07610795656840007, "sim_compute_robot_state-npc3": 0.07635273297627766}, "udem1-1-0": {"driven_any": 0.02593019554120814, "sim_physics": 0.13067882537841796, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.07149895191192628, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15966646989186606, "deviation-heading": 5.795316370396738, "set_robot_commands": 0.07894331534703572, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.04287650108337402, "sim_compute_performance-ego": 0.07258883635203044, "sim_compute_robot_state-ego": 0.06537246465682983, "sim_compute_robot_state-npc0": 0.07634308656056722, "sim_compute_robot_state-npc1": 0.07483828624089559, "sim_compute_robot_state-npc2": 0.07455001354217529, "sim_compute_robot_state-npc3": 0.07431480964024861}, "udem1-2-0": {"driven_any": 0.02380440467243486, "sim_physics": 0.12702621698379515, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.0677596108118693, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.15486369132995606, "deviation-heading": 5.6030883817195525, "set_robot_commands": 0.07881982405980428, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.04112337430318196, "sim_compute_performance-ego": 0.07041127602259319, "sim_compute_robot_state-ego": 0.06670924186706544, "sim_compute_robot_state-npc0": 0.07509844382603963, "sim_compute_robot_state-npc1": 0.07386327664057414, "sim_compute_robot_state-npc2": 0.07209889729817709, "sim_compute_robot_state-npc3": 0.07159338076909383}, "udem1-3-0": {"driven_any": 0.02216545266138003, "sim_physics": 0.12266590515772502, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202353105, "sim_render-ego": 0.06932199954986572, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.1576659115155538, "deviation-heading": 5.536662996854866, "set_robot_commands": 0.07948587973912558, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202353105, "sim_compute_sim_state": 0.04299468517303467, "sim_compute_performance-ego": 0.07054940938949585, "sim_compute_robot_state-ego": 0.06476981004079183, "sim_compute_robot_state-npc0": 0.07546880960464478, "sim_compute_robot_state-npc1": 0.07227360566457113, "sim_compute_robot_state-npc2": 0.07216967423756918, "sim_compute_robot_state-npc3": 0.07245831251144409}, "udem1-4-0": {"driven_any": 0.02594247225219117, "sim_physics": 0.12150150616963704, "survival_time": 14.950000000000076, "driven_lanedir": 0.000305044676884636, "sim_render-ego": 0.06891451994578043, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.15617098887761435, "deviation-heading": 5.830135897709594, "set_robot_commands": 0.07891873041788737, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.000305044676884636, "sim_compute_sim_state": 0.04102774461110433, "sim_compute_performance-ego": 0.07043965021769205, "sim_compute_robot_state-ego": 0.06440005620320638, "sim_compute_robot_state-npc0": 0.0762375259399414, "sim_compute_robot_state-npc1": 0.07371385018030803, "sim_compute_robot_state-npc2": 0.07302451213200888, "sim_compute_robot_state-npc3": 0.07220407247543335}}
set_robot_commands_max0.07960545778274536
set_robot_commands_mean0.07915464146931966
set_robot_commands_median0.07894331534703572
set_robot_commands_min0.07881982405980428
sim_compute_performance-ego_max0.07258883635203044
sim_compute_performance-ego_mean0.0710420168240865
sim_compute_performance-ego_median0.07054940938949585
sim_compute_performance-ego_min0.07041127602259319
sim_compute_robot_state-ego_max0.06670924186706544
sim_compute_robot_state-ego_mean0.06558553806940716
sim_compute_robot_state-ego_median0.06537246465682983
sim_compute_robot_state-ego_min0.06440005620320638
sim_compute_robot_state-npc0_max0.07881128072738647
sim_compute_robot_state-npc0_mean0.07639182933171589
sim_compute_robot_state-npc0_median0.0762375259399414
sim_compute_robot_state-npc0_min0.07509844382603963
sim_compute_robot_state-npc1_max0.07607035795847575
sim_compute_robot_state-npc1_mean0.07415187533696492
sim_compute_robot_state-npc1_median0.07386327664057414
sim_compute_robot_state-npc1_min0.07227360566457113
sim_compute_robot_state-npc2_max0.07610795656840007
sim_compute_robot_state-npc2_mean0.0735902107556661
sim_compute_robot_state-npc2_median0.07302451213200888
sim_compute_robot_state-npc2_min0.07209889729817709
sim_compute_robot_state-npc3_max0.07635273297627766
sim_compute_robot_state-npc3_mean0.0733846616744995
sim_compute_robot_state-npc3_median0.07245831251144409
sim_compute_robot_state-npc3_min0.07159338076909383
sim_compute_sim_state_max0.04392107327779134
sim_compute_sim_state_mean0.04238867568969727
sim_compute_sim_state_median0.04287650108337402
sim_compute_sim_state_min0.04102774461110433
sim_physics_max0.13067882537841796
sim_physics_mean0.12648290411631266
sim_physics_median0.12702621698379515
sim_physics_min0.12150150616963704
sim_render-ego_max0.07149895191192628
sim_render-ego_mean0.06976541900634765
sim_render-ego_median0.06932199954986572
sim_render-ego_min0.0677596108118693
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible