Duckietown Challenges Home Challenges Submissions

Evaluator 722

ID722
evaluatoridsc-rudolf-10821
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-10821
versiond-c:4.0.17;d-c-r:4.0.25;d-s:4.0.17
first heard
last heard
statusinactive
# evaluating
# success1 17763
# timeout1 17800
# failed
# error3 17751
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
178002499Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationtimeoutnoidsc-rudolf-108210:25:14
I can see how the jo [...]
I can see how the job 17800 is timeout because passed 1514 seconds and the timeout is 1200.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177982506Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-108210:00:37
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177962524Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-108210:00:38
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177632403Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-108210:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12560777185697702
survival_time_median1.5000000000000009
deviation-center-line_median0.016602967691917637
in-drivable-lane_median0.7000000000000003


other stats
agent_compute-ego_max0.25826611518859866
agent_compute-ego_mean0.21814669357027325
agent_compute-ego_median0.22680642775126864
agent_compute-ego_min0.17185736497243245
deviation-center-line_max0.4264143215558398
deviation-center-line_mean0.09969371925171663
deviation-center-line_min0.010826871658658425
deviation-heading_max5.364604992607123
deviation-heading_mean1.432532842234909
deviation-heading_median0.5118406189045788
deviation-heading_min0.24003761741058793
driven_any_max3.927466459505728
driven_any_mean1.0411556501595625
driven_any_median0.37907950927755896
driven_any_min0.13728896818514116
driven_lanedir_consec_max1.0551506564219837
driven_lanedir_consec_mean0.30362419195042084
driven_lanedir_consec_min0.04258803324217864
driven_lanedir_max1.0551506564219837
driven_lanedir_mean0.30362419195042084
driven_lanedir_median0.12560777185697702
driven_lanedir_min0.04258803324217864
in-drivable-lane_max8.000000000000043
in-drivable-lane_mean2.0600000000000085
in-drivable-lane_min0.19999999999999996
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3607890054579347, "sim_physics": 0.013336522238595144, "survival_time": 1.4000000000000006, "driven_lanedir": 0.12560777185697702, "sim_render-ego": 0.06142596687589373, "in-drivable-lane": 0.6500000000000004, "agent_compute-ego": 0.22680642775126864, "deviation-heading": 0.554929453774309, "set_robot_commands": 0.07528655869620186, "deviation-center-line": 0.028556509581282356, "driven_lanedir_consec": 0.12560777185697702, "sim_compute_sim_state": 0.038313286645071845, "sim_compute_performance-ego": 0.06148309367043631, "sim_compute_robot_state-ego": 0.0622232300894601}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4011543083714497, "sim_physics": 0.017631324132283528, "survival_time": 1.5000000000000009, "driven_lanedir": 0.17166843621751982, "sim_render-ego": 0.06785895029703776, "in-drivable-lane": 0.7000000000000003, "agent_compute-ego": 0.20411783854166668, "deviation-heading": 0.4912515284779466, "set_robot_commands": 0.07746771176656088, "deviation-center-line": 0.016602967691917637, "driven_lanedir_consec": 0.17166843621751982, "sim_compute_sim_state": 0.04316479365030925, "sim_compute_performance-ego": 0.06796647707621256, "sim_compute_robot_state-ego": 0.06638402938842773}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13728896818514116, "sim_physics": 0.013882780075073242, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04258803324217864, "sim_render-ego": 0.06247520446777344, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.25826611518859866, "deviation-heading": 0.24003761741058793, "set_robot_commands": 0.07445862293243408, "deviation-center-line": 0.010826871658658425, "driven_lanedir_consec": 0.04258803324217864, "sim_compute_sim_state": 0.040129899978637695, "sim_compute_performance-ego": 0.06686725616455078, "sim_compute_robot_state-ego": 0.06414237022399902}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.37907950927755896, "sim_physics": 0.013783621788024902, "survival_time": 1.5000000000000009, "driven_lanedir": 0.12310606201344498, "sim_render-ego": 0.06194624106089274, "in-drivable-lane": 0.7500000000000004, "agent_compute-ego": 0.17185736497243245, "deviation-heading": 0.5118406189045788, "set_robot_commands": 0.07266171773274739, "deviation-center-line": 0.016067925770885016, "driven_lanedir_consec": 0.12310606201344498, "sim_compute_sim_state": 0.03807876110076904, "sim_compute_performance-ego": 0.05854202111562093, "sim_compute_robot_state-ego": 0.06028249263763428}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.927466459505728, "sim_physics": 0.01169038454691569, "survival_time": 14.950000000000076, "driven_lanedir": 1.0551506564219837, "sim_render-ego": 0.0593251355489095, "in-drivable-lane": 8.000000000000043, "agent_compute-ego": 0.2296857213973999, "deviation-heading": 5.364604992607123, "set_robot_commands": 0.07327565828959147, "deviation-center-line": 0.4264143215558398, "driven_lanedir_consec": 1.0551506564219837, "sim_compute_sim_state": 0.036730985641479495, "sim_compute_performance-ego": 0.06041320006052653, "sim_compute_robot_state-ego": 0.059450198809305826}}
set_robot_commands_max0.07746771176656088
set_robot_commands_mean0.07463005388350714
set_robot_commands_median0.07445862293243408
set_robot_commands_min0.07266171773274739
sim_compute_performance-ego_max0.06796647707621256
sim_compute_performance-ego_mean0.06305440961746941
sim_compute_performance-ego_median0.06148309367043631
sim_compute_performance-ego_min0.05854202111562093
sim_compute_robot_state-ego_max0.06638402938842773
sim_compute_robot_state-ego_mean0.0624964642297654
sim_compute_robot_state-ego_median0.0622232300894601
sim_compute_robot_state-ego_min0.059450198809305826
sim_compute_sim_state_max0.04316479365030925
sim_compute_sim_state_mean0.03928354540325347
sim_compute_sim_state_median0.038313286645071845
sim_compute_sim_state_min0.036730985641479495
sim_physics_max0.017631324132283528
sim_physics_mean0.014064926556178504
sim_physics_median0.013783621788024902
sim_physics_min0.01169038454691569
sim_render-ego_max0.06785895029703776
sim_render-ego_mean0.06260629965010144
sim_render-ego_median0.06194624106089274
sim_render-ego_min0.0593251355489095
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean3.970000000000016
survival_time_min0.49999999999999994
No reset possible
177512503Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-108210:01:07
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible