Duckietown Challenges Home Challenges Submissions

Evaluator 641

ID641
evaluatorInstance2
ownerJulian Zilly
machineidsc-rudolf
processInstance2
versiond-c:4.0.14;d-c-r:4.0.18;d-s:4.0.15
first heard
last heard
statusinactive
# evaluating
# success2 17601
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
176172443Jacopo Tanirandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessnoInstance20:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6896127428821732
survival_time_median1.1500000000000004
deviation-center-line_median0.05610305022565209
in-drivable-lane_median0.20000000000000007


other stats
agent_compute-ego_max0.14436832718227222
agent_compute-ego_mean0.13803187872805706
agent_compute-ego_median0.13868985857282365
agent_compute-ego_min0.12984036362689474
deviation-center-line_max0.07504669169058735
deviation-center-line_mean0.05629372528587068
deviation-center-line_min0.031337769455374115
deviation-heading_max0.4695314592890065
deviation-heading_mean0.28295632700130013
deviation-heading_median0.28969351082790473
deviation-heading_min0.13822734158708538
driven_any_max1.1972535692377095
driven_any_mean1.069550703128448
driven_any_median1.0381750331691957
driven_any_min1.0257183998178268
driven_lanedir_consec_max0.8123144800841251
driven_lanedir_consec_mean0.6312226729648216
driven_lanedir_consec_min0.4373052105850964
driven_lanedir_max0.9325407987545682
driven_lanedir_mean0.7224147694584564
driven_lanedir_median0.8123144800841251
driven_lanedir_min0.48318684247252186
in-drivable-lane_max0.6000000000000004
in-drivable-lane_mean0.3000000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.028239292757851735, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.05835379021508353, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.13868985857282365, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.07743999787739345, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.03449246713093349, "sim_compute_performance-ego": 0.05921737636838641, "sim_compute_robot_state-ego": 0.061884948185512, "sim_compute_robot_state-npc0": 0.06393229961395264, "sim_compute_robot_state-npc1": 0.05955977950777326, "sim_compute_robot_state-npc2": 0.05676474741527012, "sim_compute_robot_state-npc3": 0.06064833062035697}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.0267298420270284, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.05780742565790812, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.1367694934209188, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.07602615157763164, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03428611159324646, "sim_compute_performance-ego": 0.0599723756313324, "sim_compute_robot_state-ego": 0.05919752518335978, "sim_compute_robot_state-npc0": 0.07018223404884338, "sim_compute_robot_state-npc1": 0.060492744048436485, "sim_compute_robot_state-npc2": 0.06070790688196818, "sim_compute_robot_state-npc3": 0.0615135133266449}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.02934214343195376, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.06188486969989279, "in-drivable-lane": 0, "agent_compute-ego": 0.12984036362689474, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.08378354362819505, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.03385610165803329, "sim_compute_performance-ego": 0.06382551400557808, "sim_compute_robot_state-ego": 0.06244340150252632, "sim_compute_robot_state-npc0": 0.06814323300900667, "sim_compute_robot_state-npc1": 0.06150122310804284, "sim_compute_robot_state-npc2": 0.0601496696472168, "sim_compute_robot_state-npc3": 0.05974219156348187}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.02593206322711447, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.05973469692727794, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.14436832718227222, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.08253935109014096, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.034783850545468536, "sim_compute_performance-ego": 0.05952495077381963, "sim_compute_robot_state-ego": 0.06541082133417545, "sim_compute_robot_state-npc0": 0.06671406911767047, "sim_compute_robot_state-npc1": 0.06605247829271399, "sim_compute_robot_state-npc2": 0.06583307100378949, "sim_compute_robot_state-npc3": 0.06437988903211511}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.025411253390104874, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.061384823011315384, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1404913508373758, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.07342028617858887, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.03427886962890625, "sim_compute_performance-ego": 0.058184903600941536, "sim_compute_robot_state-ego": 0.06049544914909031, "sim_compute_robot_state-npc0": 0.06857467734295389, "sim_compute_robot_state-npc1": 0.06315065466839334, "sim_compute_robot_state-npc2": 0.06209173409835152, "sim_compute_robot_state-npc3": 0.05962842443714971}}
set_robot_commands_max0.08378354362819505
set_robot_commands_mean0.07864186607038999
set_robot_commands_median0.07743999787739345
set_robot_commands_min0.07342028617858887
sim_compute_performance-ego_max0.06382551400557808
sim_compute_performance-ego_mean0.06014502407601161
sim_compute_performance-ego_median0.05952495077381963
sim_compute_performance-ego_min0.058184903600941536
sim_compute_robot_state-ego_max0.06541082133417545
sim_compute_robot_state-ego_mean0.061886429070932766
sim_compute_robot_state-ego_median0.061884948185512
sim_compute_robot_state-ego_min0.05919752518335978
sim_compute_robot_state-npc0_max0.07018223404884338
sim_compute_robot_state-npc0_mean0.0675093026264854
sim_compute_robot_state-npc0_median0.06814323300900667
sim_compute_robot_state-npc0_min0.06393229961395264
sim_compute_robot_state-npc1_max0.06605247829271399
sim_compute_robot_state-npc1_mean0.062151375925071986
sim_compute_robot_state-npc1_median0.06150122310804284
sim_compute_robot_state-npc1_min0.05955977950777326
sim_compute_robot_state-npc2_max0.06583307100378949
sim_compute_robot_state-npc2_mean0.06110942580931922
sim_compute_robot_state-npc2_median0.06070790688196818
sim_compute_robot_state-npc2_min0.05676474741527012
sim_compute_robot_state-npc3_max0.06437988903211511
sim_compute_robot_state-npc3_mean0.06118246979594971
sim_compute_robot_state-npc3_median0.06064833062035697
sim_compute_robot_state-npc3_min0.05962842443714971
sim_compute_sim_state_max0.034783850545468536
sim_compute_sim_state_mean0.034339480111317607
sim_compute_sim_state_median0.03428611159324646
sim_compute_sim_state_min0.03385610165803329
sim_physics_max0.02934214343195376
sim_physics_mean0.02713091896681065
sim_physics_median0.0267298420270284
sim_physics_min0.025411253390104874
sim_render-ego_max0.06188486969989279
sim_render-ego_mean0.05983312110229555
sim_render-ego_median0.05973469692727794
sim_render-ego_min0.05780742565790812
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.2100000000000004
survival_time_min1.1500000000000004
No reset possible
176012421Andrea Censi 🇨🇭random_agentaido2-LFV-sim-validationstep1-simulationsuccessnoInstance20:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2342705027983982
survival_time_median1.7500000000000009
deviation-center-line_median0.10801953665034704
in-drivable-lane_median0.7000000000000004


other stats
agent_compute-ego_max0.13267850106762302
agent_compute-ego_mean0.12509031152488492
agent_compute-ego_median0.12213124547685895
agent_compute-ego_min0.1187561103275844
deviation-center-line_max0.17768774509810673
deviation-center-line_mean0.08758489727910898
deviation-center-line_min0.019005533143064354
deviation-heading_max0.759385645220147
deviation-heading_mean0.3195081252333424
deviation-heading_median0.1806788823983304
deviation-heading_min0.118601117425238
driven_any_max2.812198352312563
driven_any_mean1.6891781761410722
driven_any_median1.608242001486626
driven_any_min0.3130680825984642
driven_lanedir_consec_max1.7389031534183392
driven_lanedir_consec_mean0.9694700664283822
driven_lanedir_consec_min0.28316071129320397
driven_lanedir_max1.7389031534183392
driven_lanedir_mean0.9694700664283822
driven_lanedir_median1.2342705027983982
driven_lanedir_min0.28316071129320397
in-drivable-lane_max1.5999999999999988
in-drivable-lane_mean0.7299999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.021176514418228813, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06205087122709855, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.13178635680157205, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.075982259667438, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.03503957002059273, "sim_compute_performance-ego": 0.06071154967598293, "sim_compute_robot_state-ego": 0.06210903499437415, "sim_compute_robot_state-npc0": 0.07078907800757367, "sim_compute_robot_state-npc1": 0.062013833419136376, "sim_compute_robot_state-npc2": 0.0594553221826968, "sim_compute_robot_state-npc3": 0.06629249323969302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.024276321934115504, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.06553091156867243, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.13267850106762302, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.07687592506408691, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.03701063509910337, "sim_compute_performance-ego": 0.06537527422751149, "sim_compute_robot_state-ego": 0.06561601161956787, "sim_compute_robot_state-npc0": 0.07261018983779415, "sim_compute_robot_state-npc1": 0.06574425005143689, "sim_compute_robot_state-npc2": 0.065807496347735, "sim_compute_robot_state-npc3": 0.06627564276418378}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.02342186655317034, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.05727812222072056, "in-drivable-lane": 0, "agent_compute-ego": 0.12213124547685895, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.08170706885201591, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.03322533198765346, "sim_compute_performance-ego": 0.060286453792027066, "sim_compute_robot_state-ego": 0.06566766330174037, "sim_compute_robot_state-npc0": 0.06372189521789551, "sim_compute_robot_state-npc1": 0.05874075208391462, "sim_compute_robot_state-npc2": 0.05442040307181222, "sim_compute_robot_state-npc3": 0.057693583624703546}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.02208590507507324, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.05713189670017787, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.1187561103275844, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.07509560585021972, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.034144748960222515, "sim_compute_performance-ego": 0.06096679142543248, "sim_compute_robot_state-ego": 0.061524384362357, "sim_compute_robot_state-npc0": 0.0631648199898856, "sim_compute_robot_state-npc1": 0.06119400433131627, "sim_compute_robot_state-npc2": 0.062294292449951175, "sim_compute_robot_state-npc3": 0.06058504922049386}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.023170520388890822, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.05842046889047774, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.1200993439507863, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.07975154831295922, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.033491921803307914, "sim_compute_performance-ego": 0.06033531446305533, "sim_compute_robot_state-ego": 0.06296534765334356, "sim_compute_robot_state-npc0": 0.06453307848128062, "sim_compute_robot_state-npc1": 0.06358621990869916, "sim_compute_robot_state-npc2": 0.0621017577156188, "sim_compute_robot_state-npc3": 0.06081469853719076}}
set_robot_commands_max0.08170706885201591
set_robot_commands_mean0.07788248154934395
set_robot_commands_median0.07687592506408691
set_robot_commands_min0.07509560585021972
sim_compute_performance-ego_max0.06537527422751149
sim_compute_performance-ego_mean0.06153507671680186
sim_compute_performance-ego_median0.06071154967598293
sim_compute_performance-ego_min0.060286453792027066
sim_compute_robot_state-ego_max0.06566766330174037
sim_compute_robot_state-ego_mean0.06357648838627658
sim_compute_robot_state-ego_median0.06296534765334356
sim_compute_robot_state-ego_min0.061524384362357
sim_compute_robot_state-npc0_max0.07261018983779415
sim_compute_robot_state-npc0_mean0.0669638123068859
sim_compute_robot_state-npc0_median0.06453307848128062
sim_compute_robot_state-npc0_min0.0631648199898856
sim_compute_robot_state-npc1_max0.06574425005143689
sim_compute_robot_state-npc1_mean0.06225581195890066
sim_compute_robot_state-npc1_median0.062013833419136376
sim_compute_robot_state-npc1_min0.05874075208391462
sim_compute_robot_state-npc2_max0.065807496347735
sim_compute_robot_state-npc2_mean0.06081585435356281
sim_compute_robot_state-npc2_median0.0621017577156188
sim_compute_robot_state-npc2_min0.05442040307181222
sim_compute_robot_state-npc3_max0.06629249323969302
sim_compute_robot_state-npc3_mean0.062332293477252984
sim_compute_robot_state-npc3_median0.06081469853719076
sim_compute_robot_state-npc3_min0.057693583624703546
sim_compute_sim_state_max0.03701063509910337
sim_compute_sim_state_mean0.03458244157417599
sim_compute_sim_state_median0.034144748960222515
sim_compute_sim_state_min0.03322533198765346
sim_physics_max0.024276321934115504
sim_physics_mean0.022826225673895743
sim_physics_median0.023170520388890822
sim_physics_min0.021176514418228813
sim_render-ego_max0.06553091156867243
sim_render-ego_mean0.06008245412142943
sim_render-ego_median0.05842046889047774
sim_render-ego_min0.05713189670017787
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean1.899999999999999
survival_time_min0.35
No reset possible