Duckietown Challenges Home Challenges Submissions

Evaluator 896

ID896
evaluatoridsc-rudolf-12355
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-12355
versiond-c:4.0.25;d-c-r:4.0.31;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success1 21654
# timeout1 21687
# failed
# error1 21643
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
216872964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationtimeoutnoidsc-rudolf-123551:05:37
I can see how the jo [...]
I can see how the job 21687 is timeout because passed 3937 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
216542660Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-123550:47:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6585860509100432
survival_time_median6.449999999999985
deviation-center-line_median0.6318672715294984
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.0735366809239026
agent_compute-ego_mean0.07138984551557831
agent_compute-ego_median0.07159793456395468
agent_compute-ego_min0.06811601775033134
deviation-center-line_max1.28363462990207
deviation-center-line_mean0.5953965537737947
deviation-center-line_min0.13087440182364257
deviation-heading_max7.748766095161664
deviation-heading_mean3.194460486662275
deviation-heading_median2.0790328120040615
deviation-heading_min0.5389415647956504
driven_any_max2.348839797869971
driven_any_mean1.265657174608426
driven_any_median0.982961665059313
driven_any_min0.1713829686606922
driven_lanedir_consec_max1.35263348080637
driven_lanedir_consec_mean0.6777040953786695
driven_lanedir_consec_min0.14492173049252566
driven_lanedir_max1.8658797157489668
driven_lanedir_mean0.979248344891088
driven_lanedir_median0.961371430861022
driven_lanedir_min0.14492173049252566
in-drivable-lane_max2.700000000000019
in-drivable-lane_mean0.7466666666666723
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.155317987580848, "sim_physics": 0.11728686718303805, "survival_time": 13.850000000000062, "driven_lanedir": 1.7406049446494365, "sim_render-ego": 0.06898057934179203, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.0735366809239026, "deviation-heading": 5.33920427360572, "set_robot_commands": 0.07719724789423202, "deviation-center-line": 0.903104600371473, "driven_lanedir_consec": 0.9957741303811068, "sim_compute_sim_state": 0.04055017770842955, "sim_compute_performance-ego": 0.06934028842388938, "sim_compute_robot_state-ego": 0.06447670347854119, "sim_compute_robot_state-npc0": 0.07658836127188232, "sim_compute_robot_state-npc1": 0.07294702874193984, "sim_compute_robot_state-npc2": 0.07116433773660488, "sim_compute_robot_state-npc3": 0.07184034650506525}, "udem1-1-0": {"driven_any": 0.7177127159371829, "sim_physics": 0.11631961166858672, "survival_time": 4.799999999999991, "driven_lanedir": 0.5980456768737374, "sim_render-ego": 0.06861465175946553, "in-drivable-lane": 0, "agent_compute-ego": 0.07334905117750168, "deviation-heading": 2.0790328120040615, "set_robot_commands": 0.07574713478485744, "deviation-center-line": 0.22077281627786863, "driven_lanedir_consec": 0.5980456768737374, "sim_compute_sim_state": 0.04009439547856649, "sim_compute_performance-ego": 0.06850325564543407, "sim_compute_robot_state-ego": 0.06320743262767792, "sim_compute_robot_state-npc0": 0.07685285309950511, "sim_compute_robot_state-npc1": 0.0719053049882253, "sim_compute_robot_state-npc2": 0.07205479840437572, "sim_compute_robot_state-npc3": 0.07203877468903859}, "udem1-2-0": {"driven_any": 2.3248294717645988, "sim_physics": 0.11152932772765288, "survival_time": 14.800000000000075, "driven_lanedir": 1.8658797157489668, "sim_render-ego": 0.06660001906188759, "in-drivable-lane": 1.1000000000000068, "agent_compute-ego": 0.07202715245453087, "deviation-heading": 5.946982316300223, "set_robot_commands": 0.07650439723117931, "deviation-center-line": 0.9953660171301444, "driven_lanedir_consec": 1.2171090465671028, "sim_compute_sim_state": 0.04017484832454373, "sim_compute_performance-ego": 0.06844973483601131, "sim_compute_robot_state-ego": 0.06376857773677723, "sim_compute_robot_state-npc0": 0.07617302279214601, "sim_compute_robot_state-npc1": 0.07125411645786182, "sim_compute_robot_state-npc2": 0.0715827627761944, "sim_compute_robot_state-npc3": 0.07188578956835978}, "udem1-3-0": {"driven_any": 0.23562820064526988, "sim_physics": 0.12084318531884088, "survival_time": 1.800000000000001, "driven_lanedir": 0.21406932262140657, "sim_render-ego": 0.06670710775587294, "in-drivable-lane": 0, "agent_compute-ego": 0.07166135973400539, "deviation-heading": 0.5389415647956504, "set_robot_commands": 0.0755069719420539, "deviation-center-line": 0.16255302234825245, "driven_lanedir_consec": 0.21406932262140657, "sim_compute_sim_state": 0.03940002123514811, "sim_compute_performance-ego": 0.06643342309527928, "sim_compute_robot_state-ego": 0.062464886241488986, "sim_compute_robot_state-npc0": 0.07684671216540867, "sim_compute_robot_state-npc1": 0.06924511988957723, "sim_compute_robot_state-npc2": 0.06940372784932454, "sim_compute_robot_state-npc3": 0.06968447897169325}, "udem1-4-0": {"driven_any": 2.348839797869971, "sim_physics": 0.11486336469650268, "survival_time": 14.950000000000076, "driven_lanedir": 1.6976623297462876, "sim_render-ego": 0.06849059104919433, "in-drivable-lane": 2.4500000000000313, "agent_compute-ego": 0.07199657360712687, "deviation-heading": 5.080466929424764, "set_robot_commands": 0.07647521336873372, "deviation-center-line": 1.0044778117277442, "driven_lanedir_consec": 1.35263348080637, "sim_compute_sim_state": 0.03912551720937093, "sim_compute_performance-ego": 0.06894409735997518, "sim_compute_robot_state-ego": 0.06427804946899414, "sim_compute_robot_state-npc0": 0.0761616333325704, "sim_compute_robot_state-npc1": 0.07055832068125407, "sim_compute_robot_state-npc2": 0.07017587820688884, "sim_compute_robot_state-npc3": 0.06981698274612427}, "udem1-5-0": {"driven_any": 2.3487451495339076, "sim_physics": 0.10958864053090411, "survival_time": 14.950000000000076, "driven_lanedir": 1.82222726098947, "sim_render-ego": 0.06662001848220825, "in-drivable-lane": 1.1000000000000023, "agent_compute-ego": 0.07023915688196818, "deviation-heading": 6.340760850491856, "set_robot_commands": 0.07426167011260987, "deviation-center-line": 1.28363462990207, "driven_lanedir_consec": 0.9037777703276112, "sim_compute_sim_state": 0.038219676812489826, "sim_compute_performance-ego": 0.0675146230061849, "sim_compute_robot_state-ego": 0.06271129528681438, "sim_compute_robot_state-npc0": 0.07434632062911987, "sim_compute_robot_state-npc1": 0.0696190865834554, "sim_compute_robot_state-npc2": 0.06781532605489095, "sim_compute_robot_state-npc3": 0.06910140514373779}, "udem1-6-0": {"driven_any": 0.982961665059313, "sim_physics": 0.1253899326620176, "survival_time": 6.449999999999985, "driven_lanedir": 0.961371430861022, "sim_render-ego": 0.06830179044442583, "in-drivable-lane": 0, "agent_compute-ego": 0.07248354327771091, "deviation-heading": 1.096688835456738, "set_robot_commands": 0.07692664907884228, "deviation-center-line": 0.6508572565190109, "driven_lanedir_consec": 0.9469038102108096, "sim_compute_sim_state": 0.04027274597522824, "sim_compute_performance-ego": 0.06896771386612294, "sim_compute_robot_state-ego": 0.06452051059220189, "sim_compute_robot_state-npc0": 0.07621253553287004, "sim_compute_robot_state-npc1": 0.07171267317247021, "sim_compute_robot_state-npc2": 0.07110037175259849, "sim_compute_robot_state-npc3": 0.0707829571509546}, "udem1-7-0": {"driven_any": 0.4445503490002461, "sim_physics": 0.12906939368094167, "survival_time": 3.099999999999997, "driven_lanedir": 0.38105721765598455, "sim_render-ego": 0.06676703114663401, "in-drivable-lane": 0, "agent_compute-ego": 0.07275825931179908, "deviation-heading": 1.4008636910147092, "set_robot_commands": 0.07584104614873086, "deviation-center-line": 0.15300821031748807, "driven_lanedir_consec": 0.38105721765598455, "sim_compute_sim_state": 0.04009152612378521, "sim_compute_performance-ego": 0.06872272106908983, "sim_compute_robot_state-ego": 0.06381822016931349, "sim_compute_robot_state-npc0": 0.07545455425016341, "sim_compute_robot_state-npc1": 0.07089886742253457, "sim_compute_robot_state-npc2": 0.06986088522018925, "sim_compute_robot_state-npc3": 0.07049395961146201}, "udem1-8-0": {"driven_any": 2.3483652501727836, "sim_physics": 0.11412141799926756, "survival_time": 14.950000000000076, "driven_lanedir": 1.4569077894106908, "sim_render-ego": 0.06746369441350301, "in-drivable-lane": 2.450000000000014, "agent_compute-ego": 0.07065024693806966, "deviation-heading": 7.748766095161664, "set_robot_commands": 0.075206565062205, "deviation-center-line": 1.2692946643958156, "driven_lanedir_consec": 0.7630342975689666, "sim_compute_sim_state": 0.039058621724446616, "sim_compute_performance-ego": 0.06715850830078125, "sim_compute_robot_state-ego": 0.0638776691754659, "sim_compute_robot_state-npc0": 0.07523134469985962, "sim_compute_robot_state-npc1": 0.07049387693405151, "sim_compute_robot_state-npc2": 0.06987578630447387, "sim_compute_robot_state-npc3": 0.07032716433207194}, "udem1-9-0": {"driven_any": 0.5570694762276293, "sim_physics": 0.12409274201644094, "survival_time": 3.7999999999999945, "driven_lanedir": 0.4594283421127783, "sim_render-ego": 0.06830000877380371, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.07146333707006354, "deviation-heading": 0.9765112153310744, "set_robot_commands": 0.07548181006782934, "deviation-center-line": 0.20082762680237023, "driven_lanedir_consec": 0.4594283421127783, "sim_compute_sim_state": 0.037957605562712014, "sim_compute_performance-ego": 0.06790639538513987, "sim_compute_robot_state-ego": 0.06408377070175975, "sim_compute_robot_state-npc0": 0.07624468364213642, "sim_compute_robot_state-npc1": 0.07079130411148071, "sim_compute_robot_state-npc2": 0.06978674625095568, "sim_compute_robot_state-npc3": 0.07056316262797306}, "udem1-10-0": {"driven_any": 1.3847089445909595, "sim_physics": 0.11105441381145456, "survival_time": 8.949999999999992, "driven_lanedir": 1.1787787910005805, "sim_render-ego": 0.06734961637571538, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.07034205990796649, "deviation-heading": 3.8869234511169974, "set_robot_commands": 0.07388033547214956, "deviation-center-line": 0.6318672715294984, "driven_lanedir_consec": 0.6585860509100432, "sim_compute_sim_state": 0.03865552214936837, "sim_compute_performance-ego": 0.06766383741155017, "sim_compute_robot_state-ego": 0.06155868349128595, "sim_compute_robot_state-npc0": 0.07309535761785241, "sim_compute_robot_state-npc1": 0.06919563282801452, "sim_compute_robot_state-npc2": 0.06922379818708536, "sim_compute_robot_state-npc3": 0.06782132953238887}, "udem1-11-0": {"driven_any": 0.1713829686606922, "sim_physics": 0.11101981571742468, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14492173049252566, "sim_render-ego": 0.06281204734529768, "in-drivable-lane": 0, "agent_compute-ego": 0.06811601775033134, "deviation-heading": 0.5712174718514345, "set_robot_commands": 0.07343122788837977, "deviation-center-line": 0.13087440182364257, "driven_lanedir_consec": 0.14492173049252566, "sim_compute_sim_state": 0.03419227259499686, "sim_compute_performance-ego": 0.06544939960752215, "sim_compute_robot_state-ego": 0.06136324575969151, "sim_compute_robot_state-npc0": 0.07032916375568934, "sim_compute_robot_state-npc1": 0.06514334678649902, "sim_compute_robot_state-npc2": 0.06248252732413156, "sim_compute_robot_state-npc3": 0.06222690003258841}, "udem1-12-0": {"driven_any": 0.3883143837714607, "sim_physics": 0.12085467685352672, "survival_time": 2.7499999999999982, "driven_lanedir": 0.34204159591430194, "sim_render-ego": 0.0624712120402943, "in-drivable-lane": 0, "agent_compute-ego": 0.07069113037802956, "deviation-heading": 1.0463869275497235, "set_robot_commands": 0.07359603968533603, "deviation-center-line": 0.16931730481476442, "driven_lanedir_consec": 0.34204159591430194, "sim_compute_sim_state": 0.03734413493763317, "sim_compute_performance-ego": 0.06113097017461604, "sim_compute_robot_state-ego": 0.05850266543301669, "sim_compute_robot_state-npc0": 0.07049726139415394, "sim_compute_robot_state-npc1": 0.0668673645366322, "sim_compute_robot_state-npc2": 0.06538595286282627, "sim_compute_robot_state-npc3": 0.0660014889457009}, "udem1-13-0": {"driven_any": 0.22760420548582924, "sim_physics": 0.11053159577505928, "survival_time": 1.7500000000000009, "driven_lanedir": 0.18229137703644183, "sim_render-ego": 0.0700960772378104, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.06993517875671387, "deviation-heading": 0.5616962351227285, "set_robot_commands": 0.07473186084202357, "deviation-center-line": 0.1436689677541819, "driven_lanedir_consec": 0.18229137703644183, "sim_compute_sim_state": 0.038654116221836635, "sim_compute_performance-ego": 0.06843647956848145, "sim_compute_robot_state-ego": 0.06173600469316755, "sim_compute_robot_state-npc0": 0.07753605161394392, "sim_compute_robot_state-npc1": 0.0734236444745745, "sim_compute_robot_state-npc2": 0.07266966274806431, "sim_compute_robot_state-npc3": 0.06999591418675014}, "udem1-14-0": {"driven_any": 2.3488270528256985, "sim_physics": 0.1223605751991272, "survival_time": 14.950000000000076, "driven_lanedir": 1.6434376482526891, "sim_render-ego": 0.06622992595036825, "in-drivable-lane": 2.700000000000019, "agent_compute-ego": 0.07159793456395468, "deviation-heading": 5.302464630706775, "set_robot_commands": 0.07541493892669678, "deviation-center-line": 1.011323704892598, "driven_lanedir_consec": 1.005887581200856, "sim_compute_sim_state": 0.03863284587860107, "sim_compute_performance-ego": 0.06821941296259562, "sim_compute_robot_state-ego": 0.06340009133021036, "sim_compute_robot_state-npc0": 0.07444586833318075, "sim_compute_robot_state-npc1": 0.06952916781107585, "sim_compute_robot_state-npc2": 0.0685656754175822, "sim_compute_robot_state-npc3": 0.06884191354115804}}
set_robot_commands_max0.07719724789423202
set_robot_commands_mean0.07534687390039063
set_robot_commands_median0.07548181006782934
set_robot_commands_min0.07343122788837977
sim_compute_performance-ego_max0.06934028842388938
sim_compute_performance-ego_mean0.06752272404751156
sim_compute_performance-ego_median0.06821941296259562
sim_compute_performance-ego_min0.06113097017461604
sim_compute_robot_state-ego_max0.06452051059220189
sim_compute_robot_state-ego_mean0.06291785374576046
sim_compute_robot_state-ego_median0.06340009133021036
sim_compute_robot_state-ego_min0.05850266543301669
sim_compute_robot_state-npc0_max0.07753605161394392
sim_compute_robot_state-npc0_mean0.07506771494203214
sim_compute_robot_state-npc0_median0.0761616333325704
sim_compute_robot_state-npc0_min0.07032916375568934
sim_compute_robot_state-npc1_max0.0734236444745745
sim_compute_robot_state-npc1_mean0.07023899036130979
sim_compute_robot_state-npc1_median0.07055832068125407
sim_compute_robot_state-npc1_min0.06514334678649902
sim_compute_robot_state-npc2_max0.07266966274806431
sim_compute_robot_state-npc2_mean0.06940988247307908
sim_compute_robot_state-npc2_median0.06986088522018925
sim_compute_robot_state-npc2_min0.06248252732413156
sim_compute_robot_state-npc3_max0.07203877468903859
sim_compute_robot_state-npc3_mean0.06942817117233778
sim_compute_robot_state-npc3_median0.06999591418675014
sim_compute_robot_state-npc3_min0.06222690003258841
sim_compute_sim_state_max0.04055017770842955
sim_compute_sim_state_mean0.03882826852914379
sim_compute_sim_state_median0.039058621724446616
sim_compute_sim_state_min0.03419227259499686
sim_physics_max0.12906939368094167
sim_physics_mean0.1172617040560524
sim_physics_median0.11631961166858672
sim_physics_min0.10958864053090411
sim_render-ego_max0.0700960772378104
sim_render-ego_mean0.06705362474521821
sim_render-ego_median0.06734961637571538
sim_render-ego_min0.0624712120402943
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.216666666666693
survival_time_min1.4000000000000006
No reset possible
216433262Sean LuBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-123550:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible