Duckietown Challenges Home Challenges Submissions

Evaluator 646

ID646
evaluatoridsc-rudolf-4752
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-4752
versiond-c:4.0.14;d-c-r:4.0.19;d-s:4.0.15
first heard
last heard
statusinactive
# evaluating
# success6 17634
# timeout
# failed
# error2 17650
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
177032459Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-47520:05:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24485310743273692
survival_time_median1.0000000000000002
deviation-center-line_median0.02780957766589444
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.16400431817577732
agent_compute-ego_mean0.1575336887901732
agent_compute-ego_median0.15771342515945436
agent_compute-ego_min0.1492142817553352
deviation-center-line_max0.1367821242164622
deviation-center-line_mean0.05703768142247749
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792059
deviation-heading_mean0.33854872313755296
deviation-heading_median0.3074760381865352
deviation-heading_min0.16993642764665506
driven_any_max0.9094890302704578
driven_any_mean0.6148172530722962
driven_any_median0.5457640496143875
driven_any_min0.30227389810048894
driven_lanedir_consec_max0.797287526441987
driven_lanedir_consec_mean0.4211897171247365
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.797287526441987
driven_lanedir_mean0.4229139258079286
driven_lanedir_median0.24485310743273692
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.020916569232940673, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.06789758205413818, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.15771342515945436, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.08549193143844605, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.036719441413879395, "sim_compute_performance-ego": 0.06705954074859619, "sim_compute_robot_state-ego": 0.0650475263595581, "sim_compute_robot_state-npc0": 0.07532153129577637, "sim_compute_robot_state-npc1": 0.07049452066421509, "sim_compute_robot_state-npc2": 0.06994814872741699, "sim_compute_robot_state-npc3": 0.06699360609054565}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126896, "sim_physics": 0.023333283031688017, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120295193918956, "sim_render-ego": 0.06588614688200109, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.1492142817553352, "deviation-heading": 0.3074760381865352, "set_robot_commands": 0.07791709899902344, "deviation-center-line": 0.02399911835622947, "driven_lanedir_consec": 0.17258190852322874, "sim_compute_sim_state": 0.04100296076606302, "sim_compute_performance-ego": 0.06580617848564596, "sim_compute_robot_state-ego": 0.06387849415049833, "sim_compute_robot_state-npc0": 0.07563665333916159, "sim_compute_robot_state-npc1": 0.06872834878809311, "sim_compute_robot_state-npc2": 0.07076483614304487, "sim_compute_robot_state-npc3": 0.0736235029557172}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30227389810048894, "sim_physics": 0.02556602954864502, "survival_time": 0.49999999999999994, "driven_lanedir": 0.24485310743273692, "sim_render-ego": 0.0719517707824707, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.16070244312286378, "deviation-heading": 0.16993642764665506, "set_robot_commands": 0.07677574157714843, "deviation-center-line": 0.02780957766589444, "driven_lanedir_consec": 0.24485310743273692, "sim_compute_sim_state": 0.0381662368774414, "sim_compute_performance-ego": 0.0658583402633667, "sim_compute_robot_state-ego": 0.06151072978973389, "sim_compute_robot_state-npc0": 0.07107658386230468, "sim_compute_robot_state-npc1": 0.06815474033355713, "sim_compute_robot_state-npc2": 0.06858136653900146, "sim_compute_robot_state-npc3": 0.06917121410369872}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.02339948926653181, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.06959158182144165, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1560339757374355, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.07674693209784371, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.03720099585396903, "sim_compute_performance-ego": 0.06614249093191964, "sim_compute_robot_state-ego": 0.06476162161145892, "sim_compute_robot_state-npc0": 0.07463618687220983, "sim_compute_robot_state-npc1": 0.07021764346531459, "sim_compute_robot_state-npc2": 0.07068801777703422, "sim_compute_robot_state-npc3": 0.06938648223876953}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704578, "sim_physics": 0.021940385141680317, "survival_time": 1.5500000000000007, "driven_lanedir": 0.797287526441987, "sim_render-ego": 0.06823452826469176, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.16400431817577732, "deviation-heading": 0.6295143987792059, "set_robot_commands": 0.07910564637953235, "deviation-center-line": 0.1367821242164622, "driven_lanedir_consec": 0.797287526441987, "sim_compute_sim_state": 0.03889099244148501, "sim_compute_performance-ego": 0.06594613290602161, "sim_compute_robot_state-ego": 0.06670158140120967, "sim_compute_robot_state-npc0": 0.07262099173761183, "sim_compute_robot_state-npc1": 0.06932303982396279, "sim_compute_robot_state-npc2": 0.06810602834147791, "sim_compute_robot_state-npc3": 0.06720025308670537}}
set_robot_commands_max0.08549193143844605
set_robot_commands_mean0.07920747009839879
set_robot_commands_median0.07791709899902344
set_robot_commands_min0.07674693209784371
sim_compute_performance-ego_max0.06705954074859619
sim_compute_performance-ego_mean0.06616253666711003
sim_compute_performance-ego_median0.06594613290602161
sim_compute_performance-ego_min0.06580617848564596
sim_compute_robot_state-ego_max0.06670158140120967
sim_compute_robot_state-ego_mean0.06437999066249178
sim_compute_robot_state-ego_median0.06476162161145892
sim_compute_robot_state-ego_min0.06151072978973389
sim_compute_robot_state-npc0_max0.07563665333916159
sim_compute_robot_state-npc0_mean0.07385838942141285
sim_compute_robot_state-npc0_median0.07463618687220983
sim_compute_robot_state-npc0_min0.07107658386230468
sim_compute_robot_state-npc1_max0.07049452066421509
sim_compute_robot_state-npc1_mean0.06938365861502856
sim_compute_robot_state-npc1_median0.06932303982396279
sim_compute_robot_state-npc1_min0.06815474033355713
sim_compute_robot_state-npc2_max0.07076483614304487
sim_compute_robot_state-npc2_mean0.0696176795055951
sim_compute_robot_state-npc2_median0.06994814872741699
sim_compute_robot_state-npc2_min0.06810602834147791
sim_compute_robot_state-npc3_max0.0736235029557172
sim_compute_robot_state-npc3_mean0.06927501169508729
sim_compute_robot_state-npc3_median0.06917121410369872
sim_compute_robot_state-npc3_min0.06699360609054565
sim_compute_sim_state_max0.04100296076606302
sim_compute_sim_state_mean0.038396125470567574
sim_compute_sim_state_median0.0381662368774414
sim_compute_sim_state_min0.036719441413879395
sim_physics_max0.02556602954864502
sim_physics_mean0.02303115124429717
sim_physics_median0.023333283031688017
sim_physics_min0.020916569232940673
sim_render-ego_max0.0719517707824707
sim_render-ego_mean0.06871232196094867
sim_render-ego_median0.06823452826469176
sim_render-ego_min0.06588614688200109
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
176962468Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-47520:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.15639853477478027
agent_compute-ego_mean0.15047675553443451
agent_compute-ego_median0.15010802312330765
agent_compute-ego_min0.14575891909391983
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.013257057770438816, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06781291961669922, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.14705792717311694, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.08066686340000319, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.04307681581248408, "sim_compute_performance-ego": 0.06672325341597847, "sim_compute_robot_state-ego": 0.06688153225442638}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.012691145357878311, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.06445617261140243, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.14575891909391983, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07731147434400476, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.04046388294385827, "sim_compute_performance-ego": 0.065028366835221, "sim_compute_robot_state-ego": 0.0648812833039657}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.01297625628384677, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.06784644993868741, "in-drivable-lane": 0, "agent_compute-ego": 0.15010802312330765, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.0804687196558172, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.04100309718738903, "sim_compute_performance-ego": 0.06852091442454945, "sim_compute_robot_state-ego": 0.06846225261688232}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.01381230354309082, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.07044251759847005, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.15639853477478027, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.07842943403455946, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.04220085673862033, "sim_compute_performance-ego": 0.06559885872734918, "sim_compute_robot_state-ego": 0.06528017255995008}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.012770138288799086, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.07122578118976794, "in-drivable-lane": 0, "agent_compute-ego": 0.15306037350704796, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.07930428103396767, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.04483473928351151, "sim_compute_performance-ego": 0.06798469392876876, "sim_compute_robot_state-ego": 0.06916220564591258}}
set_robot_commands_max0.08066686340000319
set_robot_commands_mean0.07923615449367045
set_robot_commands_median0.07930428103396767
set_robot_commands_min0.07731147434400476
sim_compute_performance-ego_max0.06852091442454945
sim_compute_performance-ego_mean0.06677121746637336
sim_compute_performance-ego_median0.06672325341597847
sim_compute_performance-ego_min0.065028366835221
sim_compute_robot_state-ego_max0.06916220564591258
sim_compute_robot_state-ego_mean0.06693348927622741
sim_compute_robot_state-ego_median0.06688153225442638
sim_compute_robot_state-ego_min0.0648812833039657
sim_compute_sim_state_max0.04483473928351151
sim_compute_sim_state_mean0.04231587839317265
sim_compute_sim_state_median0.04220085673862033
sim_compute_sim_state_min0.04046388294385827
sim_physics_max0.01381230354309082
sim_physics_mean0.01310138024881076
sim_physics_median0.01297625628384677
sim_physics_min0.012691145357878311
sim_render-ego_max0.07122578118976794
sim_render-ego_mean0.0683567681910054
sim_render-ego_median0.06784644993868741
sim_render-ego_min0.06445617261140243
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible
176922504Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-47520:00:52
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176822492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-47520:03:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.11787311293556813
survival_time_median0.4
deviation-center-line_median0.02177412971850603
in-drivable-lane_median0


other stats
agent_compute-ego_max0.30548157010759625
agent_compute-ego_mean0.20160602671759467
agent_compute-ego_median0.17867544293403623
agent_compute-ego_min0.15697327256202698
deviation-center-line_max0.02517309714575105
deviation-center-line_mean0.02199318274869947
deviation-center-line_min0.018961942504283437
deviation-heading_max0.28143234419472074
deviation-heading_mean0.25528562897268453
deviation-heading_median0.26267943750409495
deviation-heading_min0.2210431519676657
driven_any_max0.1925227572200348
driven_any_mean0.17734052607740508
driven_any_median0.17725761743492635
driven_any_min0.1645251905193902
driven_lanedir_consec_max0.1263723516629427
driven_lanedir_consec_mean0.11897529831373252
driven_lanedir_consec_min0.11285378639359056
driven_lanedir_max0.1263723516629427
driven_lanedir_mean0.11897529831373252
driven_lanedir_median0.11787311293556813
driven_lanedir_min0.11285378639359056
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1645251905193902, "sim_physics": 0.012237344469342912, "survival_time": 0.35, "driven_lanedir": 0.11410379493788714, "sim_render-ego": 0.060837745666503906, "in-drivable-lane": 0, "agent_compute-ego": 0.30548157010759625, "deviation-heading": 0.2210431519676657, "set_robot_commands": 0.0737668786730085, "deviation-center-line": 0.019451886418531187, "driven_lanedir_consec": 0.11410379493788714, "sim_compute_sim_state": 0.03374089513506208, "sim_compute_performance-ego": 0.057050739015851705, "sim_compute_robot_state-ego": 0.05842760631016323}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1791029724409935, "sim_physics": 0.013644039630889893, "survival_time": 0.4, "driven_lanedir": 0.11787311293556813, "sim_render-ego": 0.059360116720199585, "in-drivable-lane": 0, "agent_compute-ego": 0.15697327256202698, "deviation-heading": 0.26267943750409495, "set_robot_commands": 0.07897555828094482, "deviation-center-line": 0.018961942504283437, "driven_lanedir_consec": 0.11787311293556813, "sim_compute_sim_state": 0.03847521543502808, "sim_compute_performance-ego": 0.0677361786365509, "sim_compute_robot_state-ego": 0.06396999955177307}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1925227572200348, "sim_physics": 0.01290801167488098, "survival_time": 0.4, "driven_lanedir": 0.1263723516629427, "sim_render-ego": 0.059503912925720215, "in-drivable-lane": 0, "agent_compute-ego": 0.17867544293403623, "deviation-heading": 0.26782645789139414, "set_robot_commands": 0.07844814658164978, "deviation-center-line": 0.024604857956425665, "driven_lanedir_consec": 0.1263723516629427, "sim_compute_sim_state": 0.04126310348510742, "sim_compute_performance-ego": 0.062101662158966064, "sim_compute_robot_state-ego": 0.06897741556167603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17725761743492635, "sim_physics": 0.014254927635192873, "survival_time": 0.4, "driven_lanedir": 0.11285378639359056, "sim_render-ego": 0.06659549474716187, "in-drivable-lane": 0, "agent_compute-ego": 0.1968514621257782, "deviation-heading": 0.28143234419472074, "set_robot_commands": 0.08270567655563354, "deviation-center-line": 0.02517309714575105, "driven_lanedir_consec": 0.11285378639359056, "sim_compute_sim_state": 0.040944576263427734, "sim_compute_performance-ego": 0.06359240412712097, "sim_compute_robot_state-ego": 0.06416851282119751}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17329409277168062, "sim_physics": 0.016082406044006348, "survival_time": 0.4, "driven_lanedir": 0.1236734456386741, "sim_render-ego": 0.07065975666046143, "in-drivable-lane": 0, "agent_compute-ego": 0.17004838585853577, "deviation-heading": 0.24344675330554727, "set_robot_commands": 0.07551705837249756, "deviation-center-line": 0.02177412971850603, "driven_lanedir_consec": 0.1236734456386741, "sim_compute_sim_state": 0.039920151233673096, "sim_compute_performance-ego": 0.06402626633644104, "sim_compute_robot_state-ego": 0.0653512179851532}}
set_robot_commands_max0.08270567655563354
set_robot_commands_mean0.07788266369274685
set_robot_commands_median0.07844814658164978
set_robot_commands_min0.0737668786730085
sim_compute_performance-ego_max0.0677361786365509
sim_compute_performance-ego_mean0.06290145005498612
sim_compute_performance-ego_median0.06359240412712097
sim_compute_performance-ego_min0.057050739015851705
sim_compute_robot_state-ego_max0.06897741556167603
sim_compute_robot_state-ego_mean0.0641789504459926
sim_compute_robot_state-ego_median0.06416851282119751
sim_compute_robot_state-ego_min0.05842760631016323
sim_compute_sim_state_max0.04126310348510742
sim_compute_sim_state_mean0.03886878831045968
sim_compute_sim_state_median0.039920151233673096
sim_compute_sim_state_min0.03374089513506208
sim_physics_max0.016082406044006348
sim_physics_mean0.0138253458908626
sim_physics_median0.013644039630889893
sim_physics_min0.012237344469342912
sim_render-ego_max0.07065975666046143
sim_render-ego_mean0.0633914053440094
sim_render-ego_median0.060837745666503906
sim_render-ego_min0.059360116720199585
simulation-passed1
survival_time_max0.4
survival_time_mean0.39
survival_time_min0.35
No reset possible
176652492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-47520:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1658098482451782
survival_time_median2.1500000000000004
deviation-center-line_median0.048489005492847626
in-drivable-lane_median1.0999999999999996


other stats
agent_compute-ego_max0.20745041370391845
agent_compute-ego_mean0.19367362719534204
agent_compute-ego_median0.2003337784511287
agent_compute-ego_min0.1658772535102312
deviation-center-line_max0.06326675034053543
deviation-center-line_mean0.036285933989915545
deviation-center-line_min0.004816268965194883
deviation-heading_max1.5022809567796138
deviation-heading_mean0.8212203384580773
deviation-heading_median0.7416603496188637
deviation-heading_min0.19622713250710683
driven_any_max1.0258162963185806
driven_any_mean0.5539385637630232
driven_any_median0.5090569455011766
driven_any_min0.11892137172632004
driven_lanedir_consec_max0.32818233145133435
driven_lanedir_consec_mean0.17289575253075662
driven_lanedir_consec_min0.01982263499432335
driven_lanedir_max0.32818233145133435
driven_lanedir_mean0.17289575253075662
driven_lanedir_median0.1658098482451782
driven_lanedir_min0.01982263499432335
in-drivable-lane_max2.199999999999996
in-drivable-lane_mean1.1499999999999984
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1331364770096155, "sim_physics": 0.015234202146530151, "survival_time": 0.4, "driven_lanedir": 0.04756923610105801, "sim_render-ego": 0.059277892112731934, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.19007045030593872, "deviation-heading": 0.2305378554498448, "set_robot_commands": 0.07142427563667297, "deviation-center-line": 0.009251223765857025, "driven_lanedir_consec": 0.04756923610105801, "sim_compute_sim_state": 0.03511747717857361, "sim_compute_performance-ego": 0.05875939130783081, "sim_compute_robot_state-ego": 0.0589621365070343}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5090569455011766, "sim_physics": 0.014010290766871252, "survival_time": 2.1500000000000004, "driven_lanedir": 0.1658098482451782, "sim_render-ego": 0.06801366806030273, "in-drivable-lane": 1.0999999999999996, "agent_compute-ego": 0.1658772535102312, "deviation-heading": 0.7416603496188637, "set_robot_commands": 0.07831770874733149, "deviation-center-line": 0.048489005492847626, "driven_lanedir_consec": 0.1658098482451782, "sim_compute_sim_state": 0.042925806932671125, "sim_compute_performance-ego": 0.06589148765386538, "sim_compute_robot_state-ego": 0.0676351647044337}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9827617282594234, "sim_physics": 0.01416290969383426, "survival_time": 4.099999999999993, "driven_lanedir": 0.3030947118618892, "sim_render-ego": 0.06131550160849967, "in-drivable-lane": 2.099999999999996, "agent_compute-ego": 0.2003337784511287, "deviation-heading": 1.435395397934957, "set_robot_commands": 0.07760485207162253, "deviation-center-line": 0.05560642138514274, "driven_lanedir_consec": 0.3030947118618892, "sim_compute_sim_state": 0.039917669645169886, "sim_compute_performance-ego": 0.061695625142353334, "sim_compute_robot_state-ego": 0.06340500785083306}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.11892137172632004, "sim_physics": 0.014604640007019044, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01982263499432335, "sim_render-ego": 0.07342519760131835, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.20745041370391845, "deviation-heading": 0.19622713250710683, "set_robot_commands": 0.07896182537078858, "deviation-center-line": 0.004816268965194883, "driven_lanedir_consec": 0.01982263499432335, "sim_compute_sim_state": 0.042369627952575685, "sim_compute_performance-ego": 0.07547962665557861, "sim_compute_robot_state-ego": 0.06841845512390136}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0258162963185806, "sim_physics": 0.014346745434929344, "survival_time": 4.249999999999993, "driven_lanedir": 0.32818233145133435, "sim_render-ego": 0.0636482883902157, "in-drivable-lane": 2.199999999999996, "agent_compute-ego": 0.20463624000549316, "deviation-heading": 1.5022809567796138, "set_robot_commands": 0.07678123361924115, "deviation-center-line": 0.06326675034053543, "driven_lanedir_consec": 0.32818233145133435, "sim_compute_sim_state": 0.03780317306518555, "sim_compute_performance-ego": 0.06152334213256836, "sim_compute_robot_state-ego": 0.06198116751278148}}
set_robot_commands_max0.07896182537078858
set_robot_commands_mean0.07661797908913134
set_robot_commands_median0.07760485207162253
set_robot_commands_min0.07142427563667297
sim_compute_performance-ego_max0.07547962665557861
sim_compute_performance-ego_mean0.0646698945784393
sim_compute_performance-ego_median0.061695625142353334
sim_compute_performance-ego_min0.05875939130783081
sim_compute_robot_state-ego_max0.06841845512390136
sim_compute_robot_state-ego_mean0.06408038633979678
sim_compute_robot_state-ego_median0.06340500785083306
sim_compute_robot_state-ego_min0.0589621365070343
sim_compute_sim_state_max0.042925806932671125
sim_compute_sim_state_mean0.039626750954835165
sim_compute_sim_state_median0.039917669645169886
sim_compute_sim_state_min0.03511747717857361
sim_physics_max0.015234202146530151
sim_physics_mean0.014471757609836811
sim_physics_median0.014346745434929344
sim_physics_min0.014010290766871252
sim_render-ego_max0.07342519760131835
sim_render-ego_mean0.06513610955461367
sim_render-ego_median0.0636482883902157
sim_render-ego_min0.059277892112731934
simulation-passed1
survival_time_max4.249999999999993
survival_time_mean2.279999999999997
survival_time_min0.4
No reset possible
176582492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-47520:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10680682662893126
survival_time_median1.3500000000000003
deviation-center-line_median0.032442088261032495
in-drivable-lane_median0.7000000000000004


other stats
agent_compute-ego_max0.25917914280524623
agent_compute-ego_mean0.21492506659509553
agent_compute-ego_median0.21904500822226208
agent_compute-ego_min0.17537804003115054
deviation-center-line_max0.05229220872944738
deviation-center-line_mean0.03509843939198463
deviation-center-line_min0.02546778746597619
deviation-heading_max0.9669486786348414
deviation-heading_mean0.6009386696311767
deviation-heading_median0.44340088113933473
deviation-heading_min0.4172964262697352
driven_any_max0.627697372857192
driven_any_mean0.4210140774154314
driven_any_median0.3505758348488476
driven_any_min0.3064133535462081
driven_lanedir_consec_max0.17705375442412663
driven_lanedir_consec_mean0.1251806775807983
driven_lanedir_consec_min0.07815323937273977
driven_lanedir_max0.17705375442412663
driven_lanedir_mean0.1251806775807983
driven_lanedir_median0.10680682662893126
driven_lanedir_min0.07815323937273977
in-drivable-lane_max1.1999999999999995
in-drivable-lane_mean0.8800000000000001
in-drivable-lane_min0.7000000000000002
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.627697372857192, "sim_physics": 0.011983434359232584, "survival_time": 2.3999999999999995, "driven_lanedir": 0.17705375442412663, "sim_render-ego": 0.054610833525657654, "in-drivable-lane": 1.1999999999999995, "agent_compute-ego": 0.21904500822226208, "deviation-heading": 0.9669486786348414, "set_robot_commands": 0.07469163835048676, "deviation-center-line": 0.03525340536906197, "driven_lanedir_consec": 0.17705375442412663, "sim_compute_sim_state": 0.03524668018023173, "sim_compute_performance-ego": 0.05548178652922312, "sim_compute_robot_state-ego": 0.059268792470296226}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.498859653515609, "sim_physics": 0.011951734853345294, "survival_time": 2.1500000000000004, "driven_lanedir": 0.15984627161273424, "sim_render-ego": 0.054863109145053594, "in-drivable-lane": 1.1, "agent_compute-ego": 0.2361892267715099, "deviation-heading": 0.734142962231145, "set_robot_commands": 0.07393006945765296, "deviation-center-line": 0.05229220872944738, "driven_lanedir_consec": 0.15984627161273424, "sim_compute_sim_state": 0.03238850416139115, "sim_compute_performance-ego": 0.05951508810353834, "sim_compute_robot_state-ego": 0.06147258780723394}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3215241723093003, "sim_physics": 0.012134666796083804, "survival_time": 1.3500000000000003, "driven_lanedir": 0.10404329586545956, "sim_render-ego": 0.05730183036239059, "in-drivable-lane": 0.7000000000000003, "agent_compute-ego": 0.17537804003115054, "deviation-heading": 0.4429043998808271, "set_robot_commands": 0.08113323317633735, "deviation-center-line": 0.03003670713440512, "driven_lanedir_consec": 0.10404329586545956, "sim_compute_sim_state": 0.03551836367006655, "sim_compute_performance-ego": 0.05853916097570349, "sim_compute_robot_state-ego": 0.06338818868001302}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3064133535462081, "sim_physics": 0.014128923416137695, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07815323937273977, "sim_render-ego": 0.05511127985440768, "in-drivable-lane": 0.7000000000000002, "agent_compute-ego": 0.25917914280524623, "deviation-heading": 0.4172964262697352, "set_robot_commands": 0.07088486047891471, "deviation-center-line": 0.02546778746597619, "driven_lanedir_consec": 0.07815323937273977, "sim_compute_sim_state": 0.03397032847771278, "sim_compute_performance-ego": 0.05629014051877535, "sim_compute_robot_state-ego": 0.05974908975454477}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3505758348488476, "sim_physics": 0.013319315733733, "survival_time": 1.3500000000000003, "driven_lanedir": 0.10680682662893126, "sim_render-ego": 0.05267420521488896, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.1848339151453089, "deviation-heading": 0.44340088113933473, "set_robot_commands": 0.07201023455019351, "deviation-center-line": 0.032442088261032495, "driven_lanedir_consec": 0.10680682662893126, "sim_compute_sim_state": 0.03371523927759241, "sim_compute_performance-ego": 0.05472108169838234, "sim_compute_robot_state-ego": 0.060694871125397856}}
set_robot_commands_max0.08113323317633735
set_robot_commands_mean0.07453000720271705
set_robot_commands_median0.07393006945765296
set_robot_commands_min0.07088486047891471
sim_compute_performance-ego_max0.05951508810353834
sim_compute_performance-ego_mean0.05690945156512452
sim_compute_performance-ego_median0.05629014051877535
sim_compute_performance-ego_min0.05472108169838234
sim_compute_robot_state-ego_max0.06338818868001302
sim_compute_robot_state-ego_mean0.060914705967497165
sim_compute_robot_state-ego_median0.060694871125397856
sim_compute_robot_state-ego_min0.059268792470296226
sim_compute_sim_state_max0.03551836367006655
sim_compute_sim_state_mean0.034167823153398925
sim_compute_sim_state_median0.03397032847771278
sim_compute_sim_state_min0.03238850416139115
sim_physics_max0.014128923416137695
sim_physics_mean0.012703615031706476
sim_physics_median0.012134666796083804
sim_physics_min0.011951734853345294
sim_render-ego_max0.05730183036239059
sim_render-ego_mean0.05491225162047969
sim_render-ego_median0.054863109145053594
sim_render-ego_min0.05267420521488896
simulation-passed1
survival_time_max2.3999999999999995
survival_time_mean1.7100000000000002
survival_time_min1.3000000000000005
No reset possible
176502480Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-47520:00:50
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176342495Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-47520:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07081116930848053
survival_time_median0.49999999999999994
deviation-center-line_median0.0124696412722414
in-drivable-lane_median0.14999999999999997


other stats
agent_compute-ego_max0.18231927264820447
agent_compute-ego_mean0.17305647351525047
agent_compute-ego_median0.17539459466934204
agent_compute-ego_min0.1636676788330078
deviation-center-line_max0.013974643057305218
deviation-center-line_mean0.012267695471154742
deviation-center-line_min0.011051093896565528
deviation-heading_max0.25131853100816326
deviation-heading_mean0.2276937185088172
deviation-heading_median0.22861970785786115
deviation-heading_min0.19733107900794816
driven_any_max0.18896974823300208
driven_any_mean0.16970083269295058
driven_any_median0.16816680194138914
driven_any_min0.14552042927812214
driven_lanedir_consec_max0.09635116662687392
driven_lanedir_consec_mean0.07465859319196524
driven_lanedir_consec_min0.05606088923398245
driven_lanedir_max0.09635116662687392
driven_lanedir_mean0.07465859319196524
driven_lanedir_median0.07081116930848053
driven_lanedir_min0.05606088923398245
in-drivable-lane_max0.19999999999999996
in-drivable-lane_mean0.14999999999999997
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.18896974823300208, "sim_physics": 0.02483651854775169, "survival_time": 0.5499999999999999, "driven_lanedir": 0.07081116930848053, "sim_render-ego": 0.07331111214377663, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.18231927264820447, "deviation-heading": 0.24721028809161744, "set_robot_commands": 0.08258253877813165, "deviation-center-line": 0.013974643057305218, "driven_lanedir_consec": 0.07081116930848053, "sim_compute_sim_state": 0.04409096457741477, "sim_compute_performance-ego": 0.07238455252213911, "sim_compute_robot_state-ego": 0.07344935157082298, "sim_compute_robot_state-npc0": 0.08176086165688255, "sim_compute_robot_state-npc1": 0.07361117276278409, "sim_compute_robot_state-npc2": 0.07358384132385254, "sim_compute_robot_state-npc3": 0.07421673427928578}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.14552042927812214, "sim_physics": 0.02554294466972351, "survival_time": 0.4, "driven_lanedir": 0.05606088923398245, "sim_render-ego": 0.072480708360672, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.17539459466934204, "deviation-heading": 0.22861970785786115, "set_robot_commands": 0.07713747024536133, "deviation-center-line": 0.011290855710415843, "driven_lanedir_consec": 0.05606088923398245, "sim_compute_sim_state": 0.042856574058532715, "sim_compute_performance-ego": 0.07428315281867981, "sim_compute_robot_state-ego": 0.06666931509971619, "sim_compute_robot_state-npc0": 0.08302375674247742, "sim_compute_robot_state-npc1": 0.07720643281936646, "sim_compute_robot_state-npc2": 0.075558602809906, "sim_compute_robot_state-npc3": 0.07600241899490356}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16816680194138914, "sim_physics": 0.02582081158955892, "survival_time": 0.45, "driven_lanedir": 0.09635116662687392, "sim_render-ego": 0.07194638252258301, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.1636676788330078, "deviation-heading": 0.19733107900794816, "set_robot_commands": 0.0812639660305447, "deviation-center-line": 0.012552243419245724, "driven_lanedir_consec": 0.09635116662687392, "sim_compute_sim_state": 0.03573971324496799, "sim_compute_performance-ego": 0.0673789448208279, "sim_compute_robot_state-ego": 0.07007172372606066, "sim_compute_robot_state-npc0": 0.08236712879604763, "sim_compute_robot_state-npc1": 0.08001822895473903, "sim_compute_robot_state-npc2": 0.06965245140923394, "sim_compute_robot_state-npc3": 0.07086888949076335}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16185359928130855, "sim_physics": 0.023915982246398924, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06789903163132793, "sim_render-ego": 0.07313303947448731, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.16528403759002686, "deviation-heading": 0.25131853100816326, "set_robot_commands": 0.08064429759979248, "deviation-center-line": 0.0124696412722414, "driven_lanedir_consec": 0.06789903163132793, "sim_compute_sim_state": 0.04065546989440918, "sim_compute_performance-ego": 0.0670649528503418, "sim_compute_robot_state-ego": 0.06672396659851074, "sim_compute_robot_state-npc0": 0.07601888179779052, "sim_compute_robot_state-npc1": 0.06963953971862794, "sim_compute_robot_state-npc2": 0.07126901149749756, "sim_compute_robot_state-npc3": 0.07541563510894775}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18399358473093097, "sim_physics": 0.02426864884116433, "survival_time": 0.5499999999999999, "driven_lanedir": 0.08217070915916136, "sim_render-ego": 0.06976905736056241, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.17861678383567117, "deviation-heading": 0.213988986578496, "set_robot_commands": 0.07907674529335716, "deviation-center-line": 0.011051093896565528, "driven_lanedir_consec": 0.08217070915916136, "sim_compute_sim_state": 0.04333565451882102, "sim_compute_performance-ego": 0.06844305992126465, "sim_compute_robot_state-ego": 0.0692900527607311, "sim_compute_robot_state-npc0": 0.0770172422582453, "sim_compute_robot_state-npc1": 0.07745595411820845, "sim_compute_robot_state-npc2": 0.06960504705255682, "sim_compute_robot_state-npc3": 0.06947612762451172}}
set_robot_commands_max0.08258253877813165
set_robot_commands_mean0.08014100358943746
set_robot_commands_median0.08064429759979248
set_robot_commands_min0.07713747024536133
sim_compute_performance-ego_max0.07428315281867981
sim_compute_performance-ego_mean0.06991093258665065
sim_compute_performance-ego_median0.06844305992126465
sim_compute_performance-ego_min0.0670649528503418
sim_compute_robot_state-ego_max0.07344935157082298
sim_compute_robot_state-ego_mean0.06924088195116833
sim_compute_robot_state-ego_median0.0692900527607311
sim_compute_robot_state-ego_min0.06666931509971619
sim_compute_robot_state-npc0_max0.08302375674247742
sim_compute_robot_state-npc0_mean0.08003757425028869
sim_compute_robot_state-npc0_median0.08176086165688255
sim_compute_robot_state-npc0_min0.07601888179779052
sim_compute_robot_state-npc1_max0.08001822895473903
sim_compute_robot_state-npc1_mean0.07558626567474519
sim_compute_robot_state-npc1_median0.07720643281936646
sim_compute_robot_state-npc1_min0.06963953971862794
sim_compute_robot_state-npc2_max0.075558602809906
sim_compute_robot_state-npc2_mean0.07193379081860937
sim_compute_robot_state-npc2_median0.07126901149749756
sim_compute_robot_state-npc2_min0.06960504705255682
sim_compute_robot_state-npc3_max0.07600241899490356
sim_compute_robot_state-npc3_mean0.07319596109968243
sim_compute_robot_state-npc3_median0.07421673427928578
sim_compute_robot_state-npc3_min0.06947612762451172
sim_compute_sim_state_max0.04409096457741477
sim_compute_sim_state_mean0.041335675258829134
sim_compute_sim_state_median0.042856574058532715
sim_compute_sim_state_min0.03573971324496799
sim_physics_max0.02582081158955892
sim_physics_mean0.024876981178919476
sim_physics_median0.02483651854775169
sim_physics_min0.023915982246398924
sim_render-ego_max0.07331111214377663
sim_render-ego_mean0.07212805997241627
sim_render-ego_median0.072480708360672
sim_render-ego_min0.06976905736056241
simulation-passed1
survival_time_max0.5499999999999999
survival_time_mean0.48999999999999994
survival_time_min0.4
No reset possible