Duckietown Challenges Home Challenges Submissions

Submission 2812

Submission2812
Competingyes
Challengeaido2-LFVI-sim-testing
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22762
Next
User labelchallenge-aido_LF-template-random - random_agent
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22762step1-simulationsuccessyes0:19:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.08159929589380192
agent_compute-ego_mean0.08010377164327694
agent_compute-ego_median0.08003342151641846
agent_compute-ego_min0.07928786958966937
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.08039326305630841, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.03314140476757967, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.08159929589380192, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.04966377608383758, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.020306713973419575, "sim_compute_performance-ego": 0.03539970856678637, "sim_compute_robot_state-ego": 0.037084582485730135, "sim_compute_robot_state-npc0": 0.035739889627770534, "sim_compute_robot_state-npc1": 0.03630760651600512, "sim_compute_robot_state-npc2": 0.0357013593746137, "sim_compute_robot_state-npc3": 0.035717182521578635}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.08258347000394549, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.032463175909859796, "in-drivable-lane": 0, "agent_compute-ego": 0.07928786958966937, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.05332995312554496, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.02017475025994437, "sim_compute_performance-ego": 0.03517709459577288, "sim_compute_robot_state-ego": 0.038001571382795064, "sim_compute_robot_state-npc0": 0.035616116864340644, "sim_compute_robot_state-npc1": 0.03524276188441685, "sim_compute_robot_state-npc2": 0.03519161258425031, "sim_compute_robot_state-npc3": 0.03580080611365182}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.07807530477208999, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.032518366008128935, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07988288333115068, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.04902837345901045, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.020172135343829407, "sim_compute_performance-ego": 0.034621984055898725, "sim_compute_robot_state-ego": 0.036765927249945485, "sim_compute_robot_state-npc0": 0.03594156144892128, "sim_compute_robot_state-npc1": 0.03580017228728359, "sim_compute_robot_state-npc2": 0.03524832586640293, "sim_compute_robot_state-npc3": 0.03578958233583321}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.08323693772157033, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.031805604696273804, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.08027418951193492, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.04937850932280222, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.02008016407489777, "sim_compute_performance-ego": 0.03473569949467977, "sim_compute_robot_state-ego": 0.03652379413445791, "sim_compute_robot_state-npc0": 0.03618775308132171, "sim_compute_robot_state-npc1": 0.03762519359588623, "sim_compute_robot_state-npc2": 0.035242716471354164, "sim_compute_robot_state-npc3": 0.03505929311116537}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.08134789693923224, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.03196892284211658, "in-drivable-lane": 0, "agent_compute-ego": 0.0800223918188186, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.04880211466834659, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.020555087498256137, "sim_compute_performance-ego": 0.03469797543116978, "sim_compute_robot_state-ego": 0.03695090611775717, "sim_compute_robot_state-npc0": 0.03562206313723609, "sim_compute_robot_state-npc1": 0.03553233827863421, "sim_compute_robot_state-npc2": 0.036879721141996835, "sim_compute_robot_state-npc3": 0.035250255039760044}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.07828552851419963, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.032346581270594796, "in-drivable-lane": 2, "agent_compute-ego": 0.07985001695370246, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.04947011342305623, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.020055976456510808, "sim_compute_performance-ego": 0.0348404638781519, "sim_compute_robot_state-ego": 0.03698831118509441, "sim_compute_robot_state-npc0": 0.035535041443602054, "sim_compute_robot_state-npc1": 0.03580024999058889, "sim_compute_robot_state-npc2": 0.03540664233133464, "sim_compute_robot_state-npc3": 0.035461218771106466}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.08338028944811775, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.03251639616142199, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08026771175051198, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.04923785311504475, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02232622405857716, "sim_compute_performance-ego": 0.035184874117953104, "sim_compute_robot_state-ego": 0.03701603528365348, "sim_compute_robot_state-npc0": 0.03561289333602757, "sim_compute_robot_state-npc1": 0.03568504157575589, "sim_compute_robot_state-npc2": 0.03570443218194165, "sim_compute_robot_state-npc3": 0.035498359828319365}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.08709868431091308, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.033323841094970705, "in-drivable-lane": 0, "agent_compute-ego": 0.07979367733001709, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.049545788764953615, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.020580053329467773, "sim_compute_performance-ego": 0.03516577243804932, "sim_compute_robot_state-ego": 0.03687504768371582, "sim_compute_robot_state-npc0": 0.03555574417114258, "sim_compute_robot_state-npc1": 0.035804734230041504, "sim_compute_robot_state-npc2": 0.03564877986907959, "sim_compute_robot_state-npc3": 0.03580949306488037}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.07779416671166053, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.03210646372575026, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08046816404049213, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.04947532140291654, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.02012214293846717, "sim_compute_performance-ego": 0.034948188524979815, "sim_compute_robot_state-ego": 0.036595862645369306, "sim_compute_robot_state-npc0": 0.035439317043011, "sim_compute_robot_state-npc1": 0.03622367748847374, "sim_compute_robot_state-npc2": 0.035384599979107194, "sim_compute_robot_state-npc3": 0.035491764545440674}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.0902965160516592, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.03250425595503587, "in-drivable-lane": 0, "agent_compute-ego": 0.0803055213047908, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.05005935522226187, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.020062694182762734, "sim_compute_performance-ego": 0.03438243499168983, "sim_compute_robot_state-ego": 0.03647946394406832, "sim_compute_robot_state-npc0": 0.03703382382026085, "sim_compute_robot_state-npc1": 0.03621357220869798, "sim_compute_robot_state-npc2": 0.03600981602301964, "sim_compute_robot_state-npc3": 0.03533339500427246}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.08259116519581187, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.032793218439275566, "in-drivable-lane": 0, "agent_compute-ego": 0.08003342151641846, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.04836073788729581, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.02011871337890625, "sim_compute_performance-ego": 0.036095922643488106, "sim_compute_robot_state-ego": 0.037366541949185456, "sim_compute_robot_state-npc0": 0.03634566610509699, "sim_compute_robot_state-npc1": 0.03557113083926114, "sim_compute_robot_state-npc2": 0.03476527604189786, "sim_compute_robot_state-npc3": 0.03528240593996915}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.07718895435333252, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.03232187747955322, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08034112930297851, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.04935735702514649, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.020695905685424804, "sim_compute_performance-ego": 0.03499733924865723, "sim_compute_robot_state-ego": 0.03668574810028076, "sim_compute_robot_state-npc0": 0.035890660285949706, "sim_compute_robot_state-npc1": 0.036248397827148435, "sim_compute_robot_state-npc2": 0.036390581130981446, "sim_compute_robot_state-npc3": 0.03597043037414551}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.08086198187888936, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.032052126336604994, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.08007775976302776, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.04924366575606326, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.020305258162478183, "sim_compute_performance-ego": 0.03488607863162426, "sim_compute_robot_state-ego": 0.03684472530446154, "sim_compute_robot_state-npc0": 0.03568622152856056, "sim_compute_robot_state-npc1": 0.035876045835779066, "sim_compute_robot_state-npc2": 0.035549747182967814, "sim_compute_robot_state-npc3": 0.03592645614705187}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.07821430151279156, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.032327088025900036, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.07935063655559833, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.04900371569853563, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.020174053999093864, "sim_compute_performance-ego": 0.035804798969855674, "sim_compute_robot_state-ego": 0.037469955591055065, "sim_compute_robot_state-npc0": 0.035777467947739824, "sim_compute_robot_state-npc1": 0.03577268582123976, "sim_compute_robot_state-npc2": 0.03603301598475529, "sim_compute_robot_state-npc3": 0.03566525074151846}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.07785161109197708, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.03313965116228376, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.08000190598624093, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.04924586613972982, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.020072230838593982, "sim_compute_performance-ego": 0.03490605581374395, "sim_compute_robot_state-ego": 0.03721928369431268, "sim_compute_robot_state-npc0": 0.035785790852137976, "sim_compute_robot_state-npc1": 0.03596053350539435, "sim_compute_robot_state-npc2": 0.03561942463829404, "sim_compute_robot_state-npc3": 0.03556650706699916}}
set_robot_commands_max0.05332995312554496
set_robot_commands_mean0.04954683340630306
set_robot_commands_median0.04935735702514649
set_robot_commands_min0.04836073788729581
sim_compute_performance-ego_max0.036095922643488106
sim_compute_performance-ego_mean0.03505629276016672
sim_compute_performance-ego_median0.034948188524979815
sim_compute_performance-ego_min0.03438243499168983
sim_compute_robot_state-ego_max0.038001571382795064
sim_compute_robot_state-ego_mean0.03699118378345884
sim_compute_robot_state-ego_median0.03695090611775717
sim_compute_robot_state-ego_min0.03647946394406832
sim_compute_robot_state-npc0_max0.03703382382026085
sim_compute_robot_state-npc0_mean0.03585133404620796
sim_compute_robot_state-npc0_median0.035739889627770534
sim_compute_robot_state-npc0_min0.035439317043011
sim_compute_robot_state-npc1_max0.03762519359588623
sim_compute_robot_state-npc1_mean0.03597760945897378
sim_compute_robot_state-npc1_median0.035804734230041504
sim_compute_robot_state-npc1_min0.03524276188441685
sim_compute_robot_state-npc2_max0.036879721141996835
sim_compute_robot_state-npc2_mean0.03565173672013314
sim_compute_robot_state-npc2_median0.03561942463829404
sim_compute_robot_state-npc2_min0.03476527604189786
sim_compute_robot_state-npc3_max0.03597043037414551
sim_compute_robot_state-npc3_mean0.03557482670704617
sim_compute_robot_state-npc3_median0.03556650706699916
sim_compute_robot_state-npc3_min0.03505929311116537
sim_compute_sim_state_max0.02232622405857716
sim_compute_sim_state_mean0.020386806945375337
sim_compute_sim_state_median0.020174053999093864
sim_compute_sim_state_min0.020055976456510808
sim_physics_max0.0902965160516592
sim_physics_mean0.08128000477083328
sim_physics_median0.08086198187888936
sim_physics_min0.07718895435333252
sim_render-ego_max0.033323841094970705
sim_render-ego_mean0.03248859825835667
sim_render-ego_median0.032463175909859796
sim_render-ego_min0.031805604696273804
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible