Duckietown Challenges Home Challenges Submissions

Submission 2636

Submission2636
Competingyes
Challengeaido2-LFVI-sim-testing
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22849
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22849step1-simulationsuccessyes0:29:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.16252770790686974
agent_compute-ego_mean0.14944000711237013
agent_compute-ego_median0.15136917928854624
agent_compute-ego_min0.1314097356796265
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.20396912248828744, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06704959386511694, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1606367419037638, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09676697586156144, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03923459596271756, "sim_compute_performance-ego": 0.0725950772249246, "sim_compute_robot_state-ego": 0.07924090759663642, "sim_compute_robot_state-npc0": 0.07293974598751793, "sim_compute_robot_state-npc1": 0.07181919677348077, "sim_compute_robot_state-npc2": 0.07047269314150267, "sim_compute_robot_state-npc3": 0.07009755207013481}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.19468028204781668, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06195613316127232, "in-drivable-lane": 0, "agent_compute-ego": 0.14461419412067958, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09563570363180976, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03791282006672451, "sim_compute_performance-ego": 0.0676972610609872, "sim_compute_robot_state-ego": 0.07345908028738839, "sim_compute_robot_state-npc0": 0.06780758925846644, "sim_compute_robot_state-npc1": 0.06880039828164237, "sim_compute_robot_state-npc2": 0.0670134084565299, "sim_compute_robot_state-npc3": 0.06517595052719116}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18169781999680604, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.058046384922509055, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14294435677019138, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08961731484792765, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03677451263353663, "sim_compute_performance-ego": 0.06280082406349552, "sim_compute_robot_state-ego": 0.06935198793133486, "sim_compute_robot_state-npc0": 0.06511783136904818, "sim_compute_robot_state-npc1": 0.06574245332514198, "sim_compute_robot_state-npc2": 0.06412120467250787, "sim_compute_robot_state-npc3": 0.06623278775261444}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2139415740966797, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06735493739446004, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15136917928854624, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09938040872414906, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03789544105529785, "sim_compute_performance-ego": 0.06825744112332661, "sim_compute_robot_state-ego": 0.07729260623455048, "sim_compute_robot_state-npc0": 0.06834885974725087, "sim_compute_robot_state-npc1": 0.06823105116685231, "sim_compute_robot_state-npc2": 0.07131317257881165, "sim_compute_robot_state-npc3": 0.06927888095378876}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2018113817487444, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06089233216785249, "in-drivable-lane": 0, "agent_compute-ego": 0.150439875466483, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09468049094790504, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03779355684916178, "sim_compute_performance-ego": 0.06736566906883604, "sim_compute_robot_state-ego": 0.06927084922790527, "sim_compute_robot_state-npc0": 0.07016553197588239, "sim_compute_robot_state-npc1": 0.06909686043148949, "sim_compute_robot_state-npc2": 0.07231184414454869, "sim_compute_robot_state-npc3": 0.0692791257585798}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.19024827237614617, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06285946668978937, "in-drivable-lane": 2, "agent_compute-ego": 0.15237513702072783, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09576443569388932, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03877613216103194, "sim_compute_performance-ego": 0.07335553483334845, "sim_compute_robot_state-ego": 0.07418430779508488, "sim_compute_robot_state-npc0": 0.06892291799990717, "sim_compute_robot_state-npc1": 0.06922673179717835, "sim_compute_robot_state-npc2": 0.07037079405641841, "sim_compute_robot_state-npc3": 0.06928606947025139}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.21301271845993489, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06279677326239429, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15682475080767885, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09623073142709083, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.039790801631594166, "sim_compute_performance-ego": 0.06913231645972984, "sim_compute_robot_state-ego": 0.07312216805022898, "sim_compute_robot_state-npc0": 0.07246519523916893, "sim_compute_robot_state-npc1": 0.07300939837705742, "sim_compute_robot_state-npc2": 0.07224063271457709, "sim_compute_robot_state-npc3": 0.07097372962433157}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.20446685314178467, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.0635302209854126, "in-drivable-lane": 0, "agent_compute-ego": 0.1495400094985962, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09667890548706054, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03861409664154053, "sim_compute_performance-ego": 0.06860416889190674, "sim_compute_robot_state-ego": 0.07117433071136475, "sim_compute_robot_state-npc0": 0.0707487964630127, "sim_compute_robot_state-npc1": 0.06647271633148194, "sim_compute_robot_state-npc2": 0.06898120880126953, "sim_compute_robot_state-npc3": 0.06539711952209473}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.2062911162009606, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06590769841120793, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16252770790686974, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10382526654463547, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04074751413785494, "sim_compute_performance-ego": 0.07258012661567101, "sim_compute_robot_state-ego": 0.08340505911753728, "sim_compute_robot_state-npc0": 0.07378169664969811, "sim_compute_robot_state-npc1": 0.07330254866526677, "sim_compute_robot_state-npc2": 0.07434540528517503, "sim_compute_robot_state-npc3": 0.07243791910318229}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.21408399251791144, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06460154056549072, "in-drivable-lane": 0, "agent_compute-ego": 0.15137842985299918, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.0969255153949444, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.038190520726717435, "sim_compute_performance-ego": 0.06587110115931584, "sim_compute_robot_state-ego": 0.07029840579399696, "sim_compute_robot_state-npc0": 0.06872830024132362, "sim_compute_robot_state-npc1": 0.07343244552612305, "sim_compute_robot_state-npc2": 0.06794711259695199, "sim_compute_robot_state-npc3": 0.07072843955113338}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2018203085119074, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06494816866787997, "in-drivable-lane": 0, "agent_compute-ego": 0.15876678986982865, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.0902882597663186, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.045554702932184395, "sim_compute_performance-ego": 0.06942307949066162, "sim_compute_robot_state-ego": 0.07621097564697266, "sim_compute_robot_state-npc0": 0.07075998999855736, "sim_compute_robot_state-npc1": 0.07052039016376842, "sim_compute_robot_state-npc2": 0.06866320696744052, "sim_compute_robot_state-npc3": 0.07038839296861128}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.16273346900939942, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05622938632965088, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1314097356796265, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.08272758483886719, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.035657796859741214, "sim_compute_performance-ego": 0.06218173027038574, "sim_compute_robot_state-ego": 0.06391804695129394, "sim_compute_robot_state-npc0": 0.05971678256988525, "sim_compute_robot_state-npc1": 0.06067320346832275, "sim_compute_robot_state-npc2": 0.06061127662658691, "sim_compute_robot_state-npc3": 0.06452774047851563}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.16801654785237413, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.05587677752718012, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1421143983272796, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.08515246371005444, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.034453922129691915, "sim_compute_performance-ego": 0.060898387685735175, "sim_compute_robot_state-ego": 0.06622990648797218, "sim_compute_robot_state-npc0": 0.06165617070299514, "sim_compute_robot_state-npc1": 0.05918624806911387, "sim_compute_robot_state-npc2": 0.06089376642348918, "sim_compute_robot_state-npc3": 0.06031173848091288}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.16766501848514265, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.05310808695279635, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.13389944571715134, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.07869018499667828, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03413013770030095, "sim_compute_performance-ego": 0.05919729287807758, "sim_compute_robot_state-ego": 0.05952747968526987, "sim_compute_robot_state-npc0": 0.05971975968434261, "sim_compute_robot_state-npc1": 0.06016667989584116, "sim_compute_robot_state-npc2": 0.0592391536786006, "sim_compute_robot_state-npc3": 0.05761533975601196}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.19500628653026764, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06385555494399298, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.15275935445513045, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.09647727012634276, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03898067020234607, "sim_compute_performance-ego": 0.06996894336882092, "sim_compute_robot_state-ego": 0.07284474826994397, "sim_compute_robot_state-npc0": 0.0684211912609282, "sim_compute_robot_state-npc1": 0.0692120665595645, "sim_compute_robot_state-npc2": 0.0685704163142613, "sim_compute_robot_state-npc3": 0.06737553959801083}}
set_robot_commands_max0.10382526654463547
set_robot_commands_mean0.093256100799949
set_robot_commands_median0.09576443569388932
set_robot_commands_min0.07869018499667828
sim_compute_performance-ego_max0.07335553483334845
sim_compute_performance-ego_mean0.0673285969463482
sim_compute_performance-ego_median0.06825744112332661
sim_compute_performance-ego_min0.05919729287807758
sim_compute_robot_state-ego_max0.08340505911753728
sim_compute_robot_state-ego_mean0.07196872398583205
sim_compute_robot_state-ego_median0.07284474826994397
sim_compute_robot_state-ego_min0.05952747968526987
sim_compute_robot_state-npc0_max0.07378169664969811
sim_compute_robot_state-npc0_mean0.06795335727653232
sim_compute_robot_state-npc0_median0.06872830024132362
sim_compute_robot_state-npc0_min0.05971678256988525
sim_compute_robot_state-npc1_max0.07343244552612305
sim_compute_robot_state-npc1_mean0.06792615925548834
sim_compute_robot_state-npc1_median0.06909686043148949
sim_compute_robot_state-npc1_min0.05918624806911387
sim_compute_robot_state-npc2_max0.07434540528517503
sim_compute_robot_state-npc2_mean0.06780635309724475
sim_compute_robot_state-npc2_median0.06866320696744052
sim_compute_robot_state-npc2_min0.0592391536786006
sim_compute_robot_state-npc3_max0.07243791910318229
sim_compute_robot_state-npc3_mean0.06727375504102433
sim_compute_robot_state-npc3_median0.06927888095378876
sim_compute_robot_state-npc3_min0.05761533975601196
sim_compute_sim_state_max0.045554702932184395
sim_compute_sim_state_mean0.038300481446029454
sim_compute_sim_state_median0.038190520726717435
sim_compute_sim_state_min0.03413013770030095
sim_physics_max0.21408399251791144
sim_physics_mean0.1946296508976109
sim_physics_median0.2018113817487444
sim_physics_min0.16273346900939942
sim_render-ego_max0.06735493739446004
sim_render-ego_mean0.061934203723133734
sim_render-ego_median0.06285946668978937
sim_render-ego_min0.05310808695279635
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible