Duckietown Challenges Home Challenges Submissions

Submission 4404

Submission4404
Competingyes
Challengeaido3-LFV-sim-testing
UserAlex Deliyannis
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27462
Next
User labelchallenge-aido_LF-template-tensorflow
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27462step1-simulationsuccessyes0:10:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.23631341009403584
survival_time_median1.0000000000000002
deviation-center-line_median0.06506280426212205
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03253335219163161
agent_compute-ego_mean0.02872816582463347
agent_compute-ego_median0.02799689769744873
agent_compute-ego_min0.024882018566131592
deviation-center-line_max0.12248946832205532
deviation-center-line_mean0.06883650683706119
deviation-center-line_min0.03866885633962419
deviation-heading_max0.6825851825213449
deviation-heading_mean0.4236013239089602
deviation-heading_median0.43245935302508554
deviation-heading_min0.15274853879697994
driven_any_max0.435811889651772
driven_any_mean0.29038579834363426
driven_any_median0.2863968970065738
driven_any_min0.19444673160941617
driven_lanedir_consec_max0.3818105767101674
driven_lanedir_consec_mean0.2402079180928385
driven_lanedir_consec_min0.15605639488417378
driven_lanedir_max0.3818105767101674
driven_lanedir_mean0.2402079180928385
driven_lanedir_median0.23631341009403584
driven_lanedir_min0.15605639488417378
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.010000000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2863968970065738, "sim_physics": 0.15605669021606444, "survival_time": 1.0000000000000002, "driven_lanedir": 0.23631341009403584, "sim_render-ego": 0.012744450569152832, "in-drivable-lane": 0.04999999999999993, "agent_compute-ego": 0.0265913724899292, "deviation-heading": 0.3883337785520484, "set_robot_commands": 0.007698225975036621, "deviation-center-line": 0.051632004151774505, "driven_lanedir_consec": 0.23631341009403584, "sim_compute_sim_state": 0.004842722415924072, "sim_compute_performance-ego": 0.007319211959838867, "sim_compute_robot_state-ego": 0.00931941270828247, "sim_compute_robot_state-npc0": 0.007720398902893067, "sim_compute_robot_state-npc1": 0.008195161819458008, "sim_compute_robot_state-npc2": 0.007808339595794678, "sim_compute_robot_state-npc3": 0.007776594161987305}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.234923235395348, "sim_physics": 0.17042492628097533, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1633417165629436, "sim_render-ego": 0.01377711296081543, "in-drivable-lane": 0, "agent_compute-ego": 0.028824317455291747, "deviation-heading": 0.5123514093463503, "set_robot_commands": 0.009134960174560548, "deviation-center-line": 0.0573237364130864, "driven_lanedir_consec": 0.1633417165629436, "sim_compute_sim_state": 0.005047452449798584, "sim_compute_performance-ego": 0.0073874473571777345, "sim_compute_robot_state-ego": 0.009455227851867675, "sim_compute_robot_state-npc0": 0.009709298610687256, "sim_compute_robot_state-npc1": 0.00825425386428833, "sim_compute_robot_state-npc2": 0.008027434349060059, "sim_compute_robot_state-npc3": 0.008939743041992188}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30391903375090085, "sim_physics": 0.14956978956858316, "survival_time": 1.2000000000000004, "driven_lanedir": 0.20491262664081733, "sim_render-ego": 0.013685842355092369, "in-drivable-lane": 0, "agent_compute-ego": 0.02799689769744873, "deviation-heading": 0.6825851825213449, "set_robot_commands": 0.00955157478650411, "deviation-center-line": 0.09606667382303734, "driven_lanedir_consec": 0.20491262664081733, "sim_compute_sim_state": 0.004666497310002645, "sim_compute_performance-ego": 0.007610638936360677, "sim_compute_robot_state-ego": 0.009727120399475098, "sim_compute_robot_state-npc0": 0.008532057205835978, "sim_compute_robot_state-npc1": 0.008877962827682495, "sim_compute_robot_state-npc2": 0.008456140756607056, "sim_compute_robot_state-npc3": 0.008133798837661743}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2738039531713772, "sim_physics": 0.17602124214172363, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2437449478717194, "sim_render-ego": 0.014212489128112791, "in-drivable-lane": 0, "agent_compute-ego": 0.03228803873062134, "deviation-heading": 0.43245935302508554, "set_robot_commands": 0.010007548332214357, "deviation-center-line": 0.06525733509857072, "driven_lanedir_consec": 0.2437449478717194, "sim_compute_sim_state": 0.0053515791893005375, "sim_compute_performance-ego": 0.00911620855331421, "sim_compute_robot_state-ego": 0.009487283229827882, "sim_compute_robot_state-npc0": 0.009373033046722412, "sim_compute_robot_state-npc1": 0.009835505485534668, "sim_compute_robot_state-npc2": 0.009245645999908448, "sim_compute_robot_state-npc3": 0.008600580692291259}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.34165119571448826, "sim_physics": 0.1587196680215689, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28405290434106645, "sim_render-ego": 0.015169409605172964, "in-drivable-lane": 0, "agent_compute-ego": 0.03253335219163161, "deviation-heading": 0.5114881760503482, "set_robot_commands": 0.009766633693988506, "deviation-center-line": 0.03866885633962419, "driven_lanedir_consec": 0.28405290434106645, "sim_compute_sim_state": 0.005582910317641038, "sim_compute_performance-ego": 0.007956284743088942, "sim_compute_robot_state-ego": 0.00991073021521935, "sim_compute_robot_state-npc0": 0.00961885085472694, "sim_compute_robot_state-npc1": 0.009489884743323691, "sim_compute_robot_state-npc2": 0.009542355170616737, "sim_compute_robot_state-npc3": 0.008846539717454176}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.37082894265900707, "sim_physics": 0.16825027465820314, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3263582236103111, "sim_render-ego": 0.014610328674316409, "in-drivable-lane": 0, "agent_compute-ego": 0.03231172561645508, "deviation-heading": 0.3931147516933041, "set_robot_commands": 0.009998855590820312, "deviation-center-line": 0.04632705920862815, "driven_lanedir_consec": 0.3263582236103111, "sim_compute_sim_state": 0.005557699203491211, "sim_compute_performance-ego": 0.00794281005859375, "sim_compute_robot_state-ego": 0.009751081466674805, "sim_compute_robot_state-npc0": 0.009504032135009766, "sim_compute_robot_state-npc1": 0.009612083435058594, "sim_compute_robot_state-npc2": 0.009206876754760744, "sim_compute_robot_state-npc3": 0.008961286544799805}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.19487324154133864, "sim_physics": 0.2042918046315511, "survival_time": 0.7500000000000001, "driven_lanedir": 0.17128165981682342, "sim_render-ego": 0.015062491099039711, "in-drivable-lane": 0, "agent_compute-ego": 0.032294909159342446, "deviation-heading": 0.2756983653720393, "set_robot_commands": 0.009709517161051432, "deviation-center-line": 0.06506280426212205, "driven_lanedir_consec": 0.17128165981682342, "sim_compute_sim_state": 0.005155229568481445, "sim_compute_performance-ego": 0.008278735478719075, "sim_compute_robot_state-ego": 0.00913364092508952, "sim_compute_robot_state-npc0": 0.009198745091756184, "sim_compute_robot_state-npc1": 0.0092011292775472, "sim_compute_robot_state-npc2": 0.009193801879882812, "sim_compute_robot_state-npc3": 0.008757940928141276}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.19444673160941617, "sim_physics": 0.16042065620422363, "survival_time": 0.9000000000000002, "driven_lanedir": 0.15605639488417378, "sim_render-ego": 0.012520379490322538, "in-drivable-lane": 0, "agent_compute-ego": 0.02865367465549045, "deviation-heading": 0.30087251658153535, "set_robot_commands": 0.008089847034878202, "deviation-center-line": 0.06087988144540214, "driven_lanedir_consec": 0.15605639488417378, "sim_compute_sim_state": 0.005834884113735623, "sim_compute_performance-ego": 0.007924199104309082, "sim_compute_robot_state-ego": 0.008834812376234267, "sim_compute_robot_state-npc0": 0.009451707204182943, "sim_compute_robot_state-npc1": 0.00906315114763048, "sim_compute_robot_state-npc2": 0.008573426140679253, "sim_compute_robot_state-npc3": 0.008932007683648003}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.435811889651772, "sim_physics": 0.12603206634521483, "survival_time": 1.5000000000000009, "driven_lanedir": 0.3818105767101674, "sim_render-ego": 0.012359007199605306, "in-drivable-lane": 0, "agent_compute-ego": 0.026887996991475423, "deviation-heading": 0.5852745342218716, "set_robot_commands": 0.008757781982421876, "deviation-center-line": 0.12248946832205532, "driven_lanedir_consec": 0.3818105767101674, "sim_compute_sim_state": 0.00502012570699056, "sim_compute_performance-ego": 0.007049973805745443, "sim_compute_robot_state-ego": 0.008357532819112142, "sim_compute_robot_state-npc0": 0.008264931042989095, "sim_compute_robot_state-npc1": 0.008333182334899903, "sim_compute_robot_state-npc2": 0.007914113998413085, "sim_compute_robot_state-npc3": 0.008501545588175455}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.328619643548658, "sim_physics": 0.13694153229395548, "survival_time": 1.2000000000000004, "driven_lanedir": 0.2663851931149388, "sim_render-ego": 0.01179047425587972, "in-drivable-lane": 0, "agent_compute-ego": 0.024882018566131592, "deviation-heading": 0.547135809804864, "set_robot_commands": 0.007652401924133301, "deviation-center-line": 0.08441712027510609, "driven_lanedir_consec": 0.2663851931149388, "sim_compute_sim_state": 0.004615098237991333, "sim_compute_performance-ego": 0.0067959825197855634, "sim_compute_robot_state-ego": 0.007952898740768433, "sim_compute_robot_state-npc0": 0.008015920718510946, "sim_compute_robot_state-npc1": 0.00780719518661499, "sim_compute_robot_state-npc2": 0.007631013790766398, "sim_compute_robot_state-npc3": 0.007851779460906982}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2927140508540439, "sim_physics": 0.1431864443279448, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2625214612026787, "sim_render-ego": 0.01293855621701195, "in-drivable-lane": 0, "agent_compute-ego": 0.027557191394624255, "deviation-heading": 0.40572159821551834, "set_robot_commands": 0.00902375720796131, "deviation-center-line": 0.06594402458865765, "driven_lanedir_consec": 0.2625214612026787, "sim_compute_sim_state": 0.005107550393967401, "sim_compute_performance-ego": 0.0072732652936662945, "sim_compute_robot_state-ego": 0.008898349035353888, "sim_compute_robot_state-npc0": 0.008700881685529436, "sim_compute_robot_state-npc1": 0.008773383640107654, "sim_compute_robot_state-npc2": 0.008244446345738001, "sim_compute_robot_state-npc3": 0.008690027963547479}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27520060073343, "sim_physics": 0.16509867849804105, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2075163495656156, "sim_render-ego": 0.012612796965099517, "in-drivable-lane": 0, "agent_compute-ego": 0.027029707318260557, "deviation-heading": 0.4463252511069403, "set_robot_commands": 0.00798526264372326, "deviation-center-line": 0.06288901855249772, "driven_lanedir_consec": 0.2075163495656156, "sim_compute_sim_state": 0.004869756244477772, "sim_compute_performance-ego": 0.007522900899251302, "sim_compute_robot_state-ego": 0.009881837027413505, "sim_compute_robot_state-npc0": 0.008869386854625884, "sim_compute_robot_state-npc1": 0.007713420050484794, "sim_compute_robot_state-npc2": 0.008073159626552038, "sim_compute_robot_state-npc3": 0.008345002219790504}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.23504953678764193, "sim_physics": 0.1899479627609253, "survival_time": 0.9000000000000002, "driven_lanedir": 0.1846320087674136, "sim_render-ego": 0.012208951844109427, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02724562750922309, "deviation-heading": 0.2480911615377306, "set_robot_commands": 0.008872853385077583, "deviation-center-line": 0.06551644678834918, "driven_lanedir_consec": 0.1846320087674136, "sim_compute_sim_state": 0.005763265821668837, "sim_compute_performance-ego": 0.00649759504530165, "sim_compute_robot_state-ego": 0.008507092793782553, "sim_compute_robot_state-npc0": 0.009124437967936196, "sim_compute_robot_state-npc1": 0.00817455185784234, "sim_compute_robot_state-npc2": 0.008659005165100098, "sim_compute_robot_state-npc3": 0.008554180463155111}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.2485360495402546, "sim_physics": 0.12574335148459986, "survival_time": 0.9500000000000004, "driven_lanedir": 0.18204456077028383, "sim_render-ego": 0.012306175733867443, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.029053110825388057, "deviation-heading": 0.47181943180844255, "set_robot_commands": 0.008934673510099711, "deviation-center-line": 0.05047110540274004, "driven_lanedir_consec": 0.18204456077028383, "sim_compute_sim_state": 0.004579995807848479, "sim_compute_performance-ego": 0.006998689551102488, "sim_compute_robot_state-ego": 0.008575288872969778, "sim_compute_robot_state-npc0": 0.007775645507009406, "sim_compute_robot_state-npc1": 0.007831711518137078, "sim_compute_robot_state-npc2": 0.007667328182019685, "sim_compute_robot_state-npc3": 0.007670076269852488}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.3390119731902636, "sim_physics": 0.16182957887649535, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3321467374395892, "sim_render-ego": 0.013726353645324709, "in-drivable-lane": 0, "agent_compute-ego": 0.026772546768188476, "deviation-heading": 0.15274853879697994, "set_robot_commands": 0.01906336545944214, "deviation-center-line": 0.09960206788426644, "driven_lanedir_consec": 0.3321467374395892, "sim_compute_sim_state": 0.004789292812347412, "sim_compute_performance-ego": 0.006917023658752441, "sim_compute_robot_state-ego": 0.008774673938751221, "sim_compute_robot_state-npc0": 0.007866621017456055, "sim_compute_robot_state-npc1": 0.007498311996459961, "sim_compute_robot_state-npc2": 0.007938671112060546, "sim_compute_robot_state-npc3": 0.00823122262954712}}
set_robot_commands_max0.01906336545944214
set_robot_commands_mean0.009616483924127553
set_robot_commands_median0.00902375720796131
set_robot_commands_min0.007652401924133301
sim_compute_performance-ego_max0.00911620855331421
sim_compute_performance-ego_mean0.007506064464333834
sim_compute_performance-ego_median0.0073874473571777345
sim_compute_performance-ego_min0.00649759504530165
sim_compute_robot_state-ego_max0.00991073021521935
sim_compute_robot_state-ego_mean0.009104465493388171
sim_compute_robot_state-ego_median0.00913364092508952
sim_compute_robot_state-ego_min0.007952898740768433
sim_compute_robot_state-npc0_max0.009709298610687256
sim_compute_robot_state-npc0_mean0.008781729856391437
sim_compute_robot_state-npc0_median0.008869386854625884
sim_compute_robot_state-npc0_min0.007720398902893067
sim_compute_robot_state-npc1_max0.009835505485534668
sim_compute_robot_state-npc1_mean0.008577392612338012
sim_compute_robot_state-npc1_median0.008333182334899903
sim_compute_robot_state-npc1_min0.007498311996459961
sim_compute_robot_state-npc2_max0.009542355170616737
sim_compute_robot_state-npc2_mean0.008412117257863975
sim_compute_robot_state-npc2_median0.008244446345738001
sim_compute_robot_state-npc2_min0.007631013790766398
sim_compute_robot_state-npc3_max0.008961286544799805
sim_compute_robot_state-npc3_mean0.008452821746863393
sim_compute_robot_state-npc3_median0.008554180463155111
sim_compute_robot_state-npc3_min0.007670076269852488
sim_compute_sim_state_max0.005834884113735623
sim_compute_sim_state_mean0.005118937306244463
sim_compute_sim_state_median0.005047452449798584
sim_compute_sim_state_min0.004579995807848479
sim_physics_max0.2042918046315511
sim_physics_mean0.159502311087338
sim_physics_median0.16042065620422363
sim_physics_min0.12574335148459986
sim_render-ego_max0.015169409605172964
sim_render-ego_mean0.01331498798286154
sim_render-ego_median0.01293855621701195
sim_render-ego_min0.01179047425587972
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.0700000000000005
survival_time_min0.7500000000000001
No reset possible
27461step1-simulationsuccessyes0:10:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25862step1-simulationsuccessno0:12:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25183step1-simulationsuccessno0:14:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible