Duckietown Challenges Home Challenges Submissions

Submission 12759

Submission12759
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59025
Next
User labelsim-exercise-1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59025LFVmultibodyv-simsuccessyes1:54:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.343397102967916
survival_time_median59.99999999999873
deviation-center-line_median2.700528601983299
in-drivable-lane_median7.174999999999683


other stats
agent_compute-ego0_max0.014014294304319663
agent_compute-ego0_mean0.013430345890793402
agent_compute-ego0_median0.013607627644725484
agent_compute-ego0_min0.01287405159352324
agent_compute-ego1_max0.01354411976422795
agent_compute-ego1_mean0.013148774825053364
agent_compute-ego1_median0.013441274207795688
agent_compute-ego1_min0.012612596737355812
complete-iteration_max0.8600937168762944
complete-iteration_mean0.758287131268785
complete-iteration_median0.8198405330524555
complete-iteration_min0.355766761908424
deviation-center-line_max3.689608460152421
deviation-center-line_mean2.352439298757687
deviation-center-line_min0.1833301261699805
deviation-heading_max14.379877156474922
deviation-heading_mean9.982971274624733
deviation-heading_median11.83394782442318
deviation-heading_min1.2738578238038551
driven_any_max11.419203435643125
driven_any_mean9.485626710467235
driven_any_median10.447320012190636
driven_any_min1.8815179336650096
driven_lanedir_consec_max11.028064563977225
driven_lanedir_consec_mean7.921924482976352
driven_lanedir_consec_min0.6404466649670963
driven_lanedir_max11.028064563977225
driven_lanedir_mean8.094395591124625
driven_lanedir_median9.343397102967916
driven_lanedir_min0.6404466649670963
get_duckie_state_max1.5974640349960643e-06
get_duckie_state_mean1.519588762221842e-06
get_duckie_state_median1.5845604482836569e-06
get_duckie_state_min1.3278783310660712e-06
get_robot_state_max0.015731629483606496
get_robot_state_mean0.014198521619406294
get_robot_state_median0.015548730670760612
get_robot_state_min0.007691181867346974
get_state_dump_max0.010280622232962808
get_state_dump_mean0.009509714971020315
get_state_dump_median0.010150233077367676
get_state_dump_min0.006562192275264083
get_ui_image_max0.0516956779581621
get_ui_image_mean0.0477827359312168
get_ui_image_median0.050216142581364795
get_ui_image_min0.03421653994513392
in-drivable-lane_max55.749999999998735
in-drivable-lane_mean14.221428571428062
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.805738160460685, "get_ui_image": 0.04821948524716494, "step_physics": 0.6717142332205666, "survival_time": 59.99999999999873, "driven_lanedir": 9.176034559999772, "get_state_dump": 0.010280622232962808, "get_robot_state": 0.015731629483606496, "sim_render-ego0": 0.004238156652966705, "sim_render-ego1": 0.004443640117343518, "sim_render-ego2": 0.004326519025156242, "sim_render-ego3": 0.004416341289294749, "get_duckie_state": 1.5845604482836569e-06, "in-drivable-lane": 15.249999999999169, "deviation-heading": 7.253007697957192, "agent_compute-ego0": 0.013607627644725484, "agent_compute-ego1": 0.013441274207795688, "agent_compute-ego2": 0.012437852792795454, "agent_compute-ego3": 0.013080892912255636, "complete-iteration": 0.8600937168762944, "set_robot_commands": 0.0026321454806490603, "deviation-center-line": 1.8526736887496311, "driven_lanedir_consec": 9.176034559999772, "sim_compute_sim_state": 0.02415860265021916, "sim_compute_performance-ego0": 0.0023327640053830874, "sim_compute_performance-ego1": 0.0022241755587969294, "sim_compute_performance-ego2": 0.002262170269129973, "sim_compute_performance-ego3": 0.002363387988469285}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 11.419203435643125, "get_ui_image": 0.04821948524716494, "step_physics": 0.6717142332205666, "survival_time": 59.99999999999873, "driven_lanedir": 11.028064563977225, "get_state_dump": 0.010280622232962808, "get_robot_state": 0.015731629483606496, "sim_render-ego0": 0.004238156652966705, "sim_render-ego1": 0.004443640117343518, "sim_render-ego2": 0.004326519025156242, "sim_render-ego3": 0.004416341289294749, "get_duckie_state": 1.5845604482836569e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.16534877699671, "agent_compute-ego0": 0.013607627644725484, "agent_compute-ego1": 0.013441274207795688, "agent_compute-ego2": 0.012437852792795454, "agent_compute-ego3": 0.013080892912255636, "complete-iteration": 0.8600937168762944, "set_robot_commands": 0.0026321454806490603, "deviation-center-line": 2.7706023845920145, "driven_lanedir_consec": 11.028064563977225, "sim_compute_sim_state": 0.02415860265021916, "sim_compute_performance-ego0": 0.0023327640053830874, "sim_compute_performance-ego1": 0.0022241755587969294, "sim_compute_performance-ego2": 0.002262170269129973, "sim_compute_performance-ego3": 0.002363387988469285}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.8815179336650096, "get_ui_image": 0.04821948524716494, "step_physics": 0.6717142332205666, "survival_time": 59.99999999999873, "driven_lanedir": 0.6404466649670963, "get_state_dump": 0.010280622232962808, "get_robot_state": 0.015731629483606496, "sim_render-ego0": 0.004238156652966705, "sim_render-ego1": 0.004443640117343518, "sim_render-ego2": 0.004326519025156242, "sim_render-ego3": 0.004416341289294749, "get_duckie_state": 1.5845604482836569e-06, "in-drivable-lane": 55.749999999998735, "deviation-heading": 1.2738578238038551, "agent_compute-ego0": 0.013607627644725484, "agent_compute-ego1": 0.013441274207795688, "agent_compute-ego2": 0.012437852792795454, "agent_compute-ego3": 0.013080892912255636, "complete-iteration": 0.8600937168762944, "set_robot_commands": 0.0026321454806490603, "deviation-center-line": 0.1833301261699805, "driven_lanedir_consec": 0.6404466649670963, "sim_compute_sim_state": 0.02415860265021916, "sim_compute_performance-ego0": 0.0023327640053830874, "sim_compute_performance-ego1": 0.0022241755587969294, "sim_compute_performance-ego2": 0.002262170269129973, "sim_compute_performance-ego3": 0.002363387988469285}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.095067683319511, "get_ui_image": 0.04821948524716494, "step_physics": 0.6717142332205666, "survival_time": 59.99999999999873, "driven_lanedir": 9.687637246775129, "get_state_dump": 0.010280622232962808, "get_robot_state": 0.015731629483606496, "sim_render-ego0": 0.004238156652966705, "sim_render-ego1": 0.004443640117343518, "sim_render-ego2": 0.004326519025156242, "sim_render-ego3": 0.004416341289294749, "get_duckie_state": 1.5845604482836569e-06, "in-drivable-lane": 0.5499999999999687, "deviation-heading": 11.557961935645173, "agent_compute-ego0": 0.013607627644725484, "agent_compute-ego1": 0.013441274207795688, "agent_compute-ego2": 0.012437852792795454, "agent_compute-ego3": 0.013080892912255636, "complete-iteration": 0.8600937168762944, "set_robot_commands": 0.0026321454806490603, "deviation-center-line": 2.4142202222350506, "driven_lanedir_consec": 9.687637246775129, "sim_compute_sim_state": 0.02415860265021916, "sim_compute_performance-ego0": 0.0023327640053830874, "sim_compute_performance-ego1": 0.0022241755587969294, "sim_compute_performance-ego2": 0.002262170269129973, "sim_compute_performance-ego3": 0.002363387988469285}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 10.155185797846151, "get_ui_image": 0.050216142581364795, "step_physics": 0.6176136987195424, "survival_time": 59.99999999999873, "driven_lanedir": 9.79307118565061, "get_state_dump": 0.009572050950608584, "get_robot_state": 0.014568874579881453, "sim_render-ego0": 0.00400808530485104, "sim_render-ego1": 0.004144988985085468, "sim_render-ego2": 0.004171489775925254, "sim_render-ego3": 0.004173058256519327, "get_duckie_state": 1.4725970189636892e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.263070929364565, "agent_compute-ego0": 0.01287405159352324, "agent_compute-ego1": 0.012612596737355812, "agent_compute-ego2": 0.01269209494102408, "agent_compute-ego3": 0.012724364032157752, "complete-iteration": 0.8198405330524555, "set_robot_commands": 0.002289523292242934, "deviation-center-line": 3.689608460152421, "driven_lanedir_consec": 9.79307118565061, "sim_compute_sim_state": 0.042689736737101205, "sim_compute_performance-ego0": 0.00216353803153439, "sim_compute_performance-ego1": 0.002020993498739454, "sim_compute_performance-ego2": 0.0020642004640374356, "sim_compute_performance-ego3": 0.002075157594323456}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.21431105979769, "get_ui_image": 0.050216142581364795, "step_physics": 0.6176136987195424, "survival_time": 59.99999999999873, "driven_lanedir": 10.557390754492468, "get_state_dump": 0.009572050950608584, "get_robot_state": 0.014568874579881453, "sim_render-ego0": 0.00400808530485104, "sim_render-ego1": 0.004144988985085468, "sim_render-ego2": 0.004171489775925254, "sim_render-ego3": 0.004173058256519327, "get_duckie_state": 1.4725970189636892e-06, "in-drivable-lane": 1.249999999999929, "deviation-heading": 14.379877156474922, "agent_compute-ego0": 0.01287405159352324, "agent_compute-ego1": 0.012612596737355812, "agent_compute-ego2": 0.01269209494102408, "agent_compute-ego3": 0.012724364032157752, "complete-iteration": 0.8198405330524555, "set_robot_commands": 0.002289523292242934, "deviation-center-line": 3.228795889978828, "driven_lanedir_consec": 10.557390754492468, "sim_compute_sim_state": 0.042689736737101205, "sim_compute_performance-ego0": 0.00216353803153439, "sim_compute_performance-ego1": 0.002020993498739454, "sim_compute_performance-ego2": 0.0020642004640374356, "sim_compute_performance-ego3": 0.002075157594323456}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 8.025805687088663, "get_ui_image": 0.050216142581364795, "step_physics": 0.6176136987195424, "survival_time": 59.99999999999873, "driven_lanedir": 6.434855829685121, "get_state_dump": 0.009572050950608584, "get_robot_state": 0.014568874579881453, "sim_render-ego0": 0.00400808530485104, "sim_render-ego1": 0.004144988985085468, "sim_render-ego2": 0.004171489775925254, "sim_render-ego3": 0.004173058256519327, "get_duckie_state": 1.4725970189636892e-06, "in-drivable-lane": 24.399999999998613, "deviation-heading": 8.884265244234786, "agent_compute-ego0": 0.01287405159352324, "agent_compute-ego1": 0.012612596737355812, "agent_compute-ego2": 0.01269209494102408, "agent_compute-ego3": 0.012724364032157752, "complete-iteration": 0.8198405330524555, "set_robot_commands": 0.002289523292242934, "deviation-center-line": 2.5171935512213413, "driven_lanedir_consec": 6.434855829685121, "sim_compute_sim_state": 0.042689736737101205, "sim_compute_performance-ego0": 0.00216353803153439, "sim_compute_performance-ego1": 0.002020993498739454, "sim_compute_performance-ego2": 0.0020642004640374356, "sim_compute_performance-ego3": 0.002075157594323456}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 10.757393786067432, "get_ui_image": 0.050216142581364795, "step_physics": 0.6176136987195424, "survival_time": 59.99999999999873, "driven_lanedir": 8.718211232974378, "get_state_dump": 0.009572050950608584, "get_robot_state": 0.014568874579881453, "sim_render-ego0": 0.00400808530485104, "sim_render-ego1": 0.004144988985085468, "sim_render-ego2": 0.004171489775925254, "sim_render-ego3": 0.004173058256519327, "get_duckie_state": 1.4725970189636892e-06, "in-drivable-lane": 9.899999999999505, "deviation-heading": 12.63753826303738, "agent_compute-ego0": 0.01287405159352324, "agent_compute-ego1": 0.012612596737355812, "agent_compute-ego2": 0.01269209494102408, "agent_compute-ego3": 0.012724364032157752, "complete-iteration": 0.8198405330524555, "set_robot_commands": 0.002289523292242934, "deviation-center-line": 2.6789482065050065, "driven_lanedir_consec": 8.718211232974378, "sim_compute_sim_state": 0.042689736737101205, "sim_compute_performance-ego0": 0.00216353803153439, "sim_compute_performance-ego1": 0.002020993498739454, "sim_compute_performance-ego2": 0.0020642004640374356, "sim_compute_performance-ego3": 0.002075157594323456}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 10.493978234675868, "get_ui_image": 0.0516956779581621, "step_physics": 0.582761122523299, "survival_time": 59.99999999999873, "driven_lanedir": 4.750479402118977, "get_state_dump": 0.010150233077367676, "get_robot_state": 0.015548730670760612, "sim_render-ego0": 0.004312675858814452, "sim_render-ego1": 0.004368586703005877, "sim_render-ego2": 0.004383133015565133, "sim_render-ego3": 0.004392270343091267, "get_duckie_state": 1.5974640349960643e-06, "in-drivable-lane": 34.04999999999849, "deviation-heading": 5.667108145132352, "agent_compute-ego0": 0.014014294304319663, "agent_compute-ego1": 0.01354411976422795, "agent_compute-ego2": 0.01319016108008646, "agent_compute-ego3": 0.013362870029763914, "complete-iteration": 0.7961873285577855, "set_robot_commands": 0.0023921741037741984, "deviation-center-line": 1.1246274946083263, "driven_lanedir_consec": 4.7471705917341405, "sim_compute_sim_state": 0.045406008838713915, "sim_compute_performance-ego0": 0.002348045822384951, "sim_compute_performance-ego1": 0.0022013838543284447, "sim_compute_performance-ego2": 0.002232597233552322, "sim_compute_performance-ego3": 0.002230577921490189}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.157345337140203, "get_ui_image": 0.0516956779581621, "step_physics": 0.582761122523299, "survival_time": 59.99999999999873, "driven_lanedir": 10.784577598768124, "get_state_dump": 0.010150233077367676, "get_robot_state": 0.015548730670760612, "sim_render-ego0": 0.004312675858814452, "sim_render-ego1": 0.004368586703005877, "sim_render-ego2": 0.004383133015565133, "sim_render-ego3": 0.004392270343091267, "get_duckie_state": 1.5974640349960643e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.392459520934969, "agent_compute-ego0": 0.014014294304319663, "agent_compute-ego1": 0.01354411976422795, "agent_compute-ego2": 0.01319016108008646, "agent_compute-ego3": 0.013362870029763914, "complete-iteration": 0.7961873285577855, "set_robot_commands": 0.0023921741037741984, "deviation-center-line": 3.107565800461282, "driven_lanedir_consec": 10.784577598768124, "sim_compute_sim_state": 0.045406008838713915, "sim_compute_performance-ego0": 0.002348045822384951, "sim_compute_performance-ego1": 0.0022013838543284447, "sim_compute_performance-ego2": 0.002232597233552322, "sim_compute_performance-ego3": 0.002230577921490189}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 11.05200495744596, "get_ui_image": 0.0516956779581621, "step_physics": 0.582761122523299, "survival_time": 59.99999999999873, "driven_lanedir": 10.777513268815788, "get_state_dump": 0.010150233077367676, "get_robot_state": 0.015548730670760612, "sim_render-ego0": 0.004312675858814452, "sim_render-ego1": 0.004368586703005877, "sim_render-ego2": 0.004383133015565133, "sim_render-ego3": 0.004392270343091267, "get_duckie_state": 1.5974640349960643e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.75522282420412, "agent_compute-ego0": 0.014014294304319663, "agent_compute-ego1": 0.01354411976422795, "agent_compute-ego2": 0.01319016108008646, "agent_compute-ego3": 0.013362870029763914, "complete-iteration": 0.7961873285577855, "set_robot_commands": 0.0023921741037741984, "deviation-center-line": 2.9845326845957345, "driven_lanedir_consec": 10.777513268815788, "sim_compute_sim_state": 0.045406008838713915, "sim_compute_performance-ego0": 0.002348045822384951, "sim_compute_performance-ego1": 0.0022013838543284447, "sim_compute_performance-ego2": 0.002232597233552322, "sim_compute_performance-ego3": 0.002230577921490189}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 10.400661789705406, "get_ui_image": 0.0516956779581621, "step_physics": 0.582761122523299, "survival_time": 59.99999999999873, "driven_lanedir": 8.09719654701307, "get_state_dump": 0.010150233077367676, "get_robot_state": 0.015548730670760612, "sim_render-ego0": 0.004312675858814452, "sim_render-ego1": 0.004368586703005877, "sim_render-ego2": 0.004383133015565133, "sim_render-ego3": 0.004392270343091267, "get_duckie_state": 1.5974640349960643e-06, "in-drivable-lane": 11.949999999999974, "deviation-heading": 12.109933713201189, "agent_compute-ego0": 0.014014294304319663, "agent_compute-ego1": 0.01354411976422795, "agent_compute-ego2": 0.01319016108008646, "agent_compute-ego3": 0.013362870029763914, "complete-iteration": 0.7961873285577855, "set_robot_commands": 0.0023921741037741984, "deviation-center-line": 2.8887499290073473, "driven_lanedir_consec": 5.685909843322079, "sim_compute_sim_state": 0.045406008838713915, "sim_compute_performance-ego0": 0.002348045822384951, "sim_compute_performance-ego1": 0.0022013838543284447, "sim_compute_performance-ego2": 0.002232597233552322, "sim_compute_performance-ego3": 0.002230577921490189}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.701952946008591, "get_ui_image": 0.03421653994513392, "step_physics": 0.2545052892858043, "survival_time": 59.99999999999873, "driven_lanedir": 3.365299774570922, "get_state_dump": 0.006562192275264083, "get_robot_state": 0.007691181867346974, "sim_render-ego0": 0.004148579556975734, "sim_render-ego1": 0.004284820389886581, "get_duckie_state": 1.3278783310660712e-06, "in-drivable-lane": 41.549999999998604, "deviation-heading": 3.6998806694333974, "agent_compute-ego0": 0.013020474150417053, "agent_compute-ego1": 0.012845442356614646, "complete-iteration": 0.355766761908424, "set_robot_commands": 0.0023971586600628424, "deviation-center-line": 0.7711927468690618, "driven_lanedir_consec": 3.365299774570922, "sim_compute_sim_state": 0.009112842275538512, "sim_compute_performance-ego0": 0.0021485244106194262, "sim_compute_performance-ego1": 0.0021673545154504833}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.638607137677026, "get_ui_image": 0.03421653994513392, "step_physics": 0.2545052892858043, "survival_time": 59.99999999999873, "driven_lanedir": 9.510759645936062, "get_state_dump": 0.006562192275264083, "get_robot_state": 0.007691181867346974, "sim_render-ego0": 0.004148579556975734, "sim_render-ego1": 0.004284820389886581, "get_duckie_state": 1.3278783310660712e-06, "in-drivable-lane": 4.449999999999861, "deviation-heading": 12.722065144325644, "agent_compute-ego0": 0.013020474150417053, "agent_compute-ego1": 0.012845442356614646, "complete-iteration": 0.355766761908424, "set_robot_commands": 0.0023971586600628424, "deviation-center-line": 2.722108997461592, "driven_lanedir_consec": 9.510759645936062, "sim_compute_sim_state": 0.009112842275538512, "sim_compute_performance-ego0": 0.0021485244106194262, "sim_compute_performance-ego1": 0.0021673545154504833}}
set_robot_commands_max0.0026321454806490603
set_robot_commands_mean0.0024321206304850325
set_robot_commands_median0.0023921741037741984
set_robot_commands_min0.002289523292242934
sim_compute_performance-ego0_max0.002348045822384951
sim_compute_performance-ego0_mean0.002262460018460612
sim_compute_performance-ego0_median0.0023327640053830874
sim_compute_performance-ego0_min0.0021485244106194262
sim_compute_performance-ego1_max0.0022241755587969294
sim_compute_performance-ego1_mean0.002151494334168592
sim_compute_performance-ego1_median0.0022013838543284447
sim_compute_performance-ego1_min0.002020993498739454
sim_compute_sim_state_max0.045406008838713915
sim_compute_sim_state_mean0.0333745055325153
sim_compute_sim_state_median0.042689736737101205
sim_compute_sim_state_min0.009112842275538512
sim_render-ego0_max0.004312675858814452
sim_render-ego0_mean0.00418091645574859
sim_render-ego0_median0.004238156652966705
sim_render-ego0_min0.00400808530485104
sim_render-ego1_max0.004443640117343518
sim_render-ego1_mean0.004314178857250901
sim_render-ego1_median0.004368586703005877
sim_render-ego1_min0.004144988985085468
simulation-passed1
step_physics_max0.6717142332205666
step_physics_mean0.5712404854589456
step_physics_median0.6176136987195424
step_physics_min0.2545052892858043
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible