Duckietown Challenges Home Challenges Submissions

Submission 12759

Submission12759
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59025
Next
User labelsim-exercise-1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
59025LFVmultibodyv-simsuccessyes1:54:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.343397102967916
survival_time_median59.99999999999873
deviation-center-line_median2.700528601983299
in-drivable-lane_median7.174999999999683


other stats
agent_compute-ego0_max0.014014294304319663
agent_compute-ego0_mean0.013430345890793402
agent_compute-ego0_median0.013607627644725484
agent_compute-ego0_min0.01287405159352324
agent_compute-ego1_max0.01354411976422795
agent_compute-ego1_mean0.013148774825053364
agent_compute-ego1_median0.013441274207795688
agent_compute-ego1_min0.012612596737355812
complete-iteration_max0.8600937168762944
complete-iteration_mean0.758287131268785
complete-iteration_median0.8198405330524555
complete-iteration_min0.355766761908424
deviation-center-line_max3.689608460152421
deviation-center-line_mean2.352439298757687
deviation-center-line_min0.1833301261699805
deviation-heading_max14.379877156474922
deviation-heading_mean9.982971274624733
deviation-heading_median11.83394782442318
deviation-heading_min1.2738578238038551
driven_any_max11.419203435643125
driven_any_mean9.485626710467235
driven_any_median10.447320012190636
driven_any_min1.8815179336650096
driven_lanedir_consec_max11.028064563977225
driven_lanedir_consec_mean7.921924482976352
driven_lanedir_consec_min0.6404466649670963
driven_lanedir_max11.028064563977225
driven_lanedir_mean8.094395591124625
driven_lanedir_median9.343397102967916
driven_lanedir_min0.6404466649670963
get_duckie_state_max1.5974640349960643e-06
get_duckie_state_mean1.519588762221842e-06
get_duckie_state_median1.5845604482836569e-06
get_duckie_state_min1.3278783310660712e-06
get_robot_state_max0.015731629483606496
get_robot_state_mean0.014198521619406294
get_robot_state_median0.015548730670760612
get_robot_state_min0.007691181867346974
get_state_dump_max0.010280622232962808
get_state_dump_mean0.009509714971020315
get_state_dump_median0.010150233077367676
get_state_dump_min0.006562192275264083
get_ui_image_max0.0516956779581621
get_ui_image_mean0.0477827359312168
get_ui_image_median0.050216142581364795
get_ui_image_min0.03421653994513392
in-drivable-lane_max55.749999999998735
in-drivable-lane_mean14.221428571428062
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.805738160460685, "get_ui_image": 0.04821948524716494, "step_physics": 0.6717142332205666, "survival_time": 59.99999999999873, "driven_lanedir": 9.176034559999772, "get_state_dump": 0.010280622232962808, "get_robot_state": 0.015731629483606496, "sim_render-ego0": 0.004238156652966705, "sim_render-ego1": 0.004443640117343518, "sim_render-ego2": 0.004326519025156242, "sim_render-ego3": 0.004416341289294749, "get_duckie_state": 1.5845604482836569e-06, "in-drivable-lane": 15.249999999999169, "deviation-heading": 7.253007697957192, "agent_compute-ego0": 0.013607627644725484, "agent_compute-ego1": 0.013441274207795688, "agent_compute-ego2": 0.012437852792795454, "agent_compute-ego3": 0.013080892912255636, "complete-iteration": 0.8600937168762944, "set_robot_commands": 0.0026321454806490603, "deviation-center-line": 1.8526736887496311, "driven_lanedir_consec": 9.176034559999772, "sim_compute_sim_state": 0.02415860265021916, "sim_compute_performance-ego0": 0.0023327640053830874, "sim_compute_performance-ego1": 0.0022241755587969294, "sim_compute_performance-ego2": 0.002262170269129973, "sim_compute_performance-ego3": 0.002363387988469285}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 11.419203435643125, "get_ui_image": 0.04821948524716494, "step_physics": 0.6717142332205666, "survival_time": 59.99999999999873, "driven_lanedir": 11.028064563977225, "get_state_dump": 0.010280622232962808, "get_robot_state": 0.015731629483606496, "sim_render-ego0": 0.004238156652966705, "sim_render-ego1": 0.004443640117343518, "sim_render-ego2": 0.004326519025156242, "sim_render-ego3": 0.004416341289294749, "get_duckie_state": 1.5845604482836569e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.16534877699671, "agent_compute-ego0": 0.013607627644725484, "agent_compute-ego1": 0.013441274207795688, "agent_compute-ego2": 0.012437852792795454, "agent_compute-ego3": 0.013080892912255636, "complete-iteration": 0.8600937168762944, "set_robot_commands": 0.0026321454806490603, "deviation-center-line": 2.7706023845920145, "driven_lanedir_consec": 11.028064563977225, "sim_compute_sim_state": 0.02415860265021916, "sim_compute_performance-ego0": 0.0023327640053830874, "sim_compute_performance-ego1": 0.0022241755587969294, "sim_compute_performance-ego2": 0.002262170269129973, "sim_compute_performance-ego3": 0.002363387988469285}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.8815179336650096, "get_ui_image": 0.04821948524716494, "step_physics": 0.6717142332205666, "survival_time": 59.99999999999873, "driven_lanedir": 0.6404466649670963, "get_state_dump": 0.010280622232962808, "get_robot_state": 0.015731629483606496, "sim_render-ego0": 0.004238156652966705, "sim_render-ego1": 0.004443640117343518, "sim_render-ego2": 0.004326519025156242, "sim_render-ego3": 0.004416341289294749, "get_duckie_state": 1.5845604482836569e-06, "in-drivable-lane": 55.749999999998735, "deviation-heading": 1.2738578238038551, "agent_compute-ego0": 0.013607627644725484, "agent_compute-ego1": 0.013441274207795688, "agent_compute-ego2": 0.012437852792795454, "agent_compute-ego3": 0.013080892912255636, "complete-iteration": 0.8600937168762944, "set_robot_commands": 0.0026321454806490603, "deviation-center-line": 0.1833301261699805, "driven_lanedir_consec": 0.6404466649670963, "sim_compute_sim_state": 0.02415860265021916, "sim_compute_performance-ego0": 0.0023327640053830874, "sim_compute_performance-ego1": 0.0022241755587969294, "sim_compute_performance-ego2": 0.002262170269129973, "sim_compute_performance-ego3": 0.002363387988469285}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.095067683319511, "get_ui_image": 0.04821948524716494, "step_physics": 0.6717142332205666, "survival_time": 59.99999999999873, "driven_lanedir": 9.687637246775129, "get_state_dump": 0.010280622232962808, "get_robot_state": 0.015731629483606496, "sim_render-ego0": 0.004238156652966705, "sim_render-ego1": 0.004443640117343518, "sim_render-ego2": 0.004326519025156242, "sim_render-ego3": 0.004416341289294749, "get_duckie_state": 1.5845604482836569e-06, "in-drivable-lane": 0.5499999999999687, "deviation-heading": 11.557961935645173, "agent_compute-ego0": 0.013607627644725484, "agent_compute-ego1": 0.013441274207795688, "agent_compute-ego2": 0.012437852792795454, "agent_compute-ego3": 0.013080892912255636, "complete-iteration": 0.8600937168762944, "set_robot_commands": 0.0026321454806490603, "deviation-center-line": 2.4142202222350506, "driven_lanedir_consec": 9.687637246775129, "sim_compute_sim_state": 0.02415860265021916, "sim_compute_performance-ego0": 0.0023327640053830874, "sim_compute_performance-ego1": 0.0022241755587969294, "sim_compute_performance-ego2": 0.002262170269129973, "sim_compute_performance-ego3": 0.002363387988469285}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 10.155185797846151, "get_ui_image": 0.050216142581364795, "step_physics": 0.6176136987195424, "survival_time": 59.99999999999873, "driven_lanedir": 9.79307118565061, "get_state_dump": 0.009572050950608584, "get_robot_state": 0.014568874579881453, "sim_render-ego0": 0.00400808530485104, "sim_render-ego1": 0.004144988985085468, "sim_render-ego2": 0.004171489775925254, "sim_render-ego3": 0.004173058256519327, "get_duckie_state": 1.4725970189636892e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.263070929364565, "agent_compute-ego0": 0.01287405159352324, "agent_compute-ego1": 0.012612596737355812, "agent_compute-ego2": 0.01269209494102408, "agent_compute-ego3": 0.012724364032157752, "complete-iteration": 0.8198405330524555, "set_robot_commands": 0.002289523292242934, "deviation-center-line": 3.689608460152421, "driven_lanedir_consec": 9.79307118565061, "sim_compute_sim_state": 0.042689736737101205, "sim_compute_performance-ego0": 0.00216353803153439, "sim_compute_performance-ego1": 0.002020993498739454, "sim_compute_performance-ego2": 0.0020642004640374356, "sim_compute_performance-ego3": 0.002075157594323456}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.21431105979769, "get_ui_image": 0.050216142581364795, "step_physics": 0.6176136987195424, "survival_time": 59.99999999999873, "driven_lanedir": 10.557390754492468, "get_state_dump": 0.009572050950608584, "get_robot_state": 0.014568874579881453, "sim_render-ego0": 0.00400808530485104, "sim_render-ego1": 0.004144988985085468, "sim_render-ego2": 0.004171489775925254, "sim_render-ego3": 0.004173058256519327, "get_duckie_state": 1.4725970189636892e-06, "in-drivable-lane": 1.249999999999929, "deviation-heading": 14.379877156474922, "agent_compute-ego0": 0.01287405159352324, "agent_compute-ego1": 0.012612596737355812, "agent_compute-ego2": 0.01269209494102408, "agent_compute-ego3": 0.012724364032157752, "complete-iteration": 0.8198405330524555, "set_robot_commands": 0.002289523292242934, "deviation-center-line": 3.228795889978828, "driven_lanedir_consec": 10.557390754492468, "sim_compute_sim_state": 0.042689736737101205, "sim_compute_performance-ego0": 0.00216353803153439, "sim_compute_performance-ego1": 0.002020993498739454, "sim_compute_performance-ego2": 0.0020642004640374356, "sim_compute_performance-ego3": 0.002075157594323456}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 8.025805687088663, "get_ui_image": 0.050216142581364795, "step_physics": 0.6176136987195424, "survival_time": 59.99999999999873, "driven_lanedir": 6.434855829685121, "get_state_dump": 0.009572050950608584, "get_robot_state": 0.014568874579881453, "sim_render-ego0": 0.00400808530485104, "sim_render-ego1": 0.004144988985085468, "sim_render-ego2": 0.004171489775925254, "sim_render-ego3": 0.004173058256519327, "get_duckie_state": 1.4725970189636892e-06, "in-drivable-lane": 24.399999999998613, "deviation-heading": 8.884265244234786, "agent_compute-ego0": 0.01287405159352324, "agent_compute-ego1": 0.012612596737355812, "agent_compute-ego2": 0.01269209494102408, "agent_compute-ego3": 0.012724364032157752, "complete-iteration": 0.8198405330524555, "set_robot_commands": 0.002289523292242934, "deviation-center-line": 2.5171935512213413, "driven_lanedir_consec": 6.434855829685121, "sim_compute_sim_state": 0.042689736737101205, "sim_compute_performance-ego0": 0.00216353803153439, "sim_compute_performance-ego1": 0.002020993498739454, "sim_compute_performance-ego2": 0.0020642004640374356, "sim_compute_performance-ego3": 0.002075157594323456}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 10.757393786067432, "get_ui_image": 0.050216142581364795, "step_physics": 0.6176136987195424, "survival_time": 59.99999999999873, "driven_lanedir": 8.718211232974378, "get_state_dump": 0.009572050950608584, "get_robot_state": 0.014568874579881453, "sim_render-ego0": 0.00400808530485104, "sim_render-ego1": 0.004144988985085468, "sim_render-ego2": 0.004171489775925254, "sim_render-ego3": 0.004173058256519327, "get_duckie_state": 1.4725970189636892e-06, "in-drivable-lane": 9.899999999999505, "deviation-heading": 12.63753826303738, "agent_compute-ego0": 0.01287405159352324, "agent_compute-ego1": 0.012612596737355812, "agent_compute-ego2": 0.01269209494102408, "agent_compute-ego3": 0.012724364032157752, "complete-iteration": 0.8198405330524555, "set_robot_commands": 0.002289523292242934, "deviation-center-line": 2.6789482065050065, "driven_lanedir_consec": 8.718211232974378, "sim_compute_sim_state": 0.042689736737101205, "sim_compute_performance-ego0": 0.00216353803153439, "sim_compute_performance-ego1": 0.002020993498739454, "sim_compute_performance-ego2": 0.0020642004640374356, "sim_compute_performance-ego3": 0.002075157594323456}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 10.493978234675868, "get_ui_image": 0.0516956779581621, "step_physics": 0.582761122523299, "survival_time": 59.99999999999873, "driven_lanedir": 4.750479402118977, "get_state_dump": 0.010150233077367676, "get_robot_state": 0.015548730670760612, "sim_render-ego0": 0.004312675858814452, "sim_render-ego1": 0.004368586703005877, "sim_render-ego2": 0.004383133015565133, "sim_render-ego3": 0.004392270343091267, "get_duckie_state": 1.5974640349960643e-06, "in-drivable-lane": 34.04999999999849, "deviation-heading": 5.667108145132352, "agent_compute-ego0": 0.014014294304319663, "agent_compute-ego1": 0.01354411976422795, "agent_compute-ego2": 0.01319016108008646, "agent_compute-ego3": 0.013362870029763914, "complete-iteration": 0.7961873285577855, "set_robot_commands": 0.0023921741037741984, "deviation-center-line": 1.1246274946083263, "driven_lanedir_consec": 4.7471705917341405, "sim_compute_sim_state": 0.045406008838713915, "sim_compute_performance-ego0": 0.002348045822384951, "sim_compute_performance-ego1": 0.0022013838543284447, "sim_compute_performance-ego2": 0.002232597233552322, "sim_compute_performance-ego3": 0.002230577921490189}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.157345337140203, "get_ui_image": 0.0516956779581621, "step_physics": 0.582761122523299, "survival_time": 59.99999999999873, "driven_lanedir": 10.784577598768124, "get_state_dump": 0.010150233077367676, "get_robot_state": 0.015548730670760612, "sim_render-ego0": 0.004312675858814452, "sim_render-ego1": 0.004368586703005877, "sim_render-ego2": 0.004383133015565133, "sim_render-ego3": 0.004392270343091267, "get_duckie_state": 1.5974640349960643e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.392459520934969, "agent_compute-ego0": 0.014014294304319663, "agent_compute-ego1": 0.01354411976422795, "agent_compute-ego2": 0.01319016108008646, "agent_compute-ego3": 0.013362870029763914, "complete-iteration": 0.7961873285577855, "set_robot_commands": 0.0023921741037741984, "deviation-center-line": 3.107565800461282, "driven_lanedir_consec": 10.784577598768124, "sim_compute_sim_state": 0.045406008838713915, "sim_compute_performance-ego0": 0.002348045822384951, "sim_compute_performance-ego1": 0.0022013838543284447, "sim_compute_performance-ego2": 0.002232597233552322, "sim_compute_performance-ego3": 0.002230577921490189}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 11.05200495744596, "get_ui_image": 0.0516956779581621, "step_physics": 0.582761122523299, "survival_time": 59.99999999999873, "driven_lanedir": 10.777513268815788, "get_state_dump": 0.010150233077367676, "get_robot_state": 0.015548730670760612, "sim_render-ego0": 0.004312675858814452, "sim_render-ego1": 0.004368586703005877, "sim_render-ego2": 0.004383133015565133, "sim_render-ego3": 0.004392270343091267, "get_duckie_state": 1.5974640349960643e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.75522282420412, "agent_compute-ego0": 0.014014294304319663, "agent_compute-ego1": 0.01354411976422795, "agent_compute-ego2": 0.01319016108008646, "agent_compute-ego3": 0.013362870029763914, "complete-iteration": 0.7961873285577855, "set_robot_commands": 0.0023921741037741984, "deviation-center-line": 2.9845326845957345, "driven_lanedir_consec": 10.777513268815788, "sim_compute_sim_state": 0.045406008838713915, "sim_compute_performance-ego0": 0.002348045822384951, "sim_compute_performance-ego1": 0.0022013838543284447, "sim_compute_performance-ego2": 0.002232597233552322, "sim_compute_performance-ego3": 0.002230577921490189}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 10.400661789705406, "get_ui_image": 0.0516956779581621, "step_physics": 0.582761122523299, "survival_time": 59.99999999999873, "driven_lanedir": 8.09719654701307, "get_state_dump": 0.010150233077367676, "get_robot_state": 0.015548730670760612, "sim_render-ego0": 0.004312675858814452, "sim_render-ego1": 0.004368586703005877, "sim_render-ego2": 0.004383133015565133, "sim_render-ego3": 0.004392270343091267, "get_duckie_state": 1.5974640349960643e-06, "in-drivable-lane": 11.949999999999974, "deviation-heading": 12.109933713201189, "agent_compute-ego0": 0.014014294304319663, "agent_compute-ego1": 0.01354411976422795, "agent_compute-ego2": 0.01319016108008646, "agent_compute-ego3": 0.013362870029763914, "complete-iteration": 0.7961873285577855, "set_robot_commands": 0.0023921741037741984, "deviation-center-line": 2.8887499290073473, "driven_lanedir_consec": 5.685909843322079, "sim_compute_sim_state": 0.045406008838713915, "sim_compute_performance-ego0": 0.002348045822384951, "sim_compute_performance-ego1": 0.0022013838543284447, "sim_compute_performance-ego2": 0.002232597233552322, "sim_compute_performance-ego3": 0.002230577921490189}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.701952946008591, "get_ui_image": 0.03421653994513392, "step_physics": 0.2545052892858043, "survival_time": 59.99999999999873, "driven_lanedir": 3.365299774570922, "get_state_dump": 0.006562192275264083, "get_robot_state": 0.007691181867346974, "sim_render-ego0": 0.004148579556975734, "sim_render-ego1": 0.004284820389886581, "get_duckie_state": 1.3278783310660712e-06, "in-drivable-lane": 41.549999999998604, "deviation-heading": 3.6998806694333974, "agent_compute-ego0": 0.013020474150417053, "agent_compute-ego1": 0.012845442356614646, "complete-iteration": 0.355766761908424, "set_robot_commands": 0.0023971586600628424, "deviation-center-line": 0.7711927468690618, "driven_lanedir_consec": 3.365299774570922, "sim_compute_sim_state": 0.009112842275538512, "sim_compute_performance-ego0": 0.0021485244106194262, "sim_compute_performance-ego1": 0.0021673545154504833}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.638607137677026, "get_ui_image": 0.03421653994513392, "step_physics": 0.2545052892858043, "survival_time": 59.99999999999873, "driven_lanedir": 9.510759645936062, "get_state_dump": 0.006562192275264083, "get_robot_state": 0.007691181867346974, "sim_render-ego0": 0.004148579556975734, "sim_render-ego1": 0.004284820389886581, "get_duckie_state": 1.3278783310660712e-06, "in-drivable-lane": 4.449999999999861, "deviation-heading": 12.722065144325644, "agent_compute-ego0": 0.013020474150417053, "agent_compute-ego1": 0.012845442356614646, "complete-iteration": 0.355766761908424, "set_robot_commands": 0.0023971586600628424, "deviation-center-line": 2.722108997461592, "driven_lanedir_consec": 9.510759645936062, "sim_compute_sim_state": 0.009112842275538512, "sim_compute_performance-ego0": 0.0021485244106194262, "sim_compute_performance-ego1": 0.0021673545154504833}}
set_robot_commands_max0.0026321454806490603
set_robot_commands_mean0.0024321206304850325
set_robot_commands_median0.0023921741037741984
set_robot_commands_min0.002289523292242934
sim_compute_performance-ego0_max0.002348045822384951
sim_compute_performance-ego0_mean0.002262460018460612
sim_compute_performance-ego0_median0.0023327640053830874
sim_compute_performance-ego0_min0.0021485244106194262
sim_compute_performance-ego1_max0.0022241755587969294
sim_compute_performance-ego1_mean0.002151494334168592
sim_compute_performance-ego1_median0.0022013838543284447
sim_compute_performance-ego1_min0.002020993498739454
sim_compute_sim_state_max0.045406008838713915
sim_compute_sim_state_mean0.0333745055325153
sim_compute_sim_state_median0.042689736737101205
sim_compute_sim_state_min0.009112842275538512
sim_render-ego0_max0.004312675858814452
sim_render-ego0_mean0.00418091645574859
sim_render-ego0_median0.004238156652966705
sim_render-ego0_min0.00400808530485104
sim_render-ego1_max0.004443640117343518
sim_render-ego1_mean0.004314178857250901
sim_render-ego1_median0.004368586703005877
sim_render-ego1_min0.004144988985085468
simulation-passed1
step_physics_max0.6717142332205666
step_physics_mean0.5712404854589456
step_physics_median0.6176136987195424
step_physics_min0.2545052892858043
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible