Duckietown Challenges Home Challenges Submissions

Job 53575

Job ID53575
submission12658
userBea Baselines 🐤
user labeltemplate-tensorflow
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration0:23:01
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31992881737322587
survival_time_median9.6
deviation-center-line_median0.07835975569599478
in-drivable-lane_median7.700000000000003


other stats
agent_compute-ego0_max0.02973057542528425
agent_compute-ego0_mean0.017871086186405764
agent_compute-ego0_median0.013739312868661832
agent_compute-ego0_min0.012613231964532842
agent_compute-ego1_max0.028904400174579924
agent_compute-ego1_mean0.017246666747591448
agent_compute-ego1_median0.013217613487046
agent_compute-ego1_min0.011743682524117316
agent_compute-ego2_max0.029571815142555843
agent_compute-ego2_mean0.01851379537660823
agent_compute-ego2_median0.013184431508101151
agent_compute-ego2_min0.01278513947916772
agent_compute-ego3_max0.028675177740672277
agent_compute-ego3_mean0.01803744872070671
agent_compute-ego3_median0.013483567559039657
agent_compute-ego3_min0.01195360086240821
complete-iteration_max1.1561053518265012
complete-iteration_mean0.9727871255160272
complete-iteration_median1.1361838498881445
complete-iteration_min0.35075207109804507
deviation-center-line_max0.240965720156589
deviation-center-line_mean0.08782909468281055
deviation-center-line_min0.035997628531515474
deviation-heading_max1.288730205627049
deviation-heading_mean0.6257458456007571
deviation-heading_median0.4977991644409327
deviation-heading_min0.23223876370998295
driven_any_max7.56053723655662
driven_any_mean1.7767480361357042
driven_any_median0.9885480670478064
driven_any_min0.3581894199750563
driven_lanedir_consec_max0.8622842577071264
driven_lanedir_consec_mean0.34947683631418397
driven_lanedir_consec_min0.107613810712069
driven_lanedir_max0.8622842577071264
driven_lanedir_mean0.34947683631418397
driven_lanedir_median0.31992881737322587
driven_lanedir_min0.107613810712069
get_duckie_state_max1.3909809329966808e-06
get_duckie_state_mean1.3203132937285323e-06
get_duckie_state_median1.3907750447591143e-06
get_duckie_state_min1.1947273549453988e-06
get_robot_state_max0.01418746274615091
get_robot_state_mean0.013009958292666832
get_robot_state_median0.013901078021588104
get_robot_state_min0.0072921629305239075
get_state_dump_max0.009584810998704698
get_state_dump_mean0.009003355167609936
get_state_dump_median0.009423213919209692
get_state_dump_min0.006382315247147171
get_ui_image_max0.05186703091575986
get_ui_image_mean0.046184222751664915
get_ui_image_median0.04866171006711653
get_ui_image_min0.03322024875217014
in-drivable-lane_max16.75000000000012
in-drivable-lane_mean9.260714285714313
in-drivable-lane_min4.449999999999985
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.5127684067108719, "get_ui_image": 0.04450591427186576, "step_physics": 0.7759142040547745, "survival_time": 18.05000000000012, "driven_lanedir": 0.4503654774210149, "get_state_dump": 0.009312560545146797, "get_robot_state": 0.01380023179133294, "sim_render-ego0": 0.0035828338802190115, "sim_render-ego1": 0.003475745738540565, "sim_render-ego2": 0.00363231232153118, "sim_render-ego3": 0.0034649345756235703, "get_duckie_state": 1.1947273549453988e-06, "in-drivable-lane": 16.600000000000122, "deviation-heading": 0.4232034040154166, "agent_compute-ego0": 0.012613231964532842, "agent_compute-ego1": 0.011743682524117316, "agent_compute-ego2": 0.013184431508101151, "agent_compute-ego3": 0.01195360086240821, "complete-iteration": 0.9370897020424268, "set_robot_commands": 0.00218698398842996, "deviation-center-line": 0.05457625694553754, "driven_lanedir_consec": 0.4503654774210149, "sim_compute_sim_state": 0.013521350549729487, "sim_compute_performance-ego0": 0.0018916591096319547, "sim_compute_performance-ego1": 0.0019154127131509515, "sim_compute_performance-ego2": 0.0019069620258900344, "sim_compute_performance-ego3": 0.0018534989646785168}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.0773586972736953, "get_ui_image": 0.04450591427186576, "step_physics": 0.7759142040547745, "survival_time": 18.05000000000012, "driven_lanedir": 0.3375234935553282, "get_state_dump": 0.009312560545146797, "get_robot_state": 0.01380023179133294, "sim_render-ego0": 0.0035828338802190115, "sim_render-ego1": 0.003475745738540565, "sim_render-ego2": 0.00363231232153118, "sim_render-ego3": 0.0034649345756235703, "get_duckie_state": 1.1947273549453988e-06, "in-drivable-lane": 16.55000000000012, "deviation-heading": 0.7001902904689402, "agent_compute-ego0": 0.012613231964532842, "agent_compute-ego1": 0.011743682524117316, "agent_compute-ego2": 0.013184431508101151, "agent_compute-ego3": 0.01195360086240821, "complete-iteration": 0.9370897020424268, "set_robot_commands": 0.00218698398842996, "deviation-center-line": 0.09704769294060986, "driven_lanedir_consec": 0.3375234935553282, "sim_compute_sim_state": 0.013521350549729487, "sim_compute_performance-ego0": 0.0018916591096319547, "sim_compute_performance-ego1": 0.0019154127131509515, "sim_compute_performance-ego2": 0.0019069620258900344, "sim_compute_performance-ego3": 0.0018534989646785168}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.56053723655662, "get_ui_image": 0.04450591427186576, "step_physics": 0.7759142040547745, "survival_time": 18.05000000000012, "driven_lanedir": 0.5696451020408935, "get_state_dump": 0.009312560545146797, "get_robot_state": 0.01380023179133294, "sim_render-ego0": 0.0035828338802190115, "sim_render-ego1": 0.003475745738540565, "sim_render-ego2": 0.00363231232153118, "sim_render-ego3": 0.0034649345756235703, "get_duckie_state": 1.1947273549453988e-06, "in-drivable-lane": 15.850000000000117, "deviation-heading": 1.257654743808632, "agent_compute-ego0": 0.012613231964532842, "agent_compute-ego1": 0.011743682524117316, "agent_compute-ego2": 0.013184431508101151, "agent_compute-ego3": 0.01195360086240821, "complete-iteration": 0.9370897020424268, "set_robot_commands": 0.00218698398842996, "deviation-center-line": 0.12110374827365604, "driven_lanedir_consec": 0.5696451020408935, "sim_compute_sim_state": 0.013521350549729487, "sim_compute_performance-ego0": 0.0018916591096319547, "sim_compute_performance-ego1": 0.0019154127131509515, "sim_compute_performance-ego2": 0.0019069620258900344, "sim_compute_performance-ego3": 0.0018534989646785168}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6652715241546576, "get_ui_image": 0.04450591427186576, "step_physics": 0.7759142040547745, "survival_time": 18.05000000000012, "driven_lanedir": 0.3349137042084003, "get_state_dump": 0.009312560545146797, "get_robot_state": 0.01380023179133294, "sim_render-ego0": 0.0035828338802190115, "sim_render-ego1": 0.003475745738540565, "sim_render-ego2": 0.00363231232153118, "sim_render-ego3": 0.0034649345756235703, "get_duckie_state": 1.1947273549453988e-06, "in-drivable-lane": 16.75000000000012, "deviation-heading": 0.4084887793264565, "agent_compute-ego0": 0.012613231964532842, "agent_compute-ego1": 0.011743682524117316, "agent_compute-ego2": 0.013184431508101151, "agent_compute-ego3": 0.01195360086240821, "complete-iteration": 0.9370897020424268, "set_robot_commands": 0.00218698398842996, "deviation-center-line": 0.059540331760822546, "driven_lanedir_consec": 0.3349137042084003, "sim_compute_sim_state": 0.013521350549729487, "sim_compute_performance-ego0": 0.0018916591096319547, "sim_compute_performance-ego1": 0.0019154127131509515, "sim_compute_performance-ego2": 0.0019069620258900344, "sim_compute_performance-ego3": 0.0018534989646785168}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.7015305335933123, "get_ui_image": 0.05186703091575986, "step_physics": 0.9027790077148922, "survival_time": 6.249999999999986, "driven_lanedir": 0.3595163059741928, "get_state_dump": 0.009584810998704698, "get_robot_state": 0.01418746274615091, "sim_render-ego0": 0.0038750171661376953, "sim_render-ego1": 0.003710084491305881, "sim_render-ego2": 0.0037193033430311414, "sim_render-ego3": 0.003647297147720579, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 4.749999999999985, "deviation-heading": 0.6643405150101285, "agent_compute-ego0": 0.02973057542528425, "agent_compute-ego1": 0.028904400174579924, "agent_compute-ego2": 0.029571815142555843, "agent_compute-ego3": 0.028675177740672277, "complete-iteration": 1.1561053518265012, "set_robot_commands": 0.0022353577235388377, "deviation-center-line": 0.07551959725312567, "driven_lanedir_consec": 0.3595163059741928, "sim_compute_sim_state": 0.028950479295518663, "sim_compute_performance-ego0": 0.0020065061629764617, "sim_compute_performance-ego1": 0.00198519229888916, "sim_compute_performance-ego2": 0.0019521542957850863, "sim_compute_performance-ego3": 0.0019460329933772011}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.2937164428895458, "get_ui_image": 0.05186703091575986, "step_physics": 0.9027790077148922, "survival_time": 6.249999999999986, "driven_lanedir": 0.2548812266706846, "get_state_dump": 0.009584810998704698, "get_robot_state": 0.01418746274615091, "sim_render-ego0": 0.0038750171661376953, "sim_render-ego1": 0.003710084491305881, "sim_render-ego2": 0.0037193033430311414, "sim_render-ego3": 0.003647297147720579, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 4.999999999999987, "deviation-heading": 0.8922396401861884, "agent_compute-ego0": 0.02973057542528425, "agent_compute-ego1": 0.028904400174579924, "agent_compute-ego2": 0.029571815142555843, "agent_compute-ego3": 0.028675177740672277, "complete-iteration": 1.1561053518265012, "set_robot_commands": 0.0022353577235388377, "deviation-center-line": 0.11990974629795775, "driven_lanedir_consec": 0.2548812266706846, "sim_compute_sim_state": 0.028950479295518663, "sim_compute_performance-ego0": 0.0020065061629764617, "sim_compute_performance-ego1": 0.00198519229888916, "sim_compute_performance-ego2": 0.0019521542957850863, "sim_compute_performance-ego3": 0.0019460329933772011}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 2.4247680343537885, "get_ui_image": 0.05186703091575986, "step_physics": 0.9027790077148922, "survival_time": 6.249999999999986, "driven_lanedir": 0.5666684366800019, "get_state_dump": 0.009584810998704698, "get_robot_state": 0.01418746274615091, "sim_render-ego0": 0.0038750171661376953, "sim_render-ego1": 0.003710084491305881, "sim_render-ego2": 0.0037193033430311414, "sim_render-ego3": 0.003647297147720579, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.5017718770496762, "agent_compute-ego0": 0.02973057542528425, "agent_compute-ego1": 0.028904400174579924, "agent_compute-ego2": 0.029571815142555843, "agent_compute-ego3": 0.028675177740672277, "complete-iteration": 1.1561053518265012, "set_robot_commands": 0.0022353577235388377, "deviation-center-line": 0.09612834912269846, "driven_lanedir_consec": 0.5666684366800019, "sim_compute_sim_state": 0.028950479295518663, "sim_compute_performance-ego0": 0.0020065061629764617, "sim_compute_performance-ego1": 0.00198519229888916, "sim_compute_performance-ego2": 0.0019521542957850863, "sim_compute_performance-ego3": 0.0019460329933772011}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.8997374368219176, "get_ui_image": 0.05186703091575986, "step_physics": 0.9027790077148922, "survival_time": 6.249999999999986, "driven_lanedir": 0.24799316849660413, "get_state_dump": 0.009584810998704698, "get_robot_state": 0.01418746274615091, "sim_render-ego0": 0.0038750171661376953, "sim_render-ego1": 0.003710084491305881, "sim_render-ego2": 0.0037193033430311414, "sim_render-ego3": 0.003647297147720579, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 5.349999999999985, "deviation-heading": 0.23223876370998295, "agent_compute-ego0": 0.02973057542528425, "agent_compute-ego1": 0.028904400174579924, "agent_compute-ego2": 0.029571815142555843, "agent_compute-ego3": 0.028675177740672277, "complete-iteration": 1.1561053518265012, "set_robot_commands": 0.0022353577235388377, "deviation-center-line": 0.08119991413886389, "driven_lanedir_consec": 0.24799316849660413, "sim_compute_sim_state": 0.028950479295518663, "sim_compute_performance-ego0": 0.0020065061629764617, "sim_compute_performance-ego1": 0.00198519229888916, "sim_compute_performance-ego2": 0.0019521542957850863, "sim_compute_performance-ego3": 0.0019460329933772011}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8323887561616258, "get_ui_image": 0.04866171006711653, "step_physics": 0.9608317422125624, "survival_time": 9.6, "driven_lanedir": 0.1765162833684295, "get_state_dump": 0.009423213919209692, "get_robot_state": 0.013901078021588104, "sim_render-ego0": 0.003809754712593988, "sim_render-ego1": 0.003682431779377201, "sim_render-ego2": 0.003612295951250303, "sim_render-ego3": 0.003775917804302947, "get_duckie_state": 1.3909809329966808e-06, "in-drivable-lane": 8.75, "deviation-heading": 0.561819982638771, "agent_compute-ego0": 0.013739312868661832, "agent_compute-ego1": 0.013217613487046, "agent_compute-ego2": 0.01278513947916772, "agent_compute-ego3": 0.013483567559039657, "complete-iteration": 1.1361838498881445, "set_robot_commands": 0.0022184169354216425, "deviation-center-line": 0.054638405701831434, "driven_lanedir_consec": 0.1765162833684295, "sim_compute_sim_state": 0.01878340009580622, "sim_compute_performance-ego0": 0.001906791499241646, "sim_compute_performance-ego1": 0.0019071534507632871, "sim_compute_performance-ego2": 0.001913645106893747, "sim_compute_performance-ego3": 0.0018612177260799111}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 0.3947810960621528, "get_ui_image": 0.04866171006711653, "step_physics": 0.9608317422125624, "survival_time": 9.6, "driven_lanedir": 0.11553852058534696, "get_state_dump": 0.009423213919209692, "get_robot_state": 0.013901078021588104, "sim_render-ego0": 0.003809754712593988, "sim_render-ego1": 0.003682431779377201, "sim_render-ego2": 0.003612295951250303, "sim_render-ego3": 0.003775917804302947, "get_duckie_state": 1.3909809329966808e-06, "in-drivable-lane": 8.75, "deviation-heading": 0.4312991322773665, "agent_compute-ego0": 0.013739312868661832, "agent_compute-ego1": 0.013217613487046, "agent_compute-ego2": 0.01278513947916772, "agent_compute-ego3": 0.013483567559039657, "complete-iteration": 1.1361838498881445, "set_robot_commands": 0.0022184169354216425, "deviation-center-line": 0.035997628531515474, "driven_lanedir_consec": 0.11553852058534696, "sim_compute_sim_state": 0.01878340009580622, "sim_compute_performance-ego0": 0.001906791499241646, "sim_compute_performance-ego1": 0.0019071534507632871, "sim_compute_performance-ego2": 0.001913645106893747, "sim_compute_performance-ego3": 0.0018612177260799111}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.7319739454128618, "get_ui_image": 0.04866171006711653, "step_physics": 0.9608317422125624, "survival_time": 9.6, "driven_lanedir": 0.8622842577071264, "get_state_dump": 0.009423213919209692, "get_robot_state": 0.013901078021588104, "sim_render-ego0": 0.003809754712593988, "sim_render-ego1": 0.003682431779377201, "sim_render-ego2": 0.003612295951250303, "sim_render-ego3": 0.003775917804302947, "get_duckie_state": 1.3909809329966808e-06, "in-drivable-lane": 6.800000000000004, "deviation-heading": 1.288730205627049, "agent_compute-ego0": 0.013739312868661832, "agent_compute-ego1": 0.013217613487046, "agent_compute-ego2": 0.01278513947916772, "agent_compute-ego3": 0.013483567559039657, "complete-iteration": 1.1361838498881445, "set_robot_commands": 0.0022184169354216425, "deviation-center-line": 0.240965720156589, "driven_lanedir_consec": 0.8622842577071264, "sim_compute_sim_state": 0.01878340009580622, "sim_compute_performance-ego0": 0.001906791499241646, "sim_compute_performance-ego1": 0.0019071534507632871, "sim_compute_performance-ego2": 0.001913645106893747, "sim_compute_performance-ego3": 0.0018612177260799111}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3581894199750563, "get_ui_image": 0.04866171006711653, "step_physics": 0.9608317422125624, "survival_time": 9.6, "driven_lanedir": 0.20427199044043176, "get_state_dump": 0.009423213919209692, "get_robot_state": 0.013901078021588104, "sim_render-ego0": 0.003809754712593988, "sim_render-ego1": 0.003682431779377201, "sim_render-ego2": 0.003612295951250303, "sim_render-ego3": 0.003775917804302947, "get_duckie_state": 1.3909809329966808e-06, "in-drivable-lane": 8.600000000000001, "deviation-heading": 0.4938264518321893, "agent_compute-ego0": 0.013739312868661832, "agent_compute-ego1": 0.013217613487046, "agent_compute-ego2": 0.01278513947916772, "agent_compute-ego3": 0.013483567559039657, "complete-iteration": 1.1361838498881445, "set_robot_commands": 0.0022184169354216425, "deviation-center-line": 0.05828112308234561, "driven_lanedir_consec": 0.20427199044043176, "sim_compute_sim_state": 0.01878340009580622, "sim_compute_performance-ego0": 0.001906791499241646, "sim_compute_performance-ego1": 0.0019071534507632871, "sim_compute_performance-ego2": 0.001913645106893747, "sim_compute_performance-ego3": 0.0018612177260799111}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 0.8670218666933306, "get_ui_image": 0.03322024875217014, "step_physics": 0.2542038846898962, "survival_time": 6.699999999999984, "driven_lanedir": 0.107613810712069, "get_state_dump": 0.006382315247147171, "get_robot_state": 0.0072921629305239075, "sim_render-ego0": 0.003701231214735243, "sim_render-ego1": 0.0038214347980640552, "get_duckie_state": 1.289226390697338e-06, "in-drivable-lane": 5.849999999999984, "deviation-heading": 0.4440557967990175, "agent_compute-ego0": 0.012931362787882488, "agent_compute-ego1": 0.012995274861653644, "complete-iteration": 0.35075207109804507, "set_robot_commands": 0.0022511959075927736, "deviation-center-line": 0.04115941867266226, "driven_lanedir_consec": 0.107613810712069, "sim_compute_sim_state": 0.007437031357376664, "sim_compute_performance-ego0": 0.0020089873561152704, "sim_compute_performance-ego1": 0.0020355860392252604}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.554429109240424, "get_ui_image": 0.03322024875217014, "step_physics": 0.2542038846898962, "survival_time": 6.699999999999984, "driven_lanedir": 0.30494393053805147, "get_state_dump": 0.006382315247147171, "get_robot_state": 0.0072921629305239075, "sim_render-ego0": 0.003701231214735243, "sim_render-ego1": 0.0038214347980640552, "get_duckie_state": 1.289226390697338e-06, "in-drivable-lane": 5.5999999999999845, "deviation-heading": 0.460582255660784, "agent_compute-ego0": 0.012931362787882488, "agent_compute-ego1": 0.012995274861653644, "complete-iteration": 0.35075207109804507, "set_robot_commands": 0.0022511959075927736, "deviation-center-line": 0.09353939268113208, "driven_lanedir_consec": 0.30494393053805147, "sim_compute_sim_state": 0.007437031357376664, "sim_compute_performance-ego0": 0.0020089873561152704, "sim_compute_performance-ego1": 0.0020355860392252604}}
set_robot_commands_max0.0022511959075927736
set_robot_commands_mean0.0022189590289105224
set_robot_commands_median0.0022184169354216425
set_robot_commands_min0.00218698398842996
sim_compute_performance-ego0_max0.0020089873561152704
sim_compute_performance-ego0_mean0.0019455572714021992
sim_compute_performance-ego0_median0.001906791499241646
sim_compute_performance-ego0_min0.0018916591096319547
sim_compute_performance-ego1_max0.0020355860392252604
sim_compute_performance-ego1_mean0.00195015756640458
sim_compute_performance-ego1_median0.0019154127131509515
sim_compute_performance-ego1_min0.0019071534507632871
sim_compute_performance-ego2_max0.0019521542957850863
sim_compute_performance-ego2_mean0.0019242538095229555
sim_compute_performance-ego2_median0.001913645106893747
sim_compute_performance-ego2_min0.0019069620258900344
sim_compute_performance-ego3_max0.0019460329933772011
sim_compute_performance-ego3_mean0.0018869165613785424
sim_compute_performance-ego3_median0.0018612177260799111
sim_compute_performance-ego3_min0.0018534989646785168
sim_compute_sim_state_max0.028950479295518663
sim_compute_sim_state_mean0.01856392731992649
sim_compute_sim_state_median0.01878340009580622
sim_compute_sim_state_min0.007437031357376664
sim_render-ego0_max0.0038750171661376953
sim_render-ego0_mean0.003748063247519519
sim_render-ego0_median0.003809754712593988
sim_render-ego0_min0.0035828338802190115
sim_render-ego1_max0.0038214347980640552
sim_render-ego1_mean0.003651136973787336
sim_render-ego1_median0.003682431779377201
sim_render-ego1_min0.003475745738540565
sim_render-ego2_max0.0037193033430311414
sim_render-ego2_mean0.003654637205270874
sim_render-ego2_median0.00363231232153118
sim_render-ego2_min0.003612295951250303
sim_render-ego3_max0.003775917804302947
sim_render-ego3_mean0.0036293831758823654
sim_render-ego3_median0.003647297147720579
sim_render-ego3_min0.0034649345756235703
simulation-passed1
step_physics_max0.9608317422125624
step_physics_mean0.7904648275220506
step_physics_median0.9027790077148922
step_physics_min0.2542038846898962
survival_time_max18.05000000000012
survival_time_mean10.64285714285717
survival_time_min6.249999999999986

Highlights

53575

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.