Duckietown Challenges Home Challenges Submissions

Job 58830

Job ID58830
submission12875
userRaphael Jean
user labelsim-exercise-2
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statussuccess
up to dateyes
evaluatornogpu-prod-04
date started
date completed
duration1:09:16
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.6683255652649
survival_time_median51.249999999999226
deviation-center-line_median2.370344307812264
in-drivable-lane_median4.800000000000021


other stats
agent_compute-ego0_max0.01403027948005219
agent_compute-ego0_mean0.013678491867006004
agent_compute-ego0_median0.013678491867006004
agent_compute-ego0_min0.013326704253959817
agent_compute-ego1_max0.013527284355385912
agent_compute-ego1_mean0.013485775429784144
agent_compute-ego1_median0.013485775429784144
agent_compute-ego1_min0.013444266504182378
agent_compute-ego2_max0.013307357013076669
agent_compute-ego2_mean0.013222112321926278
agent_compute-ego2_median0.013222112321926278
agent_compute-ego2_min0.013136867630775892
agent_compute-ego3_max0.014113324964969582
agent_compute-ego3_mean0.01402738730665728
agent_compute-ego3_median0.01402738730665728
agent_compute-ego3_min0.013941449648344978
complete-iteration_max1.254467270209002
complete-iteration_mean1.134762949516468
complete-iteration_median1.134762949516468
complete-iteration_min1.0150586288239338
deviation-center-line_max7.817199460354302
deviation-center-line_mean2.628455864691676
deviation-center-line_min0.694663318218426
deviation-heading_max11.272181002112236
deviation-heading_mean6.635109137967059
deviation-heading_median6.571511969013567
deviation-heading_min2.8071611822431595
driven_any_max18.319392627356606
driven_any_mean9.59133624420752
driven_any_median8.388707817761228
driven_any_min2.66816423096664
driven_lanedir_consec_max16.89043088947041
driven_lanedir_consec_mean8.174428058745312
driven_lanedir_consec_min0.661239328058838
driven_lanedir_max17.98328596082206
driven_lanedir_mean8.719112204730923
driven_lanedir_median7.938549506428354
driven_lanedir_min0.6830918536855037
get_duckie_state_max1.9053634656259757e-06
get_duckie_state_mean1.809699868502388e-06
get_duckie_state_median1.809699868502388e-06
get_duckie_state_min1.7140362713788007e-06
get_robot_state_max0.01601761961658233
get_robot_state_mean0.015807727093434865
get_robot_state_median0.015807727093434865
get_robot_state_min0.015597834570287397
get_state_dump_max0.010379212723495537
get_state_dump_mean0.010356891036634428
get_state_dump_median0.010356891036634428
get_state_dump_min0.01033456934977332
get_ui_image_max0.05624260354498642
get_ui_image_mean0.05605931820562629
get_ui_image_median0.05605931820562629
get_ui_image_min0.05587603286626616
in-drivable-lane_max33.249999999999716
in-drivable-lane_mean10.337499999999874
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 4.079010233169656, "get_ui_image": 0.05587603286626616, "step_physics": 1.0562810830588063, "survival_time": 42.49999999999972, "driven_lanedir": 3.6211453150544632, "get_state_dump": 0.010379212723495537, "get_robot_state": 0.015597834570287397, "sim_render-ego0": 0.004357267070460964, "sim_render-ego1": 0.0043507600082774, "sim_render-ego2": 0.004358483817686626, "sim_render-ego3": 0.004359296289930333, "get_duckie_state": 1.7140362713788007e-06, "in-drivable-lane": 2.150000000000013, "deviation-heading": 3.966072238555614, "agent_compute-ego0": 0.01403027948005219, "agent_compute-ego1": 0.013444266504182378, "agent_compute-ego2": 0.013136867630775892, "agent_compute-ego3": 0.013941449648344978, "complete-iteration": 1.254467270209002, "set_robot_commands": 0.002582613085467723, "deviation-center-line": 0.8615909810016221, "driven_lanedir_consec": 3.621100492955012, "sim_compute_sim_state": 0.024918513908789665, "sim_compute_performance-ego0": 0.0023075489263837123, "sim_compute_performance-ego1": 0.002183685571690704, "sim_compute_performance-ego2": 0.00222419992036741, "sim_compute_performance-ego3": 0.002216884868545622}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 3.044297231832412, "get_ui_image": 0.05587603286626616, "step_physics": 1.0562810830588063, "survival_time": 42.49999999999972, "driven_lanedir": 2.681642132820737, "get_state_dump": 0.010379212723495537, "get_robot_state": 0.015597834570287397, "sim_render-ego0": 0.004357267070460964, "sim_render-ego1": 0.0043507600082774, "sim_render-ego2": 0.004358483817686626, "sim_render-ego3": 0.004359296289930333, "get_duckie_state": 1.7140362713788007e-06, "in-drivable-lane": 30.84999999999969, "deviation-heading": 2.8071611822431595, "agent_compute-ego0": 0.01403027948005219, "agent_compute-ego1": 0.013444266504182378, "agent_compute-ego2": 0.013136867630775892, "agent_compute-ego3": 0.013941449648344978, "complete-iteration": 1.254467270209002, "set_robot_commands": 0.002582613085467723, "deviation-center-line": 0.891500465809546, "driven_lanedir_consec": 2.681642132820737, "sim_compute_sim_state": 0.024918513908789665, "sim_compute_performance-ego0": 0.0023075489263837123, "sim_compute_performance-ego1": 0.002183685571690704, "sim_compute_performance-ego2": 0.00222419992036741, "sim_compute_performance-ego3": 0.002216884868545622}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 12.6984054023528, "get_ui_image": 0.05587603286626616, "step_physics": 1.0562810830588063, "survival_time": 42.49999999999972, "driven_lanedir": 12.255953697802246, "get_state_dump": 0.010379212723495537, "get_robot_state": 0.015597834570287397, "sim_render-ego0": 0.004357267070460964, "sim_render-ego1": 0.0043507600082774, "sim_render-ego2": 0.004358483817686626, "sim_render-ego3": 0.004359296289930333, "get_duckie_state": 1.7140362713788007e-06, "in-drivable-lane": 0.6499999999999999, "deviation-heading": 7.992583413601918, "agent_compute-ego0": 0.01403027948005219, "agent_compute-ego1": 0.013444266504182378, "agent_compute-ego2": 0.013136867630775892, "agent_compute-ego3": 0.013941449648344978, "complete-iteration": 1.254467270209002, "set_robot_commands": 0.002582613085467723, "deviation-center-line": 2.100275396708424, "driven_lanedir_consec": 11.715550637574788, "sim_compute_sim_state": 0.024918513908789665, "sim_compute_performance-ego0": 0.0023075489263837123, "sim_compute_performance-ego1": 0.002183685571690704, "sim_compute_performance-ego2": 0.00222419992036741, "sim_compute_performance-ego3": 0.002216884868545622}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 3.3789242431061113, "get_ui_image": 0.05587603286626616, "step_physics": 1.0562810830588063, "survival_time": 42.49999999999972, "driven_lanedir": 1.7754313798336137, "get_state_dump": 0.010379212723495537, "get_robot_state": 0.015597834570287397, "sim_render-ego0": 0.004357267070460964, "sim_render-ego1": 0.0043507600082774, "sim_render-ego2": 0.004358483817686626, "sim_render-ego3": 0.004359296289930333, "get_duckie_state": 1.7140362713788007e-06, "in-drivable-lane": 33.249999999999716, "deviation-heading": 3.38390750471421, "agent_compute-ego0": 0.01403027948005219, "agent_compute-ego1": 0.013444266504182378, "agent_compute-ego2": 0.013136867630775892, "agent_compute-ego3": 0.013941449648344978, "complete-iteration": 1.254467270209002, "set_robot_commands": 0.002582613085467723, "deviation-center-line": 0.694663318218426, "driven_lanedir_consec": 1.2971840877866758, "sim_compute_sim_state": 0.024918513908789665, "sim_compute_performance-ego0": 0.0023075489263837123, "sim_compute_performance-ego1": 0.002183685571690704, "sim_compute_performance-ego2": 0.00222419992036741, "sim_compute_performance-ego3": 0.002216884868545622}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 18.319392627356606, "get_ui_image": 0.05624260354498642, "step_physics": 0.8029502152801057, "survival_time": 59.99999999999873, "driven_lanedir": 17.98328596082206, "get_state_dump": 0.01033456934977332, "get_robot_state": 0.01601761961658233, "sim_render-ego0": 0.004347481993612501, "sim_render-ego1": 0.004477289495221979, "sim_render-ego2": 0.0044758470727442505, "sim_render-ego3": 0.00450653557376401, "get_duckie_state": 1.9053634656259757e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.147585379351275, "agent_compute-ego0": 0.013326704253959817, "agent_compute-ego1": 0.013527284355385912, "agent_compute-ego2": 0.013307357013076669, "agent_compute-ego3": 0.014113324964969582, "complete-iteration": 1.0150586288239338, "set_robot_commands": 0.00270858831350055, "deviation-center-line": 2.640413218916103, "driven_lanedir_consec": 16.89043088947041, "sim_compute_sim_state": 0.03774902504945576, "sim_compute_performance-ego0": 0.002430292291506244, "sim_compute_performance-ego1": 0.002237100982348389, "sim_compute_performance-ego2": 0.002269584868571641, "sim_compute_performance-ego3": 0.0022786435834771888}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 15.999797428111584, "get_ui_image": 0.05624260354498642, "step_physics": 0.8029502152801057, "survival_time": 59.99999999999873, "driven_lanedir": 14.837741923400722, "get_state_dump": 0.01033456934977332, "get_robot_state": 0.01601761961658233, "sim_render-ego0": 0.004347481993612501, "sim_render-ego1": 0.004477289495221979, "sim_render-ego2": 0.0044758470727442505, "sim_render-ego3": 0.00450653557376401, "get_duckie_state": 1.9053634656259757e-06, "in-drivable-lane": 7.799999999999557, "deviation-heading": 9.36094185873284, "agent_compute-ego0": 0.013326704253959817, "agent_compute-ego1": 0.013527284355385912, "agent_compute-ego2": 0.013307357013076669, "agent_compute-ego3": 0.014113324964969582, "complete-iteration": 1.0150586288239338, "set_robot_commands": 0.00270858831350055, "deviation-center-line": 2.942818674015463, "driven_lanedir_consec": 13.685907751822311, "sim_compute_sim_state": 0.03774902504945576, "sim_compute_performance-ego0": 0.002430292291506244, "sim_compute_performance-ego1": 0.002237100982348389, "sim_compute_performance-ego2": 0.002269584868571641, "sim_compute_performance-ego3": 0.0022786435834771888}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 16.54269855676436, "get_ui_image": 0.05624260354498642, "step_physics": 0.8029502152801057, "survival_time": 59.99999999999873, "driven_lanedir": 15.914605374428035, "get_state_dump": 0.01033456934977332, "get_robot_state": 0.01601761961658233, "sim_render-ego0": 0.004347481993612501, "sim_render-ego1": 0.004477289495221979, "sim_render-ego2": 0.0044758470727442505, "sim_render-ego3": 0.00450653557376401, "get_duckie_state": 1.9053634656259757e-06, "in-drivable-lane": 0.549999999999998, "deviation-heading": 11.272181002112236, "agent_compute-ego0": 0.013326704253959817, "agent_compute-ego1": 0.013527284355385912, "agent_compute-ego2": 0.013307357013076669, "agent_compute-ego3": 0.014113324964969582, "complete-iteration": 1.0150586288239338, "set_robot_commands": 0.00270858831350055, "deviation-center-line": 3.0791854025095233, "driven_lanedir_consec": 14.842369149473722, "sim_compute_sim_state": 0.03774902504945576, "sim_compute_performance-ego0": 0.002430292291506244, "sim_compute_performance-ego1": 0.002237100982348389, "sim_compute_performance-ego2": 0.002269584868571641, "sim_compute_performance-ego3": 0.0022786435834771888}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 2.66816423096664, "get_ui_image": 0.05624260354498642, "step_physics": 0.8029502152801057, "survival_time": 59.99999999999873, "driven_lanedir": 0.6830918536855037, "get_state_dump": 0.01033456934977332, "get_robot_state": 0.01601761961658233, "sim_render-ego0": 0.004347481993612501, "sim_render-ego1": 0.004477289495221979, "sim_render-ego2": 0.0044758470727442505, "sim_render-ego3": 0.00450653557376401, "get_duckie_state": 1.9053634656259757e-06, "in-drivable-lane": 7.450000000000029, "deviation-heading": 5.150440524425217, "agent_compute-ego0": 0.013326704253959817, "agent_compute-ego1": 0.013527284355385912, "agent_compute-ego2": 0.013307357013076669, "agent_compute-ego3": 0.014113324964969582, "complete-iteration": 1.0150586288239338, "set_robot_commands": 0.00270858831350055, "deviation-center-line": 7.817199460354302, "driven_lanedir_consec": 0.661239328058838, "sim_compute_sim_state": 0.03774902504945576, "sim_compute_performance-ego0": 0.002430292291506244, "sim_compute_performance-ego1": 0.002237100982348389, "sim_compute_performance-ego2": 0.002269584868571641, "sim_compute_performance-ego3": 0.0022786435834771888}}
set_robot_commands_max0.00270858831350055
set_robot_commands_mean0.002645600699484136
set_robot_commands_median0.002645600699484136
set_robot_commands_min0.002582613085467723
sim_compute_performance-ego0_max0.002430292291506244
sim_compute_performance-ego0_mean0.0023689206089449783
sim_compute_performance-ego0_median0.0023689206089449783
sim_compute_performance-ego0_min0.0023075489263837123
sim_compute_performance-ego1_max0.002237100982348389
sim_compute_performance-ego1_mean0.0022103932770195464
sim_compute_performance-ego1_median0.0022103932770195464
sim_compute_performance-ego1_min0.002183685571690704
sim_compute_performance-ego2_max0.002269584868571641
sim_compute_performance-ego2_mean0.0022468923944695255
sim_compute_performance-ego2_median0.0022468923944695255
sim_compute_performance-ego2_min0.00222419992036741
sim_compute_performance-ego3_max0.0022786435834771888
sim_compute_performance-ego3_mean0.002247764226011405
sim_compute_performance-ego3_median0.002247764226011405
sim_compute_performance-ego3_min0.002216884868545622
sim_compute_sim_state_max0.03774902504945576
sim_compute_sim_state_mean0.03133376947912271
sim_compute_sim_state_median0.03133376947912271
sim_compute_sim_state_min0.024918513908789665
sim_render-ego0_max0.004357267070460964
sim_render-ego0_mean0.004352374532036732
sim_render-ego0_median0.004352374532036732
sim_render-ego0_min0.004347481993612501
sim_render-ego1_max0.004477289495221979
sim_render-ego1_mean0.004414024751749689
sim_render-ego1_median0.004414024751749689
sim_render-ego1_min0.0043507600082774
sim_render-ego2_max0.0044758470727442505
sim_render-ego2_mean0.004417165445215438
sim_render-ego2_median0.004417165445215438
sim_render-ego2_min0.004358483817686626
sim_render-ego3_max0.00450653557376401
sim_render-ego3_mean0.004432915931847171
sim_render-ego3_median0.004432915931847171
sim_render-ego3_min0.004359296289930333
simulation-passed1
step_physics_max1.0562810830588063
step_physics_mean0.929615649169456
step_physics_median0.929615649169456
step_physics_min0.8029502152801057
survival_time_max59.99999999999873
survival_time_mean51.249999999999226
survival_time_min42.49999999999972

Highlights

58830

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.