Duckietown Challenges Home Challenges Submissions

Submission 4244

Submission4244
Competingyes
Challengeaido3-LFVI-sim-testing
UserManfred Diaz
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27628
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27628step1-simulationsuccessyes0:52:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.03359051216426545
survival_time_median14.950000000000076
deviation-center-line_median0.7191116850449278
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09246370951334636
agent_compute-ego_mean0.0810148229598999
agent_compute-ego_median0.07915138562520345
agent_compute-ego_min0.07456783771514892
deviation-center-line_max1.3041686134459638
deviation-center-line_mean0.6384537346374511
deviation-center-line_min0.07927392683306739
deviation-heading_max5.588610897133456
deviation-heading_mean2.8117635425924288
deviation-heading_median3.364217945940352
deviation-heading_min0.2939943358931355
driven_any_max0.034741540279716765
driven_any_mean0.03429771417571837
driven_any_median0.03446401033685223
driven_any_min0.03327158684579707
driven_lanedir_consec_max0.034708159444901465
driven_lanedir_consec_mean0.03346378164435163
driven_lanedir_consec_min0.03203257428871087
driven_lanedir_max0.034708159444901465
driven_lanedir_mean0.03346378164435163
driven_lanedir_median0.03359051216426545
driven_lanedir_min0.03203257428871087
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.034208348050010357, "sim_physics": 0.1831443007787069, "survival_time": 14.950000000000076, "driven_lanedir": 0.03271813440471738, "sim_render-ego": 0.01068323532740275, "in-drivable-lane": 0, "agent_compute-ego": 0.07896332184473674, "deviation-heading": 4.413306051870154, "set_robot_commands": 0.00836702823638916, "deviation-center-line": 0.15883110903238262, "driven_lanedir_consec": 0.03271813440471738, "sim_compute_sim_state": 0.0045378557840983075, "sim_compute_performance-ego": 0.0062950229644775394, "sim_compute_robot_state-ego": 0.007832980950673422, "sim_compute_robot_state-npc0": 0.007931665579477946, "sim_compute_robot_state-npc1": 0.007501269181569417, "sim_compute_robot_state-npc2": 0.007453201611836751, "sim_compute_robot_state-npc3": 0.007294538021087646}, "udem1-1-0": {"driven_any": 0.03464994738140201, "sim_physics": 0.1598933188120524, "survival_time": 14.950000000000076, "driven_lanedir": 0.03449014291321406, "sim_render-ego": 0.010531710783640544, "in-drivable-lane": 0, "agent_compute-ego": 0.07956226746241252, "deviation-heading": 1.354468902195064, "set_robot_commands": 0.007875802516937256, "deviation-center-line": 0.7352333655573444, "driven_lanedir_consec": 0.03449014291321406, "sim_compute_sim_state": 0.004459013144175211, "sim_compute_performance-ego": 0.00633120059967041, "sim_compute_robot_state-ego": 0.007758709589640299, "sim_compute_robot_state-npc0": 0.007525383631388346, "sim_compute_robot_state-npc1": 0.007405898571014404, "sim_compute_robot_state-npc2": 0.007474025885264079, "sim_compute_robot_state-npc3": 0.00732550303141276}, "udem1-2-0": {"driven_any": 0.03470647296651585, "sim_physics": 0.1548378793398539, "survival_time": 14.950000000000076, "driven_lanedir": 0.03381949071458257, "sim_render-ego": 0.01042185386021932, "in-drivable-lane": 0, "agent_compute-ego": 0.07915138562520345, "deviation-heading": 3.383207500061495, "set_robot_commands": 0.008032506306966145, "deviation-center-line": 1.3041686134459638, "driven_lanedir_consec": 0.03381949071458257, "sim_compute_sim_state": 0.004430290063222249, "sim_compute_performance-ego": 0.006225291093190511, "sim_compute_robot_state-ego": 0.007784860928853353, "sim_compute_robot_state-npc0": 0.007887645562489828, "sim_compute_robot_state-npc1": 0.007494916121164957, "sim_compute_robot_state-npc2": 0.007878652413686116, "sim_compute_robot_state-npc3": 0.007438839276631673}, "udem1-3-0": {"driven_any": 0.03442202153358084, "sim_physics": 0.15973506371180216, "survival_time": 14.950000000000076, "driven_lanedir": 0.03203257428871087, "sim_render-ego": 0.010567375818888346, "in-drivable-lane": 0, "agent_compute-ego": 0.07578238487243652, "deviation-heading": 5.588610897133456, "set_robot_commands": 0.007578136126200358, "deviation-center-line": 0.08749232897480984, "driven_lanedir_consec": 0.03203257428871087, "sim_compute_sim_state": 0.004203582604726155, "sim_compute_performance-ego": 0.00587461789449056, "sim_compute_robot_state-ego": 0.007583468755086263, "sim_compute_robot_state-npc0": 0.007226609388987224, "sim_compute_robot_state-npc1": 0.007257785797119141, "sim_compute_robot_state-npc2": 0.007020339171091716, "sim_compute_robot_state-npc3": 0.006893905798594157}, "udem1-4-0": {"driven_any": 0.03390490013408585, "sim_physics": 0.15440836350123088, "survival_time": 14.950000000000076, "driven_lanedir": 0.03229085304245016, "sim_render-ego": 0.010686155160268149, "in-drivable-lane": 0, "agent_compute-ego": 0.07482882976531982, "deviation-heading": 4.633988355810592, "set_robot_commands": 0.00792680819829305, "deviation-center-line": 0.10096345478322616, "driven_lanedir_consec": 0.03229085304245016, "sim_compute_sim_state": 0.004419013659159343, "sim_compute_performance-ego": 0.006205089092254638, "sim_compute_robot_state-ego": 0.007555320262908936, "sim_compute_robot_state-npc0": 0.0076692501703898115, "sim_compute_robot_state-npc1": 0.007484718163808187, "sim_compute_robot_state-npc2": 0.007255805333455404, "sim_compute_robot_state-npc3": 0.007123323281606039}, "udem1-5-0": {"driven_any": 0.03327158684579707, "sim_physics": 0.14434296846389771, "survival_time": 14.950000000000076, "driven_lanedir": 0.03288071774376755, "sim_render-ego": 0.010238540967305502, "in-drivable-lane": 0, "agent_compute-ego": 0.07861106157302857, "deviation-heading": 2.222705791740875, "set_robot_commands": 0.007891398270924886, "deviation-center-line": 0.07927392683306739, "driven_lanedir_consec": 0.03288071774376755, "sim_compute_sim_state": 0.004337778886159261, "sim_compute_performance-ego": 0.006137882868448893, "sim_compute_robot_state-ego": 0.007546199957529704, "sim_compute_robot_state-npc0": 0.007907175223032633, "sim_compute_robot_state-npc1": 0.007360951900482178, "sim_compute_robot_state-npc2": 0.0074415858586629234, "sim_compute_robot_state-npc3": 0.007115769386291504}, "udem1-6-0": {"driven_any": 0.034456407031415406, "sim_physics": 0.15102749745051067, "survival_time": 14.950000000000076, "driven_lanedir": 0.03359051216426545, "sim_render-ego": 0.01046115001042684, "in-drivable-lane": 0, "agent_compute-ego": 0.07830221017201741, "deviation-heading": 3.364217945940352, "set_robot_commands": 0.007803425788879394, "deviation-center-line": 0.8619953157612215, "driven_lanedir_consec": 0.03359051216426545, "sim_compute_sim_state": 0.004354982376098633, "sim_compute_performance-ego": 0.0062394301096598305, "sim_compute_robot_state-ego": 0.0075662032763163245, "sim_compute_robot_state-npc0": 0.007699895699818929, "sim_compute_robot_state-npc1": 0.007387491861979166, "sim_compute_robot_state-npc2": 0.00724652369817098, "sim_compute_robot_state-npc3": 0.007310731410980225}, "udem1-7-0": {"driven_any": 0.034741540279716765, "sim_physics": 0.1562013880411784, "survival_time": 14.950000000000076, "driven_lanedir": 0.034708159444901465, "sim_render-ego": 0.010237046877543132, "in-drivable-lane": 0, "agent_compute-ego": 0.07456783771514892, "deviation-heading": 0.6608607976274126, "set_robot_commands": 0.007584873835245768, "deviation-center-line": 0.6292841214245385, "driven_lanedir_consec": 0.034708159444901465, "sim_compute_sim_state": 0.004055525461832682, "sim_compute_performance-ego": 0.006092986265818278, "sim_compute_robot_state-ego": 0.0072814758618672685, "sim_compute_robot_state-npc0": 0.007407790025075277, "sim_compute_robot_state-npc1": 0.007126418749491373, "sim_compute_robot_state-npc2": 0.006971750259399414, "sim_compute_robot_state-npc3": 0.006863556702931722}, "udem1-8-0": {"driven_any": 0.03367259639271203, "sim_physics": 0.1434488042195638, "survival_time": 14.950000000000076, "driven_lanedir": 0.0336326287878812, "sim_render-ego": 0.010296407540639242, "in-drivable-lane": 0, "agent_compute-ego": 0.07997052987416585, "deviation-heading": 0.6839393393645626, "set_robot_commands": 0.007886068026224772, "deviation-center-line": 1.210943517166155, "driven_lanedir_consec": 0.0336326287878812, "sim_compute_sim_state": 0.004400521119435628, "sim_compute_performance-ego": 0.006218115488688151, "sim_compute_robot_state-ego": 0.00750844160715739, "sim_compute_robot_state-npc0": 0.007691116333007813, "sim_compute_robot_state-npc1": 0.007292343775431315, "sim_compute_robot_state-npc2": 0.007148607571919759, "sim_compute_robot_state-npc3": 0.007291884422302246}, "udem1-9-0": {"driven_any": 0.03473022537681892, "sim_physics": 0.1687695542971293, "survival_time": 14.950000000000076, "driven_lanedir": 0.033728596531148014, "sim_render-ego": 0.010422992706298827, "in-drivable-lane": 0, "agent_compute-ego": 0.07727578004201253, "deviation-heading": 3.6058689788308658, "set_robot_commands": 0.007922036647796631, "deviation-center-line": 1.0859129228679367, "driven_lanedir_consec": 0.033728596531148014, "sim_compute_sim_state": 0.004161908626556397, "sim_compute_performance-ego": 0.006145033836364746, "sim_compute_robot_state-ego": 0.0074820280075073246, "sim_compute_robot_state-npc0": 0.007639228502909342, "sim_compute_robot_state-npc1": 0.007127025922139486, "sim_compute_robot_state-npc2": 0.00709540605545044, "sim_compute_robot_state-npc3": 0.007042462825775146}, "udem1-10-0": {"driven_any": 0.03451578468421946, "sim_physics": 0.15509637435277304, "survival_time": 14.950000000000076, "driven_lanedir": 0.03304158225808962, "sim_render-ego": 0.010837193330128989, "in-drivable-lane": 0, "agent_compute-ego": 0.08042505105336507, "deviation-heading": 4.37490794617122, "set_robot_commands": 0.008180886109670004, "deviation-center-line": 0.14730889196761518, "driven_lanedir_consec": 0.03304158225808962, "sim_compute_sim_state": 0.0043901014328002926, "sim_compute_performance-ego": 0.006981644630432129, "sim_compute_robot_state-ego": 0.008435608545939128, "sim_compute_robot_state-npc0": 0.00827254056930542, "sim_compute_robot_state-npc1": 0.007572127978006999, "sim_compute_robot_state-npc2": 0.007469743887583415, "sim_compute_robot_state-npc3": 0.007303269704182943}, "udem1-11-0": {"driven_any": 0.03472153966906985, "sim_physics": 0.16916504462560017, "survival_time": 14.950000000000076, "driven_lanedir": 0.034701238262007994, "sim_render-ego": 0.011653491655985514, "in-drivable-lane": 0, "agent_compute-ego": 0.08657956202824911, "deviation-heading": 0.2939943358931355, "set_robot_commands": 0.009075028896331787, "deviation-center-line": 0.8921793724193006, "driven_lanedir_consec": 0.034701238262007994, "sim_compute_sim_state": 0.004731953144073486, "sim_compute_performance-ego": 0.007043109734853109, "sim_compute_robot_state-ego": 0.008704267342885335, "sim_compute_robot_state-npc0": 0.008802045981089274, "sim_compute_robot_state-npc1": 0.008200273513793946, "sim_compute_robot_state-npc2": 0.008064736525217692, "sim_compute_robot_state-npc3": 0.007859154542287191}, "udem1-12-0": {"driven_any": 0.03333633389717332, "sim_physics": 0.1756798044840495, "survival_time": 14.950000000000076, "driven_lanedir": 0.03321862595260505, "sim_render-ego": 0.0121397066116333, "in-drivable-lane": 0, "agent_compute-ego": 0.09064410368601482, "deviation-heading": 1.176678855849465, "set_robot_commands": 0.009523510138193766, "deviation-center-line": 0.7191116850449278, "driven_lanedir_consec": 0.03321862595260505, "sim_compute_sim_state": 0.004907956123352051, "sim_compute_performance-ego": 0.0073591121037801105, "sim_compute_robot_state-ego": 0.0089481258392334, "sim_compute_robot_state-npc0": 0.009025631745656333, "sim_compute_robot_state-npc1": 0.008497578303019206, "sim_compute_robot_state-npc2": 0.008204196294148763, "sim_compute_robot_state-npc3": 0.008259236812591553}, "udem1-13-0": {"driven_any": 0.03466399805640557, "sim_physics": 0.1754397360483805, "survival_time": 14.950000000000076, "driven_lanedir": 0.0328307889986279, "sim_render-ego": 0.012490388552347818, "in-drivable-lane": 0, "agent_compute-ego": 0.09246370951334636, "deviation-heading": 4.858232900682434, "set_robot_commands": 0.009903250535329184, "deviation-center-line": 0.4425170183180754, "driven_lanedir_consec": 0.0328307889986279, "sim_compute_sim_state": 0.005037968953450521, "sim_compute_performance-ego": 0.007537803649902344, "sim_compute_robot_state-ego": 0.009213964939117431, "sim_compute_robot_state-npc0": 0.009181319077809651, "sim_compute_robot_state-npc1": 0.00873750368754069, "sim_compute_robot_state-npc2": 0.008565421104431153, "sim_compute_robot_state-npc3": 0.008378888765970866}, "udem1-14-0": {"driven_any": 0.03446401033685223, "sim_physics": 0.18111766497294107, "survival_time": 14.950000000000076, "driven_lanedir": 0.03427267915830523, "sim_render-ego": 0.0127223801612854, "in-drivable-lane": 0, "agent_compute-ego": 0.08809430917104086, "deviation-heading": 1.5614645397153395, "set_robot_commands": 0.010062023798624677, "deviation-center-line": 1.1215903759652033, "driven_lanedir_consec": 0.03427267915830523, "sim_compute_sim_state": 0.005039571126302083, "sim_compute_performance-ego": 0.007660176753997803, "sim_compute_robot_state-ego": 0.009364085992177328, "sim_compute_robot_state-npc0": 0.009141646226247153, "sim_compute_robot_state-npc1": 0.008810483614603678, "sim_compute_robot_state-npc2": 0.008737456798553467, "sim_compute_robot_state-npc3": 0.008438340822855632}}
set_robot_commands_max0.010062023798624677
set_robot_commands_mean0.008374185562133788
set_robot_commands_median0.00792680819829305
set_robot_commands_min0.007578136126200358
sim_compute_performance-ego_max0.007660176753997803
sim_compute_performance-ego_mean0.006556434472401938
sim_compute_performance-ego_median0.0062394301096598305
sim_compute_performance-ego_min0.00587461789449056
sim_compute_robot_state-ego_max0.009364085992177328
sim_compute_robot_state-ego_mean0.00803771612379286
sim_compute_robot_state-ego_median0.007758709589640299
sim_compute_robot_state-ego_min0.0072814758618672685
sim_compute_robot_state-npc0_max0.009181319077809651
sim_compute_robot_state-npc0_mean0.008067262914445665
sim_compute_robot_state-npc0_median0.007887645562489828
sim_compute_robot_state-npc0_min0.007226609388987224
sim_compute_robot_state-npc1_max0.008810483614603678
sim_compute_robot_state-npc1_mean0.007683785809410941
sim_compute_robot_state-npc1_median0.007484718163808187
sim_compute_robot_state-npc1_min0.007126418749491373
sim_compute_robot_state-npc2_max0.008737456798553467
sim_compute_robot_state-npc2_mean0.00760183016459147
sim_compute_robot_state-npc2_median0.007453201611836751
sim_compute_robot_state-npc2_min0.006971750259399414
sim_compute_robot_state-npc3_max0.008438340822855632
sim_compute_robot_state-npc3_mean0.007462626987033421
sim_compute_robot_state-npc3_median0.007303269704182943
sim_compute_robot_state-npc3_min0.006863556702931722
sim_compute_sim_state_max0.005039571126302083
sim_compute_sim_state_mean0.004497868167029487
sim_compute_sim_state_median0.004419013659159343
sim_compute_sim_state_min0.004055525461832682
sim_physics_max0.1831443007787069
sim_physics_mean0.16215385087331136
sim_physics_median0.15973506371180216
sim_physics_min0.1434488042195638
sim_render-ego_max0.0127223801612854
sim_render-ego_mean0.010959308624267578
sim_render-ego_median0.010567375818888346
sim_render-ego_min0.010237046877543132
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
25885step1-simulationsuccessno0:50:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25873step1-simulationhost-errorno0:01:22
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 894, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1277, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 306, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 287, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LFVI-sim-testing/submission4244/step1-simulation-ip-172-31-45-34-10499-job25873': '/tmp/duckietown/DT18/evaluator/executions/aido3-LFVI-sim-testing/submission4244/step1-simulation-ip-172-31-45-34-10499-job25873'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25457step1-simulationsuccessno0:45:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24907step1-simulationerrorno0:44:27
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24450step1-simulationerrorno0:04:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24447step1-simulationerrorno0:04:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible