Evaluator 2226

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

39936

10404

Bea Baselines 🐤

straight

aido5-LFVI-sim-testing

LFVIt-sim

error

reg04-cb6499190cf5-1

2020-11-06 20:56:01+00:00

2020-11-06 21:57:18+00:00

1:01:17

Waited 3619 seconds [...]

Waited 3619 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

39934

10376

Bea Baselines 🐤

template-random

aido5-LF-sanity-sim-validation

sanity-check

success

yes

reg04-cb6499190cf5-1

2020-11-06 20:53:25+00:00

2020-11-06 20:54:55+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06871089847212986
survival_time_median	0.49999999999999994
deviation-center-line_median	0.008019844335283851
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.02365753867409446
agent_compute-ego_mean	0.02365753867409446
agent_compute-ego_median	0.02365753867409446
agent_compute-ego_min	0.02365753867409446
complete-iteration_max	0.3822014765305953
complete-iteration_mean	0.3822014765305953
complete-iteration_median	0.3822014765305953
complete-iteration_min	0.3822014765305953
deviation-center-line_max	0.008019844335283851
deviation-center-line_mean	0.008019844335283851
deviation-center-line_min	0.008019844335283851
deviation-heading_max	0.05040343959962079
deviation-heading_mean	0.05040343959962079
deviation-heading_median	0.05040343959962079
deviation-heading_min	0.05040343959962079
driven_any_max	0.0689817689678746
driven_any_mean	0.0689817689678746
driven_any_median	0.0689817689678746
driven_any_min	0.0689817689678746
driven_lanedir_consec_max	0.06871089847212986
driven_lanedir_consec_mean	0.06871089847212986
driven_lanedir_consec_min	0.06871089847212986
driven_lanedir_max	0.06871089847212986
driven_lanedir_mean	0.06871089847212986
driven_lanedir_median	0.06871089847212986
driven_lanedir_min	0.06871089847212986
get_duckie_state_max	0.005040667273781516
get_duckie_state_mean	0.005040667273781516
get_duckie_state_median	0.005040667273781516
get_duckie_state_min	0.005040667273781516
get_robot_state_max	0.01958786357532848
get_robot_state_mean	0.01958786357532848
get_robot_state_median	0.01958786357532848
get_robot_state_min	0.01958786357532848
get_state_dump_max	0.016638539054177025
get_state_dump_mean	0.016638539054177025
get_state_dump_median	0.016638539054177025
get_state_dump_min	0.016638539054177025
get_ui_image_max	0.06662412123246626
get_ui_image_mean	0.06662412123246626
get_ui_image_median	0.06662412123246626
get_ui_image_min	0.06662412123246626
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.0689817689678746, "get_ui_image": 0.06662412123246626, "step_physics": 0.19427798011086203, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06871089847212986, "get_state_dump": 0.016638539054177025, "sim_render-ego": 0.009233734824440697, "get_robot_state": 0.01958786357532848, "get_duckie_state": 0.005040667273781516, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02365753867409446, "deviation-heading": 0.05040343959962079, "complete-iteration": 0.3822014765305953, "set_robot_commands": 0.005726294084028764, "deviation-center-line": 0.008019844335283851, "driven_lanedir_consec": 0.06871089847212986, "sim_compute_sim_state": 0.03588344834067605, "sim_compute_performance-ego": 0.0053567019375887785}}
set_robot_commands_max	0.005726294084028764
set_robot_commands_mean	0.005726294084028764
set_robot_commands_median	0.005726294084028764
set_robot_commands_min	0.005726294084028764
sim_compute_performance-ego_max	0.0053567019375887785
sim_compute_performance-ego_mean	0.0053567019375887785
sim_compute_performance-ego_median	0.0053567019375887785
sim_compute_performance-ego_min	0.0053567019375887785
sim_compute_sim_state_max	0.03588344834067605
sim_compute_sim_state_mean	0.03588344834067605
sim_compute_sim_state_median	0.03588344834067605
sim_compute_sim_state_min	0.03588344834067605
sim_render-ego_max	0.009233734824440697
sim_render-ego_mean	0.009233734824440697
sim_render-ego_median	0.009233734824440697
sim_render-ego_min	0.009233734824440697
simulation-passed	1
step_physics_max	0.19427798011086203
step_physics_mean	0.19427798011086203
step_physics_median	0.19427798011086203
step_physics_min	0.19427798011086203
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

39930

10406

Bea Baselines 🐤

baseline-duckietown

aido5-LF-sanity-sim-validation

sanity-check

success

yes

reg04-cb6499190cf5-1

2020-11-06 20:50:10+00:00

2020-11-06 20:51:49+00:00

0:01:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.020309026130807872
survival_time_median	0.49999999999999994
deviation-center-line_median	0.007329527809812471
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.02870113199407404
agent_compute-ego_mean	0.02870113199407404
agent_compute-ego_median	0.02870113199407404
agent_compute-ego_min	0.02870113199407404
complete-iteration_max	0.38878245787187055
complete-iteration_mean	0.38878245787187055
complete-iteration_median	0.38878245787187055
complete-iteration_min	0.38878245787187055
deviation-center-line_max	0.007329527809812471
deviation-center-line_mean	0.007329527809812471
deviation-center-line_min	0.007329527809812471
deviation-heading_max	0.05430062538429425
deviation-heading_mean	0.05430062538429425
deviation-heading_median	0.05430062538429425
deviation-heading_min	0.05430062538429425
driven_any_max	0.02042886035227655
driven_any_mean	0.02042886035227655
driven_any_median	0.02042886035227655
driven_any_min	0.02042886035227655
driven_lanedir_consec_max	0.020309026130807872
driven_lanedir_consec_mean	0.020309026130807872
driven_lanedir_consec_min	0.020309026130807872
driven_lanedir_max	0.020309026130807872
driven_lanedir_mean	0.020309026130807872
driven_lanedir_median	0.020309026130807872
driven_lanedir_min	0.020309026130807872
get_duckie_state_max	0.005401047793301669
get_duckie_state_mean	0.005401047793301669
get_duckie_state_median	0.005401047793301669
get_duckie_state_min	0.005401047793301669
get_robot_state_max	0.01929937709461559
get_robot_state_mean	0.01929937709461559
get_robot_state_median	0.01929937709461559
get_robot_state_min	0.01929937709461559
get_state_dump_max	0.018021475185047497
get_state_dump_mean	0.018021475185047497
get_state_dump_median	0.018021475185047497
get_state_dump_min	0.018021475185047497
get_ui_image_max	0.07075491818514737
get_ui_image_mean	0.07075491818514737
get_ui_image_median	0.07075491818514737
get_ui_image_min	0.07075491818514737
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.02042886035227655, "get_ui_image": 0.07075491818514737, "step_physics": 0.1910727240822532, "survival_time": 0.49999999999999994, "driven_lanedir": 0.020309026130807872, "get_state_dump": 0.018021475185047497, "sim_render-ego": 0.008842078122225676, "get_robot_state": 0.01929937709461559, "get_duckie_state": 0.005401047793301669, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02870113199407404, "deviation-heading": 0.05430062538429425, "complete-iteration": 0.38878245787187055, "set_robot_commands": 0.005820035934448242, "deviation-center-line": 0.007329527809812471, "driven_lanedir_consec": 0.020309026130807872, "sim_compute_sim_state": 0.03436738794500178, "sim_compute_performance-ego": 0.0062943588603626595}}
set_robot_commands_max	0.005820035934448242
set_robot_commands_mean	0.005820035934448242
set_robot_commands_median	0.005820035934448242
set_robot_commands_min	0.005820035934448242
sim_compute_performance-ego_max	0.0062943588603626595
sim_compute_performance-ego_mean	0.0062943588603626595
sim_compute_performance-ego_median	0.0062943588603626595
sim_compute_performance-ego_min	0.0062943588603626595
sim_compute_sim_state_max	0.03436738794500178
sim_compute_sim_state_mean	0.03436738794500178
sim_compute_sim_state_median	0.03436738794500178
sim_compute_sim_state_min	0.03436738794500178
sim_render-ego_max	0.008842078122225676
sim_render-ego_mean	0.008842078122225676
sim_render-ego_median	0.008842078122225676
sim_render-ego_min	0.008842078122225676
simulation-passed	1
step_physics_max	0.1910727240822532
step_physics_mean	0.1910727240822532
step_physics_median	0.1910727240822532
step_physics_min	0.1910727240822532
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

39925

10403

Bea Baselines 🐤

straight

aido5-LFVI-sim-validation

LFVIv-sim

success

reg04-cb6499190cf5-1

2020-11-06 20:40:21+00:00

2020-11-06 20:49:45+00:00

0:09:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6513468578527846
survival_time_median	10.350000000000012
deviation-center-line_median	0.38492257857602347
in-drivable-lane_median	5.500000000000021

other stats

agent_compute-ego_max	0.02094611683905413
agent_compute-ego_mean	0.02094611683905413
agent_compute-ego_median	0.02094611683905413
agent_compute-ego_min	0.02094611683905413
agent_compute-npc0_max	0.07188177223942706
agent_compute-npc0_mean	0.07188177223942706
agent_compute-npc0_median	0.07188177223942706
agent_compute-npc0_min	0.07188177223942706
agent_compute-npc1_max	0.08047438358915025
agent_compute-npc1_mean	0.08047438358915025
agent_compute-npc1_median	0.08047438358915025
agent_compute-npc1_min	0.08047438358915025
agent_compute-npc2_max	0.08067176768169311
agent_compute-npc2_mean	0.08067176768169311
agent_compute-npc2_median	0.08067176768169311
agent_compute-npc2_min	0.08067176768169311
agent_compute-npc3_max	0.08127483538383447
agent_compute-npc3_mean	0.08127483538383447
agent_compute-npc3_median	0.08127483538383447
agent_compute-npc3_min	0.08127483538383447
complete-iteration_max	1.750813377076301
complete-iteration_mean	1.750813377076301
complete-iteration_median	1.750813377076301
complete-iteration_min	1.750813377076301
deviation-center-line_max	0.38492257857602347
deviation-center-line_mean	0.38492257857602347
deviation-center-line_min	0.38492257857602347
deviation-heading_max	1.3516281792896734
deviation-heading_mean	1.3516281792896734
deviation-heading_median	1.3516281792896734
deviation-heading_min	1.3516281792896734
driven_any_max	1.651269286695859
driven_any_mean	1.651269286695859
driven_any_median	1.651269286695859
driven_any_min	1.651269286695859
driven_lanedir_consec_max	0.6513468578527846
driven_lanedir_consec_mean	0.6513468578527846
driven_lanedir_consec_min	0.6513468578527846
driven_lanedir_max	0.6766318008772938
driven_lanedir_mean	0.6766318008772938
driven_lanedir_median	0.6766318008772938
driven_lanedir_min	0.6766318008772938
get_duckie_state_max	4.07615145623396e-06
get_duckie_state_mean	4.07615145623396e-06
get_duckie_state_median	4.07615145623396e-06
get_duckie_state_min	4.07615145623396e-06
get_robot_state_max	0.06148470542281146
get_robot_state_mean	0.06148470542281146
get_robot_state_median	0.06148470542281146
get_robot_state_min	0.06148470542281146
get_state_dump_max	0.034616327516122716
get_state_dump_mean	0.034616327516122716
get_state_dump_median	0.034616327516122716
get_state_dump_min	0.034616327516122716
get_ui_image_max	0.10220186952231589
get_ui_image_mean	0.10220186952231589
get_ui_image_median	0.10220186952231589
get_ui_image_min	0.10220186952231589
in-drivable-lane_max	5.500000000000021
in-drivable-lane_mean	5.500000000000021
in-drivable-lane_min	5.500000000000021
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 1.651269286695859, "get_ui_image": 0.10220186952231589, "step_physics": 1.020497265645271, "survival_time": 10.350000000000012, "driven_lanedir": 0.6766318008772938, "get_state_dump": 0.034616327516122716, "sim_render-ego": 0.008668575885791134, "get_robot_state": 0.06148470542281146, "sim_render-npc0": 0.00891449831534123, "sim_render-npc1": 0.009105363329827495, "sim_render-npc2": 0.008948555315174342, "sim_render-npc3": 0.008721700613049494, "get_duckie_state": 4.07615145623396e-06, "in-drivable-lane": 5.500000000000021, "agent_compute-ego": 0.02094611683905413, "deviation-heading": 1.3516281792896734, "agent_compute-npc0": 0.07188177223942706, "agent_compute-npc1": 0.08047438358915025, "agent_compute-npc2": 0.08067176768169311, "agent_compute-npc3": 0.08127483538383447, "complete-iteration": 1.750813377076301, "set_robot_commands": 0.006726504523972958, "deviation-center-line": 0.38492257857602347, "driven_lanedir_consec": 0.6513468578527846, "sim_compute_sim_state": 0.0904229378354722, "sim_compute_performance-ego": 0.005719029385110606, "sim_compute_performance-npc0": 0.005659686194525825, "sim_compute_performance-npc1": 0.0058041091126520275, "sim_compute_performance-npc2": 0.005828720359986531, "sim_compute_performance-npc3": 0.005673952148732356}}
set_robot_commands_max	0.006726504523972958
set_robot_commands_mean	0.006726504523972958
set_robot_commands_median	0.006726504523972958
set_robot_commands_min	0.006726504523972958
sim_compute_performance-ego_max	0.005719029385110606
sim_compute_performance-ego_mean	0.005719029385110606
sim_compute_performance-ego_median	0.005719029385110606
sim_compute_performance-ego_min	0.005719029385110606
sim_compute_performance-npc0_max	0.005659686194525825
sim_compute_performance-npc0_mean	0.005659686194525825
sim_compute_performance-npc0_median	0.005659686194525825
sim_compute_performance-npc0_min	0.005659686194525825
sim_compute_performance-npc1_max	0.0058041091126520275
sim_compute_performance-npc1_mean	0.0058041091126520275
sim_compute_performance-npc1_median	0.0058041091126520275
sim_compute_performance-npc1_min	0.0058041091126520275
sim_compute_performance-npc2_max	0.005828720359986531
sim_compute_performance-npc2_mean	0.005828720359986531
sim_compute_performance-npc2_median	0.005828720359986531
sim_compute_performance-npc2_min	0.005828720359986531
sim_compute_performance-npc3_max	0.005673952148732356
sim_compute_performance-npc3_mean	0.005673952148732356
sim_compute_performance-npc3_median	0.005673952148732356
sim_compute_performance-npc3_min	0.005673952148732356
sim_compute_sim_state_max	0.0904229378354722
sim_compute_sim_state_mean	0.0904229378354722
sim_compute_sim_state_median	0.0904229378354722
sim_compute_sim_state_min	0.0904229378354722
sim_render-ego_max	0.008668575885791134
sim_render-ego_mean	0.008668575885791134
sim_render-ego_median	0.008668575885791134
sim_render-ego_min	0.008668575885791134
sim_render-npc0_max	0.00891449831534123
sim_render-npc0_mean	0.00891449831534123
sim_render-npc0_median	0.00891449831534123
sim_render-npc0_min	0.00891449831534123
sim_render-npc1_max	0.009105363329827495
sim_render-npc1_mean	0.009105363329827495
sim_render-npc1_median	0.009105363329827495
sim_render-npc1_min	0.009105363329827495
sim_render-npc2_max	0.008948555315174342
sim_render-npc2_mean	0.008948555315174342
sim_render-npc2_median	0.008948555315174342
sim_render-npc2_min	0.008948555315174342
sim_render-npc3_max	0.008721700613049494
sim_render-npc3_mean	0.008721700613049494
sim_render-npc3_median	0.008721700613049494
sim_render-npc3_min	0.008721700613049494
simulation-passed	1
step_physics_max	1.020497265645271
step_physics_mean	1.020497265645271
step_physics_median	1.020497265645271
step_physics_min	1.020497265645271
survival_time_max	10.350000000000012
survival_time_mean	10.350000000000012
survival_time_min	10.350000000000012

No reset possible

39923

10907

Himanshu Arora 🇨🇦

exercise_ros_template

aido5-LF-sim-validation

LFv-sim

aborted

reg04-cb6499190cf5-1

2020-11-06 20:38:30+00:00

2020-11-06 20:40:03+00:00

0:01:33

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

39914

10910

Ayman Shams 🇨🇦

exercise_ros_template

aido5-LF-sim-validation

LFv-sim

aborted

reg04-cb6499190cf5-1

2020-11-06 20:29:10+00:00

2020-11-06 20:38:01+00:00

0:08:51

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

ID	2226
evaluator	`reg04-cb6499190cf5-1`
owner	I don't have one 😀
machine	archimede
process	reg04-cb6499190cf5-1
version	d-c:6.1.23;d-c-r:6.0.59
first heard	2020-11-06 20:24:21+00:00
last heard	2020-11-06 20:56:58+00:00
status	inactive
# evaluating
# success	3 `39925`
# timeout
# failed
# error	1 `39936`
# aborted	2 `39914`
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator 2226

Evaluator jobs