Duckietown Challenges Home Challenges Submissions

Evaluator 483

ID483
evaluatorrudolf-2
ownerAndrea CensiΒ πŸ‡¨πŸ‡­
machineidsc-rudolf
processrudolf-2
versionDC:4.0.4;DCR:4.0.5;DTS:4.0.6
first heard
last heard
statusinactive
# evaluating
# success11 16840
# timeout
# failed
# error3 16859
# aborted
# host-error1 16970
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
169722277FANG MEIYIΒ πŸ‡ΈπŸ‡¬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornorudolf-20:00:38
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169702264Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationhost-errornorudolf-20:00:49
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 418, in go_
    challenge_step_name, project, do_pull, debug_volumes=debug_volumes)
  File "/project/src/duckietown_challenges_runner/runner.py", line 521, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 861, in write_logs
    f.write(logs)
UnicodeEncodeError: 'ascii' codec can't encode character '\u2502' in position 6470: ordinal not in range(128)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169492269Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido2_LFV_r1-v4step1-simulationsuccessnorudolf-20:15:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9306017070461028
deviation-center-line_median0.2467154410917354
in-drivable-lane_median2.299999999999992


other stats
deviation-center-line_max0.34338570913942046
deviation-center-line_mean0.25030164980112507
deviation-center-line_min0.16439000788160887
deviation-heading_max1.6095489732413446
deviation-heading_mean0.97710984480811
deviation-heading_median0.9609461645189982
deviation-heading_min0.3769980769530998
driven_any_max2.234179003106766
driven_any_mean1.8425421206705448
driven_any_median1.873567146510747
driven_any_min1.3888551865539178
driven_lanedir_consec_max1.3390397100187108
driven_lanedir_consec_mean0.983516144317161
driven_lanedir_consec_min0.7338214531577274
driven_lanedir_max1.7355909832406682
driven_lanedir_mean1.089808351204569
driven_lanedir_median0.944910484209941
driven_lanedir_min0.7338214531577274
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean2.224999999999992
in-drivable-lane_min1.149999999999996
per-episodes
details{"4way-0-0": {"driven_any": 2.1748492745499397, "driven_lanedir": 1.0586363759652746, "in-drivable-lane": 3.149999999999989, "deviation-heading": 1.6095489732413446, "deviation-center-line": 0.3286137010320844, "driven_lanedir_consec": 1.030018821637598}, "4way-1-0": {"driven_any": 2.234179003106766, "driven_lanedir": 1.7355909832406682, "in-drivable-lane": 1.149999999999996, "deviation-heading": 1.530260565460663, "deviation-center-line": 0.34338570913942046, "driven_lanedir_consec": 1.3390397100187108}, "udem1-0-0": {"driven_any": 1.3888551865539178, "driven_lanedir": 0.8311845924546073, "in-drivable-lane": 1.7999999999999936, "deviation-heading": 0.39163176357733337, "deviation-center-line": 0.16481718115138638, "driven_lanedir_consec": 0.8311845924546073}, "udem1-1-0": {"driven_any": 1.5722850184715549, "driven_lanedir": 0.7338214531577274, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.3769980769530998, "deviation-center-line": 0.16439000788160887, "driven_lanedir_consec": 0.7338214531577274}}
simulation-passed1
No reset possible
169482272Andrea CensiΒ πŸ‡¨πŸ‡­PredictorMeanaido2-PREDstep1-simulationsuccessnorudolf-20:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.2823839607863072
error_L20.09486695492431237


No reset possible
169142240Ka Yue FungΒ πŸ‡­πŸ‡°Solution templateaido1_test_multistep-v3step1errornorudolf-20:30:29
Timeout: Waited 180 [...]
Timeout:

Waited 1800.493343114853 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168592240Ka Yue FungΒ πŸ‡­πŸ‡°Solution templateaido1_test_multistep-v3step1errornorudolf-20:30:49
Timeout: Waited 180 [...]
Timeout:

Waited 1800.5817947387695 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168552254Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido1_luck-v4step1successnorudolf-20:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score11.2220106031628577


No reset possible
168542254Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido1_luck-v4step1successnorudolf-20:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score12.754798390979687


No reset possible
168522254Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido1_luck-v4step1successnorudolf-20:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score18.386698203351614


No reset possible
168492248Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido1_luck-v4step1successnorudolf-20:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score187.6567953035075


No reset possible
168482254Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido1_luck-v4step1successnorudolf-20:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score150.61749207051162


No reset possible
168462254Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido1_luck-v4step1successnorudolf-20:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score195.41956702569884


No reset possible
168432248Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido1_luck-v4step1successnorudolf-20:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score158.52718341539662


No reset possible
168412248Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido1_luck-v4step1successnorudolf-20:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score18.304603077261575


No reset possible
168402254Andrea CensiΒ πŸ‡¨πŸ‡­Solution templateaido1_luck-v4step1successnorudolf-20:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score163.811767764781344


No reset possible