Duckietown Challenges Home Challenges Submissions

Submission 1036

Submission1036
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11789 step2-scoring: 11801 step3-videos: 11806 step4-viz: 11815
Next
User labelROS-based Lane Following
Admin priority60
Blessingn/a
User priority60

11815

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11806

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
11815step4-vizsuccessyes0:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.504998595325894
deviation-center-line_median0.7647388365126653
in-drivable-lane_median1.4999999999999958


other stats
deviation-center-line_max1.9793178603548764
deviation-center-line_mean1.0263645390722893
deviation-center-line_min0.30199150553700044
deviation-heading_max2.782999873378505
deviation-heading_mean1.5608584346390624
deviation-heading_median1.2391260048932795
deviation-heading_min0.4924330042568376
driven_any_max18.65221350872645
driven_any_mean10.5770154940838
driven_any_median7.43246563599023
driven_any_min3.933580883121431
driven_lanedir_max16.329685377885056
driven_lanedir_mean8.49187885342262
driven_lanedir_min2.8206314537293116
in-drivable-lane_max3.099999999999999
in-drivable-lane_mean1.639999999999998
in-drivable-lane_min0.5999999999999994
per-episodes
details{"ep000": {"driven_any": 4.470861959078576, "driven_lanedir": 2.8206314537293116, "in-drivable-lane": 1.4333333333333322, "deviation-heading": 0.4924330042568376, "deviation-center-line": 0.41707953422829896}, "ep001": {"driven_any": 7.43246563599023, "driven_lanedir": 5.504998595325894, "in-drivable-lane": 1.4999999999999958, "deviation-heading": 1.2391260048932795, "deviation-center-line": 0.7647388365126653}, "ep002": {"driven_any": 3.933580883121431, "driven_lanedir": 3.172322114984933, "in-drivable-lane": 0.5999999999999994, "deviation-heading": 0.793739066310189, "deviation-center-line": 0.30199150553700044}, "ep003": {"driven_any": 18.395955483502316, "driven_lanedir": 14.631756725187904, "in-drivable-lane": 3.099999999999999, "deviation-heading": 2.4959942243565005, "deviation-center-line": 1.6686949587286055}, "ep004": {"driven_any": 18.65221350872645, "driven_lanedir": 16.329685377885056, "in-drivable-lane": 1.5666666666666635, "deviation-heading": 2.782999873378505, "deviation-center-line": 1.9793178603548764}}
No reset possible
11806step3-videossuccessyes0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11801step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.899999999999985


other stats
episodes
details{"ep000": {"nsteps": 123, "reward": -8.047446881482903, "good_angle": 1.80537763760018, "survival_time": 4.099999999999995, "traveled_tiles": 6, "valid_direction": 0.9666666666666642}, "ep001": {"nsteps": 207, "reward": -4.6113046723441, "good_angle": 3.139006430984754, "survival_time": 6.899999999999985, "traveled_tiles": 10, "valid_direction": 1.5666666666666624}, "ep002": {"nsteps": 115, "reward": -8.790579609265146, "good_angle": 6.0011433532658085, "survival_time": 3.8333333333333295, "traveled_tiles": 8, "valid_direction": 1.6999999999999995}, "ep003": {"nsteps": 500, "reward": 0.2395644602875691, "good_angle": 13.604419746150644, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.9333333333333327}, "ep004": {"nsteps": 500, "reward": 0.1268693088075961, "good_angle": 21.706766678318893, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.333333333333322}}
good_angle_max21.706766678318893
good_angle_mean9.251342769264056
good_angle_median6.0011433532658085
good_angle_min1.80537763760018
reward_max0.2395644602875691
reward_mean-4.216579478799397
reward_median-4.6113046723441
reward_min-8.790579609265146
survival_time_max16.666666666666654
survival_time_mean9.633333333333322
survival_time_min3.8333333333333295
traveled_tiles_max18
traveled_tiles_mean12
traveled_tiles_median10
traveled_tiles_min6
valid_direction_max4.333333333333322
valid_direction_mean2.4999999999999964
valid_direction_median1.6999999999999995
valid_direction_min0.9666666666666642
No reset possible
11789step1-simulationsuccessyes0:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8328step1-simulationfailedno0:06:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8327step1-simulationerrorno0:01:00
Error while running [...]

Pulling evaluator ... error
stderr | ERROR: for solution  Get https://registry-1.docker.io/v2/maivincent/aido1_lf1_r3-v3-submission/manifests/2018_11_14_00_16_27: proxyconnect tcp: dial tcp 192.168.65.1:3129: i/o timeout
stderr | 
stderr | ERROR: for evaluator  Get https://registry-1.docker.io/v2/andreacensi/aido1_lf1_r3-v3-step1-simulation-evaluator/manifests/2018_11_08_16_21_06: proxyconnect tcp: dial tcp 192.168.65.1:3129: i/o timeout
stderr | Get https://registry-1.docker.io/v2/maivincent/aido1_lf1_r3-v3-submission/manifests/2018_11_14_00_16_27: proxyconnect tcp: dial tcp 192.168.65.1:3129: i/o timeout
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido1_lf1_r3-v3-step1-simulation-evaluator/manifests/2018_11_08_16_21_06: proxyconnect tcp: dial tcp 192.168.65.1:3129: i/o timeout
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8326step1-simulationfailedno0:04:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8325step1-simulationsuccessno0:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8324step1-simulationabortedno0:00:13
Error while running [...]

Creating job8324-4499_solution_1  ... error
stderr | ERROR: for job8324-4499_solution_1  Cannot start service solution: network job8324-4499_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8324-4499_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8324-4499_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8323step1-simulationfailedno0:04:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8322step1-simulationsuccessno0:05:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible