Differences

This shows you the differences between two versions of the page.

--- public:t-720-atai:atai-20:engineering_assignment_1 [2020/08/24 09:49] – thorisson
+++ public:t-720-atai:atai-20:engineering_assignment_1 [2024/04/29 13:33] (current) – external edit 127.0.0.1
@@ Line 20: / Line 20: @@
     - Run the learner repeatedly; collect the data. Stop each run when either 1000 epochs are reached or the agent manages to get more than 200 iterations in average per epoch over at least 100 continuous epochs (this is usually the case at around 400-500 epochs).
     - Plot its improvement in performance over time.
-  - **Modified Version.** Evaluate the learner’s performance on a modified version of the cart-pole task. For this you should evaluate at least 3 of the following modifications of the environments:
+  - **Modified Version.** Evaluate the learner’s performance on a modified version of the cart-pole task. For this you should evaluate at least 3 of the following modifications of the environments and compare them to the results from 1.:
     - Noise on observation/ action/ and environment dynamics.
     - Hide each variable once (x, v, theta, omega) and run the setup with only three observables.
@@ Line 26: / Line 26: @@
     - Change the task after a certain amount of epochs. Think of at least three different changes, one is given as an example in the code.
     - Change the discreteness of time/ observables increasing or decreasing the variable resolution.
-    - And compare them to the results from 1.
   - **New Task-Environment.** Design your own simple task-environment in which you can show your own ideas of complexity of task-environments which might not have been included in the cart-pole.
   - **Report.** Write a 1-2 page report where you describe your results. Draw some insights in relation to learning in general and try to make some generalizations based on them, and discuss, e.g.:
@@ Line 32: / Line 31: @@
     - Which changes will be //impossible// for the actor-critic to adjust to (try this out yourself from what you know of neural networks; hint: input and output layers of ANNs).
     - What is your opinion of the //generality// and //adaptability// of the actor-critic learner with respect to **//novelty//** (novel task-environments)?
-    - Is this in nay way similar to how humans learn? If 'yes', how? If 'no', what's different, and why?
+    - Is this in any way similar to how humans learn? If 'yes', how? If 'no', what's different, and why?
     - ...more
@@ Line 50: / Line 49: @@
   $ python main.py
-Zip File: {{:public:t-720-atai:atai-20:exercise_1.zip|Zip file}}
+Zip Files:\\
+{{:public:t-720-atai:atai-20:exercise_1.zip|Old zip file}}\\
+{{:public:t-720-atai:atai-20:exercise_1_updated.zip|Updated zip file}}
+\\
+\\
 === Further information ===