1. In Q-learning, what does the Q stand for (you will have to research this on the internet).
2. What could we do to limit the number of states that the Q-learning algorithm has to search through?
3. What effect does changing the learning rate have on the learning process?
4. What function or parameter serves to penalize longer paths in the Q-learning equation? What effect does increasing or decreasing this function have?
5. In the genetic algorithm, how would you go about penalizing longer paths so that shorter paths (fewer number of steps) would be preferred?
6. Look up the SARSA variation of Q-learning. How would you implement the SARSA technique into program 2.
7. What effect does changing the learning rate in the genetic algorithm change? What is the upper and lower bound of the learning rate?
8. In the genetic algorithm, what effect does lowering the population cause?

...