By observing the results of its own behavior it can modify its own programs so as to achieve some purpose more effectively. These are possibilities of the near future rather than Utopian dreams.We want more than than Turing explicitly asked for. The machine should oberve its processes in action and not just the results.
Of course, logical AI involves using actual sentences in the memory of the machine.
To use hopes in this way requires the self observation to remember what it hoped for.
Sometimes a robot must also infer that other robots or people hope or did hope for certain things.
to assert that in mental situation s, the robot hopes for p.
Human hopes have certain qualities that I can't decide whether we will want. Hope automatically brings into consciousness thoughts related to what a situation realizing the hope would be like. We could design our programs to do the same, but this is more automatic in the human case than might be optimal. Wishful thinking is a well-known human malfunction.