Humans are aware of many different aspects of their minds. Here are samples of kinds of self-awareness--alas not a classification.
Thus I am human like other humans. [I am a small child, and I am "supposed to do" what the others are doing. This is innate or learned very early on the basis of an innate predisposition to learn it.5
What might we want an artificial agent to know about the fact that it is one among many agents? It seems to me that the forms in which self-awareness develops in babies and children are likely to be particularly suggestive for what we will want to build into computers.
It helps to organize as much as possible of a system's knowledge as knowledge of permanent entities.
I am driving to the supermarket. One is aware of the past of the process and also of its future. Awareness of its present depends on some concept of the ``extended now''.
Temporary phenomena
Wants can apply to both states and actions. I want to be healthy, wealthy and wise. I want to marry Yumyum and plan to persuade her guardian Koko to let me.
I suppose you can still haggle, and regard intentions as goals, but if you do you are likely to end up distinguishing a particular kind of goal corresponding to what the unsophisticated call an intention.
Attitudes towards the future:
hopes, fears, goals, expectations, anti-expectations, intentions
action: predict, want to know, promises and commitments.
Attitudes toward the past:
regrets, satisfactions, counterfactuals
I'm aware that I regret having offended him. I believe that if I
hadn't done so, he would have supported my position in this matter.
It looks like a belief is a kind of weak awareness.
Attitudes to the present:
satisfaction, I see a dog. I don't see the dog. I wonder where the
dog has gone.
There are also attitudes toward timeless entities, e.g. towards kinds of people and things. I like strawberry ice cream but not chocolate chip.
Why are hopes and fears definite mental objects? The human brain is always changing but certain structures can persist. Specific hopes and fears can last for years and can be observed. It is likely to be worthwhile to build such structures into robot minds, because they last much longer than specific neural states.