Written down so it can be wrong.

Affective Reinforcement Learning

Dual-policy optimization through a simulated internal state

The agent has two goals at once: do the task, and keep its own state up. That state is one number running from bad to good, and it also decides which of the two goals gets more say. Here is the plan, the predictions, and what would count as failure.