Our physical visual and tactile experiences influence our sense of colour but then so does our emotional touch .. our reactivity to an event, a person, an experience.
Try that too … sensing into how you colour a feeling of ANGER, or even LAUGHTER! And what about LOVE?
May be there will be an array of different colours enter your awareness. That often pops up when we focus on love!
Now pause again for a moment!
When you bring your attention to an experience or emotion, an event or relationship you may (or may not!) get a sense of a colour (or colours). That sense of a colour, may well emerge from a memory but sometimes it just bubbles up from nowhere.