As always, thank you @Tiny_Tsuruta and @kftiger for guidance and inspiration!
Once upon a time (before reality tv, the internet and the end of civil discourse) there was a program called The Morton Downey Jr. Show. Not to be confused with Robert Downey Jr. A show that was essentially a cage match between the eponymously titled host, his guests and the studio audience.
This model the RAGE GENERATOR is based on the 30 second opening sequence for his show. I found a better copy than that but still had to upscale and refine the screen caps. Despite that it still reproduces Mort enough that I have to check the real person box. ...onsite generator sadness.
Seems to work with or without the trigger: RGGNRTR
Trained in vintage 4:3 ratio but not necessary.
Lower strengths allow for lower Morton likeness. Higher strengths bring Morton to the forefront.
Examples:
man in suit, mouth (Happy, Angry, Open, Closed), (Add Subject of Rage), light blue to violet gradient background.
RGGNRTR. man with suit and tie. man facing wall. wall of tvs with (Add Subject of Rage)
Or RGGNRTR, (SUBJECT)(TOPIC)(SCENE)
About Find the smile. Of course you can control that with "mouth (expression)" but I think it likes God, America, Apple Pie and Smoking. It obviously likes yelling.
Some of the images used in the dataset: