Engineering the first self-taught Tales of Tribute agent

Tales of Tribute, or ToT, is an online card game that was particularly hard for AI to play. Imperfect information, a large and dynamic action space, and abstract long-term planning each contributed to make the game a particularly tough reasoning challenge for AI to crack.

As a result, agents at the time required human domain knowledge in order to function. While in high school, I engineered the first RL agent for the game, which learned without human knowledge and approximately matched or beat most baseline domain-knowledge agents.