Training a coding model to paint watercolours with TRL and OpenEnv
Hugging Face
A language model training pipeline was built to generate p5.brush JavaScript sketches that paint watercolor-style images, using an open RL environment and open reward pool tied to aesthetic preference judgments. The post reports an HF command that trains with 110 steps and 240 episodes per run. As a result, three GRPO training runs with different reward-model weightings produced comparable watercolor outputs and all the RL environment, pool, training scripts, and trained models were published to run end-to-end on Hugging Face.