Lorem Ipsum AI

Lorem Ipsum AI is a project utilising transformer text generation models to create placeholder text similiar to Lorem Ipsum, a popular placeholder text.

Data

I retrieved 800kb of data from online Lorem Ipsum generators. You can access this data for your own experiments here.

Training and Results

For this experiment, I used OpenAI's GPT-2 355M model. I trained it for 1250 steps and the final loss value was 0.52. The results can be accessed here