This is an interesting dive into comparing compressing images in a lossy way with what ChatGPT does to the text.
Basically, ChatGPT is like internet compressed into one program. And it explains its strengths and weaknesses.
https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web