These are "inline" images, included right in the messages (as opposed to linked), so they have to be downloaded.
They are automatically deleted, when their owning messages are.
By default, the app keeps on the device up to 250 recent messages per folder, and trims once a day (at night). The 250 is the "messages to keep" setting - global or per-account, under Options and Folders.