[rt-users] Storing messages containing invalid encodings

[Kenneth Marshall]

On Tue, Jun 15, 2010 at 02:07:36PM -0400, Jesse Vincent wrote:
> 
> 
> > I would chose any approach that keeps bad data out of the database,
> > in this case incorrect UTF-8.
> 
> That's sort of a non-starter for me. On the open Internet, bad data is
> a reality.  RT needs to be able to deal.  I suspect that "storing the
> bad data base64 encoded" may be a plausible "solution".
> 
> -jesse
> 

I agree. But this does keep the bad data out by converting it to a
proper UTF-8, base64 encoded. Hopefully, this can be done in a way to
prevent forcing all of the good Internet citizens and RT users from
taking the CPU/IO performance hit for the small group of bad apps
and worse.

Regards,
Ken