I have an S3 bucket setup as a streaming distribution with a CloudFront service attached to it. There are fairly sizable .flv files in there which I use to hook up JWPlayer using signed URL’s.
After about a month of hosting these videos in S3 (and they have been watched by web site visitors several times), I just logged on using CloudBerry and noticed that my videos S3 bucket has a lot (like 10,000) of smaller files (2K or less in size) which I didn’t create.
Are these some form of temporary files? Can I delete them out without harming anything? Is there some way to automatically clean these up? A few 2K files in there is no big deal, but once we start getting tons of these little files, the costs can start to add up. Not to mention as we keep adding videos, those will multiple like nuts.
After examining the contents of some of these “smaller” files, they looked like logs. Turns out, logging was enabled on the S3 bucket. I’m deleting them now and disabling logging on the bucket.