Question

I have a Git repository I store random things in. Mostly random scripts, text files, websites I’ve designed and so on.

There are some large binary files I have deleted over time (generally 1-5MB), which are sitting around increasing the size of the repository, which I don’t need in the revision history.

Basically I want to be able to do..

me@host:~$ [magic command or script] aad29819a908cc1c05c3b1102862746ba29bafc0 : example/blah.psd : 3.8MB : 130 days old 6e73ca29c379b71b4ff8c6b6a5df9c7f0f1f5627 : another/big.file : 1.12MB : 214 days old 

..then be able to go though each result, checking if it’s no longer required then removing it (probably using filter-branch)

Answer 1

This is an adaptation of the git-find-blob script I posted previously:

#!/usr/bin/perl use 5.008; use strict; use Memoize;  sub usage { die 'usage: git-large-blob <size[b|k|m]> [<git-log arguments ...>]\n' }  @ARGV or usage(); my ( $max_size, $unit ) = ( shift =~ /^(\d+)([bkm]?)\z/ ) ? ( $1, $2 ) : usage();  my $exp = 10 * ( $unit eq 'b' ? 0 : $unit eq 'k' ? 1 : 2 ); my $cutoff = $max_size * 2**$exp;   sub walk_tree {     my ( $tree, @path ) = @_;     my @subtree;     my @r;      {         open my $ls_tree, '-|', git => 'ls-tree' => -l => $tree             or die 'Couldn't open pipe to git-ls-tree: $!\n';          while ( <$ls_tree> ) {             my ( $type, $sha1, $size, $name ) = /\A[0-7]{6} (\S+) (\S+) +(\S+)\t(.*)/;             if ( $type eq 'tree' ) {                 push @subtree, [ $sha1, $name ];             }             elsif ( $type eq 'blob' and $size >= $cutoff ) {                 push @r, [ $size, @path, $name ];             }         }     }      push @r, walk_tree( $_->[0], @path, $_->[1] )         for @subtree;      return @r; }  memoize 'walk_tree';  open my $log, '-|', git => log => @ARGV, '--pretty=format:%T %h %cr'     or die 'Couldn't open pipe to git-log: $!\n';  my %seen; while ( <$log> ) {     chomp;     my ( $tree, $commit, $age ) = split ' ', $_, 3;     my $is_header_printed;     for ( walk_tree( $tree ) ) {         my ( $size, @path ) = @$_;         my $path = join '/', @path;         next if $seen{ $path }++;         print '$commit $age\n' if not $is_header_printed++;         print '\t$size\t$path\n';     } }