perl -e"while(<>){print unless $uniq{$_}++}" <infile >outfile