File Commands

Find files x days old and delete them

#!/bin/bash
find /path/to/files/ -type f -name '*.jpg' -mtime +10 -exec mv {} /path/to/archive/ \;
find /path/to/archive/ -type f -name '*.jpg' -mtime +30 -exec rm {} \;

Find files over a certain size

$ find . -type f -size -4G

You can use size switch for other formats, such as

• `c’ for bytes
• ‘w’ for two-byte words
• `k’ for Kilobytes
• `M’ for Megabytes
• `G’ for Gigabytes

Find Directory sizes

du -h --max-depth=2 | sort -hr

Search multiple files for a keyword, then list the file names

find . -type f -name "*.php" -print0 | xargs -I {} -0 grep -r -l "edcas" "{}"

Find files in multiple directories

use awk to clean up dir names then send to text files pass / as a delimiter to awk

find . -type f -name *.jpg | awk -F / {'print $3'} > file.txt

Find files and rsync them to a dir

find . -type f -name '*.jpg' -exec rsync -zavhP {} /dirtocopyto/ \;

Find Multiple filenames

find . -type f \( -name "*.nef" -o -name "*.jpg" -o -name "*.tif" \)

Find Files with Specific extension and specific name

find . -type f -name '*top*' -and -name '*.jpg'
# will find files with *top* and with the extension .jpg 
#use -iname for case insensitive

RSYNC copy directories with spaces

find . -type f -name '*177*' -exec rsync -zavP {} "/var/tmp/my dir" \;

Count Files in Directory

cd /var/www/

count=`ls-l *.sh | wc -l 2> /dev/null`
if [ $count -ge 1 ]; then
mv *.sql /var/www/backups/dirname
fi

Find and delete files with certain names

find -type f -name '*one*' -exec rm {} \;

Find specific files and copy them to another folder

find -type f -name "*app1*" -exec cp {} /var/www/test/ \;

Rename files adding the creation date as prefix

Get the date from the file

date -r $(stat -f %B filename.jpg) +%Y-%m-%d

Read exif data from file

mdls filename.jpg

find creation date of file in exif data

mdls filename | grep -i kMDItemContentCreationDate -m 1 | awk '{print $3}'

1. the m1 will return the 1 result

exiftool filename.jgp

Using rename command

If its not installed in MacOS, use brew to install it

rename 's/dem/rob/g' * jpg

Will change dem and replace it with rob /g is global which will replace all occurrence of dem in the file name

rename 's/\+/_/g' *.tif

use the \ escape character with the + sign

Replace multiple characters

rename 's/[_,-,a,b,c,]//g'

rename '/.jpg/.tif/' *.jpg

Change jpg extension to tif

Deleting part of a filename

rename 's/dem//' *.jpg

Searching with Groupings

rename 's/(dem|rob)ng/bac/' *.jpg

The central expression of this rename command will search for strings within filenames that have the character sequence “dem” or “rob” where those sequences are immediately followed by “ng”. In other words, our search term is going to look for “string” and “demng”. The substitution term is “bacng”.

Example: demng.jpg,  robmg.jpg

Changing case of filename

rename 'y/a-z/A-Z/' *.jpg

Use the -n option to print names without renaming them

rename -n 's/.html/.php/' *.html

Rename files adding sequential numbers Mac Only

rename -N 03000 's/searchterm/$N-out.jpg/gi' *.jpg

You have to add the 0 at the beginning otherwise it wont work

Rename All files with sequential numbers Mac Only

rename -N 0001 's/.*/$N-bldg.jpg/' *.jpg

Rename all Files with sequential numbers Linux

ls -t *.txt | cat -n | while read n f; do mv "$f" "$(printf bldg-%03d.txt $n)"; done
# %03d is the amount of digits

Rename all Files with sequential numbers Linux bash file

count=0;
for file in *.txt; do
 #check if the file is a regular file and not a directory
 if [ -f "$file" ]; then
   ((count++))
   #generate the new filename
   newname="$(printf bldg-%03d.txt $count)";
   mv "$file" "$newname"
 fi
done

Rename Delete string Mac Only

rename -d '0' *.jpg

Result

030020-abc.jpg
30020-abc.jpg

Find and Rename

find . -type f -name '*2019*' -print0 | rename -0 's/2019/2020/gi'

Rename Prepend Mac Only

rename -A 'xxxx-' *.jpg

SCP Command

Copy file from a remote host to local host SCP example:

$ scp username@from_host:file.txt /local/directory/

Copy file from local host to a remote host SCP example:

$ scp file.txt username@to_host:/remote/directory/

Copy directory from a remote host to local host SCP example:

$ scp -r username@from_host:/remote/directory/  /local/directory/

Copy directory from local host to a remote hos SCP example:

$ scp -r /local/directory/ username@to_host:/remote/directory/

Copy file from remote host to remote host SCP example:

$ scp username@from_host:/remote/directory/file.txt username@to_host:/remote/directory/

SCP using key

scp -i ~/.ssh/id_rsa.pub FILENAME USER@SERVER:/home/USER/FILENAME

SCP options:

• –r Recursively copy entire directories. Note that this follows symbolic links encountered in the tree traversal.

• -C Compression enable. Passes the -C flag to ssh to enable compression.
• -i file Specify the file from which to read the identity for public key authentication.

• -l limit – Limits the used bandwidth, specified in Kbit/s.

• -o ssh_option – Can be used to pass options to ssh in the format used in ssh_config.

• -P port – Specifies the port to connect to on the remote host. Note that this option is written with a capital ‘P.’

• -p Preserves modification times, access times, and modes from the original file.

• -q Quiet mode: disables the progress meter as well as warning and diagnostic messages from ssh.

• -v Verbose mode. Print debugging messages about progress. This is helpful in debugging connection, authentication, and configuration problems.

scp with key