Bash Scripting Fundamentals

1. Introduction to Bash

1.1 What is Bash?

Bash (Bourne Again Shell) is a command processor that typically runs in a text window where the user types commands that cause actions.

Bash can also read and execute commands from a file, called a script.

1.2 Creating and Running a Script

• Creating a script: Use a text editor to create a file with the .sh extension.

  nano script.sh

• Making the script executable:

  chmod +x script.sh

• Running the script:

  ./script.sh

2. Basic Commands

2.1 Echo

• Description: Prints text to the terminal.

  echo "Hello, World!"

2.2 Variables

• Description: Storing and using data.

  NAME="John"
  echo $NAME

2.3 Comments

• Description: Adding comments to a script for readability.

  # This is a comment
  echo "This is a script"

3. Input and Output

3.1 Reading User Input

• Description: Taking input from the user.

  read "Enter your name: " NAME
  echo "Hello, $NAME"

3.2 Redirecting Output

• Description: Redirecting command output to a file.

  echo "This is a test" > file.txt

3.3 Appending Output

• Description: Appending command output to a file.

  echo "This is a test" >> file.txt

3.4 Redirecting Input

• Description: Using a file as input to a command.

  wc -l < file.txt

3.5 Piping

• Description: Using the output of one command as input to another.

  cat file.txt | grep "test"

4. Control Structures

4.1 Conditional Statements

• Description: Making decisions in scripts.

  if [ "$NAME" == "John" ]; then
    echo "Hello, John!"
  else
    echo "You are not John."
  fi

4.2 Loops

• Description: Repeating a set of commands.

4.2.1 For Loop

  for i in {1..5}; do
    echo "Welcome $i"
  done

4.2.2 While Loop

  COUNTER=0
  while [ $COUNTER -lt 5 ]; do
    echo "Counter: $COUNTER"
    COUNTER=$((COUNTER + 1))
  done

4.2.3 Until Loop

  COUNTER=0
  until [ $COUNTER -ge 5 ]; do
    echo "Counter: $COUNTER"
    COUNTER=$((COUNTER + 1))
  done

5. Functions

5.1 Defining and Calling Functions

• Description: Grouping commands into a reusable block.

  my_function() {
    echo "Hello from my_function"
  }
  my_function

6. Data Structures

6.1 Arrays

• Description: Using arrays to store multiple values.

  NAMES=("John" "Jane" "Doe")
  echo "First Name: ${NAMES[0]}"

6.2 Tuples (Simulated with Arrays)

• Description: Using arrays to simulate tuples.

  TUPLE=("Alice" 25 "Developer")
  echo "Name: ${TUPLE[0]}, Age: ${TUPLE[1]}, Job: ${TUPLE[2]}"

6.3 Sets (Simulated with Arrays and Associative Arrays)

• Description: Using arrays and associative arrays to simulate sets.

  declare -A SET
  SET["Apple"]=1
  SET["Banana"]=1
  if [[ ${SET["Apple"]} ]]; then
    echo "Apple is in the set."
  fi

7. Operators

7.1 Mathematical Operators

• Description: Performing arithmetic operations.

  A=5
  B=3
  SUM=$((A + B))
  echo "Sum: $SUM"

7.2 Logical Operators

• Description: Using logical operators in conditions.

  if [ $A -eq 5 ] && [ $B -eq 3 ]; then
    echo "Both conditions are true."
  fi

7.3 Semantic Operators

• Description: Using comparison operators.

  if [ "$A" -eq 5 ]; then
    echo "A is 5"
  fi
  if [ "$A" -ne 5 ]; then
    echo "A is not 5"
  fi

8. Type Casting

• Description: Type casting in Bash is generally about ensuring variable content is treated correctly.

  VAR="123"
  NUM=$((VAR + 0))  # Cast string to number for arithmetic
  echo $NUM

9. API Calls

• Description: Making HTTP requests using tools like curl.

  RESPONSE=$(curl -s -X GET "https://api.example.com/data")
  echo "Response: $RESPONSE"

10. Automating Tasks

10.1 Cron Jobs

• Description: Scheduling scripts to run automatically.

  # Edit the crontab file
  crontab -e
  # Add a job to run every day at midnight
  0 0 * * * /path/to/script.sh

10.2 Using at

• Description: Scheduling a one-time task.

  echo "/path/to/script.sh" | at now + 5 minutes

10.3 Background Jobs

• Description: Running scripts in the background.

  ./script.sh &

11. Advanced Topics

11.1 Using sed and awk

• Description: Text processing with sed and awk.

11.1.1 sed

  sed 's/old/new/g' file.txt

11.1.2 awk

  awk '{print $1}' file.txt

11.2 Traps

• Description: Capturing signals.

  trap "echo 'Script interrupted'; exit" SIGINT
  while true; do
    echo "Running..."
    sleep 1
  done

12. Debugging

12.1 Enabling Debugging

• Description: Running a script in debug mode.

  bash -x script.sh

12.2 Using set

• Description: Setting options for debugging.

  set -x  # Enable debugging
  set +x  # Disable debugging

12.3 Error Handling

• Description: Handling errors in scripts.

  command || { echo "Command failed"; exit 1; }

12.4 Using trap for Cleanup

• Description: Cleaning up resources on script exit.

  cleanup() {
    echo "Cleaning up..."
    # perform cleanup here
  }
  trap cleanup EXIT

12.5 Logging

• Description: Creating log files for your scripts.

  LOG_FILE="/var/log/script.log"
  echo "Script started" >> $LOG_FILE

13. More on Arrays

13.1 Array Operations

• Description: Array length and iteration.

  ARR=("one" "two" "three")
  echo "Array length: ${#ARR[@]}"
  for ITEM in "${ARR[@]}"; do
    echo $ITEM
  done

13.2 Associative Arrays

• Description: Using associative arrays.

  declare -A ASSOC_ARRAY
  ASSOC_ARRAY["name"]="John"
  ASSOC_ARRAY["age"]="30"
  echo "Name: ${ASSOC_ARRAY["name"]}"
  echo "Age: ${ASSOC_ARRAY["age"]}"

13.3 Multidimensional Arrays

• Description: Simulating multidimensional arrays.

  ARRAY_2D[0]="1 2 3"
  ARRAY_2D[1]="4 5 6"
  ARRAY_2D[2]="

7 8 9"
  for ROW in "${ARRAY_2D[@]}"; do
    for ITEM in $ROW; do
      echo -n "$ITEM "
    done
    echo
  done

14. String Operations

14.1 Substring Extraction

• Description: Extracting a substring from a string.

  STRING="Hello World"
  echo ${STRING:6:5}  # Outputs "World"

14.2 String Length

• Description: Getting the length of a string.

  echo ${#STRING}  # Outputs "11"

14.3 String Replacement

• Description: Replacing part of a string.

  echo ${STRING/World/Bash}  # Outputs "Hello Bash"

15. File Operations

15.1 File Tests

• Description: Testing properties of files.

  if [ -f "file.txt" ]; then
    echo "file.txt is a regular file."
  fi
  if [ -d "directory" ]; then
    echo "directory is a directory."
  fi

15.2 Reading Files

• Description: Reading a file line by line.

  while IFS= read -r line; do
    echo "$line"
  done < file.txt

15.3 Writing to Files

• Description: Writing to a file.

  echo "Hello, World!" > file.txt

15.4 Appending to Files

• Description: Appending to a file.

  echo "This is a new line" >> file.txt

16. Network Operations

16.1 Downloading Files

• Description: Using wget or curl to download files.

  wget http://example.com/file.zip
  curl -O http://example.com/file.zip

16.2 Uploading Files

• Description: Using curl to upload files.

  curl -F "file=@/path/to/file" http://example.com/upload

16.3 Checking Internet Connection

• Description: Pinging a server to check for internet connectivity.

  ping -c 4 google.com

17. Handling Large Data

17.1 Sorting and Uniqueness

• Description: Sorting data and removing duplicates.

  sort file.txt | uniq > sorted.txt

17.2 Finding Patterns

• Description: Using grep to find patterns.

  grep "pattern" file.txt

17.3 Splitting Files

• Description: Splitting large files into smaller parts.

  split -l 1000 largefile.txt smallfile_

18. Process Management

18.1 Checking Running Processes

• Description: Using ps to list running processes.

  ps aux

18.2 Killing Processes

• Description: Using kill to terminate processes.

  kill -9 PID

18.3 Monitoring System Resources

• Description: Using top or htop to monitor system resources.

  top
  htop  # Requires installation

19. Packaging and Distribution

19.1 Creating Tar Archives

• Description: Archiving files using tar.

  tar -cvf archive.tar file1 file2 directory/

19.2 Extracting Tar Archives

• Description: Extracting files from a tar archive.

  tar -xvf archive.tar

19.3 Compressing Files

• Description: Compressing files using gzip.

  gzip file.txt

19.4 Decompressing Files

• Description: Decompressing files using gunzip.

  gunzip file.txt.gz

This extensive guide covers fundamental and advanced topics in Bash scripting