Python File Handling

Why File Handling Matters

Python applications often need to read configuration files, write logs, persist user input, or exchange data across processes. The built-in open() function and file object methods unlock these capabilities with a consistent API across operating systems.

• Interact with text and binary files on disk.
• Stream large datasets without loading everything into memory.
• Integrate with serialization formats like JSON, CSV, and custom protocols.

File Paths and Working Directories

File paths can be absolute or relative to the current working directory. Use the pathlib module for cross-platform path manipulation.

from pathlib import Path

cwd = Path.cwd()
config_path = cwd / "config" / "settings.ini"

print(config_path)
print(config_path.exists())

Normalize paths with Path.resolve() to remove . and .. segments, and prefer forward slashes when displaying paths to users.

Opening Files

Use open(file, mode, encoding) to access files. The most common modes are:

• 'r': Read (default); fails if the file does not exist.
• 'w': Write; creates the file or truncates existing content.
• 'a': Append; creates the file if needed.
• 'b': Binary mode modifier (for example 'rb').
• 'x': Exclusive creation; fails if the file exists.
• '+': Update (read and write) modifier.

with open("notes.txt", "r", encoding="utf-8") as file:
    content = file.read()
    print(content)

The with statement (context manager) ensures that the file closes automatically, even when exceptions occur.

Reading Strategies

Choose the reading method that matches your needs and file size.

• file.read(): Returns the entire contents as a string (or bytes in binary mode).
• file.readline(): Returns one line at a time, including the newline character.
• file.readlines(): Returns a list of lines; avoid on very large files.
• Iterate directly over the file object to stream line by line.

with open("data.csv", "r", encoding="utf-8") as file:
    for line in file:
        process(line.strip())

Writing Strategies

Writing replaces or appends content depending on the mode. Remember to include newline characters when writing multi-line text.

numbers = [1, 2, 3, 4]

with open("numbers.txt", "w", encoding="utf-8") as file:
    for number in numbers:
        file.write(f"{number}\n")

For complex data, serialize with json.dump(), csv.writer, or third-party libraries.

File Object Attributes

File objects expose helpful properties:

• file.name: Original file path.
• file.mode: Mode string used to open the file.
• file.closed: Boolean indicating whether the file is closed.
• file.encoding: Encoding for text mode files.

with open("report.log", "a", encoding="utf-8") as file:
    file.write("INFO: Task completed\n")
    print(file.name, file.mode, file.closed)

print(file.closed)  # True

Error Handling

Wrap file operations in try/except blocks to catch FileNotFoundError, PermissionError, or IsADirectoryError. Always log meaningful messages to diagnose issues.

from pathlib import Path

path = Path("/secure/data.txt")

try:
    with path.open("r", encoding="utf-8") as file:
        print(file.read())
except FileNotFoundError:
    print("File does not exist.")
except PermissionError:
    print("Insufficient permissions to read the file.")

Best Practices

• Always specify an encoding (UTF-8) for text files.
• Use pathlib.Path for portable path manipulation.
• Close files promptly with context managers or file.close().
• Validate user-provided paths to prevent directory traversal vulnerabilities.
• Avoid loading huge files entirely into memory; stream instead.

Next Steps

Continue to the reading and writing chapters to explore specific techniques, then learn how to safely delete files.

Always Use with (Context Manager)

Opening a file with with guarantees it is closed automatically, even if an error occurs — the safe, standard pattern.

with open("notes.txt", "r", encoding="utf-8") as f:
    content = f.read()
# file is closed here, automatically
print(content)

File Modes

Key Takeaways

• Open files with with open(...) so they always close.
• Choose the right mode: r, w (truncates), a, x.
• Always set encoding="utf-8".