Python Read Files

Opening a File for Reading

Always open files with the context manager syntax to ensure timely cleanup:

with open("poem.txt", "r", encoding="utf-8") as file:
    content = file.read()
    print(content)

If the file lives in another folder, build the path with pathlib.Path.

Read Entire File

file.read() returns the entire contents. For medium sized files this is convenient.

with open("story.txt", "r", encoding="utf-8") as file:
    text = file.read()
    print(len(text))

Passing a number reads that many bytes/characters. Subsequent reads continue from the current file pointer.

with open("story.txt", "r", encoding="utf-8") as file:
    header = file.read(100)
    body = file.read()  # Remainder

Read Line by Line

Process large files incrementally by iterating over the file object or using readline().

with open("access.log", "r", encoding="utf-8") as file:
    for line in file:
        if "ERROR" in line:
            alert(line.strip())

The iteration protocol automatically reads buffered chunks, keeping memory usage low.

Readlines and Slices

file.readlines() materializes every line in a list. Limit the result with the optional hint argument to bound memory usage.

with open("todos.txt", "r", encoding="utf-8") as file:
    first_block = file.readlines(2048)
    print(first_block[:3])

Binary File Reading

Use binary mode ('rb') for non-text data like images, compressed archives, or pickled objects. Omitting encoding is required.

with open("photo.jpg", "rb") as file:
    chunk = file.read(1024)
    while chunk:
        process(chunk)
        chunk = file.read(1024)

Binary mode returns bytes objects; convert to other formats as needed.

Managing the File Pointer

The file pointer tracks where the next read starts. Use file.tell() to inspect the position and file.seek() to move it.

with open("report.txt", "r", encoding="utf-8") as file:
    snippet = file.read(50)
    print(file.tell())  # 50
    file.seek(0)
    print(file.readline())

Seek offsets are byte oriented in binary mode and character oriented in text mode.

Graceful Error Handling

Wrap file operations to handle missing files, permission issues, or encoding problems.

from pathlib import Path

path = Path("logs/latest.log")

try:
    with path.open("r", encoding="utf-8") as file:
        print(file.readline())
except FileNotFoundError:
    print(f"Missing file: {path}")
except UnicodeDecodeError as exc:
    print(f"Encoding error: {exc}")

Reading Structured Data

Most real-world files follow a format. Combine file reading with specialized modules:

• json.load(file) for JSON documents.
• csv.reader(file) for comma-separated values.
• configparser.ConfigParser() for INI-style configs.
• pickle.load(file) (trusted input only).

import json

with open("settings.json", "r", encoding="utf-8") as file:
    settings = json.load(file)
    print(settings["theme"])

Performance Tips

• Read in buffered chunks for large binary files.
• Profile hot loops with the time module or cProfile.
• Disable universal newline translation by opening with newline='' when exact bytes matter.
• Cache frequently accessed data if the file rarely changes.

Next Steps

Ready to persist updates? Continue to the writing chapter to append, overwrite, and create files safely.

Read the Whole File vs Line by Line

# memory-friendly: never loads the whole file at once
with open("big.log", encoding="utf-8") as f:
    for line in f:
        print(line.rstrip())     # rstrip() drops the trailing newline

Key Takeaways

• read() loads everything; iterate the file for large data.
• readlines() gives a list; for line in f streams.
• Strip newlines with .rstrip() when printing.