How do I run ColumnProfiler on a subset of columns?

[sudsali]

I have a DataFrame with 50 columns but I only want to profile 3 of them. Is there a way to restrict the profiler to specific columns?

[github-actions]

Yes — use the restrictToColumns() method on the ColumnProfilerRunBuilder. After calling .onData(df), chain .restrictToColumns([...]) with a list of column names:

from pydeequ.profiles import ColumnProfilerRunner

result = ColumnProfilerRunner(spark) \
    .onData(df) \
    .restrictToColumns(["col_a", "col_b", "col_c"]) \
    .run()

for col, profile in result.profiles.items():
    print(profile)

This will limit profiling to only the three specified columns, which should also speed up the run significantly on wide DataFrames.

---

Generated by AI (model: us.anthropic.claude-opus-4-6-v1, prompt: a94a58bc) — may not be fully accurate. Reply if this doesn't help.