Usage

The core of Dataplan is the DataPlan object, which is used to construct an ExecPlan via a dataframe-like interface. Rather than calling the constructor for DataPlan directly, it is encouraged that convenience functions for initializing a DataPlan from some source (e.g., DataPlan.from_*) be used.

A DataPlan can generally be treated like a Table or DataFrame, to which a series of filters, projections, joins, aggregations, etc. be applied to obtain some result. Unlike with those in-memory formats, these operations merely register the next node to apply to the DataPlan; computation is deferred until the plan is run (e.g., DataPlan.to_*).

>>> import dataplan as dp
>>> dataplan = dp.DataPlan.from_dataset(...)
>>> res = dataplan.to_table()