perf(datasets): delay Engine creation until need

[deepyaman]

Description

Context

See kedro-org/kedro#2829

Possible Implementation

#281

Possible Alternatives

[astrojuanlu]

For context, this is a proposed solution for the problem stated in kedro-org/kedro#2829, but I'm not sure there was consensus there, or enough exploration of the solution space cc @merelcht

[deepyaman]

For context, this is a proposed solution for the problem stated in kedro-org/kedro#2829, but I'm not sure there was consensus there, or enough exploration of the solution space cc @merelcht

We had a discussion regarding this, that this is not a solution for kedro-org/kedro#2829 as the OP has stated it (where you don't want to have to provide any connection string at all; hence, I unassigned myself from that broader issue), but that it's an improvement nonetheless (i.e. there's no reason to create the connection well before you're actually going to use it, if at all).