You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Pydeps is an excellent tool for visualizing dependencies. I wonder if it could be adapted to show the dynamic dependencies of a particular pipeline. For example, imagine a simple pipeline built with numpy and matplotlib that goes from raw data to visualization.
Here's an example:
importnumpyasnpfromnumpy_processingimportprocess0, process1, process2# which all have their own dependenciesfrommatplotlib_visualizationimportprepare_vis, vis# also with their own dependenciesfname='some_file_name.npy'data=np.load(fname)
output0=process0(data)
output1=process1(output0)
output2=process2(output1)
vis_prms=prepare_vis(output2)
vis(output2, vis_prms)
We've defined a pipeline which uses these methods in the following order:
np.load
numpy_processing.process0
numpy_processing.process1
numpy_processing.process2
prepare_vis
vis
Wouldn't it be cool to see a pydeps graph where these methods are provided as input, are positioned on the left column of a graph moving downwards, and the dependencies are shown to the right pointing to each part of the pipeline?
If this is possible, please let me know. If there's interest and I could be of assistance in writing code to support it, let me know.
The text was updated successfully, but these errors were encountered:
Hi Andrew, thank you for your kind words. Your idea does sound interesting (and even useful), but perhaps not a perfect fit for pydeps..? I've known to occasionally be wrong, though, and I'm always happy to merge PRs (I'm also happy to help if you get stuck...)
Pydeps is an excellent tool for visualizing dependencies. I wonder if it could be adapted to show the dynamic dependencies of a particular pipeline. For example, imagine a simple pipeline built with numpy and matplotlib that goes from raw data to visualization.
Here's an example:
We've defined a pipeline which uses these methods in the following order:
np.load
numpy_processing.process0
numpy_processing.process1
numpy_processing.process2
prepare_vis
vis
Wouldn't it be cool to see a pydeps graph where these methods are provided as input, are positioned on the left column of a graph moving downwards, and the dependencies are shown to the right pointing to each part of the pipeline?
If this is possible, please let me know. If there's interest and I could be of assistance in writing code to support it, let me know.
The text was updated successfully, but these errors were encountered: