WatchrIs a file watching service for importing records into a Postgres database.
Watchr is organized through the usage of Pydantic models to govern the behavior of how a file get processed, the actions around its artifact cleanup, and other configuration.
This project is still rough and narrowly focused for my own personal use cases at the moment but in the future i may put forth more intention in making this more general and accessible to others.
<++>
<++>
<++>
<++>
<++>
See Usage
See CONTRIBUTING
<++>
Pull image from ghcr.io
docker pull ghcr.io/bryan-jenks-home-lab/etl_strong_app:mainRun image
docker run -d \
-e DB_CONNECTION_STRING='postgresql+psycopg2://<USER>:<PASSWORD>@<SERVER>:<PORT>/<DATABASE>' \
-e EXPECTED_FILE=strong.csv \
-e TARGET_TABLE=<DATABASE>.<SCHEMA>.<TABLE_NAME> \
-e WATCH_PATH=/data/inbound \
-e STAGING_PATH=/data/outbound \
-e PROCESSED_PATH=/data/processed \
-v /<PATH_ON_YOUR_MACHINE>/strong_app_import/inbound:/data/inbound \
-v /<PATH_ON_YOUR_MACHINE>/strong_app_import/outbound:/data/outbound \
-v /<PATH_ON_YOUR_MACHINE>/strong_app_import/processed:/data/processed \
ghcr.io/bryan-jenks-home-lab/etl_strong_app:main<++>
<++>
python -m pip install poetry python-dotenv pre-commitpre-commit installpre-commit autoupdate
See Road Map
See SECURITY
See ROADMAP
See RELEASES
<++>
See CODE OF CONDUCT
See AUTHORS
See LICENSE
