Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a table for digital bookplate batches #1254

Open
shelleydoljack opened this issue Oct 8, 2024 · 2 comments
Open

Create a table for digital bookplate batches #1254

shelleydoljack opened this issue Oct 8, 2024 · 2 comments

Comments

@shelleydoljack
Copy link
Contributor

shelleydoljack commented Oct 8, 2024

The table will be used to keep track of when users trigger the add 979 field DAG manually through the UI. Previously, this table would contain the following information: submitted date, created by, report email, batch type (add or delete), bookplate druid, filename, ckey count, completed date.
Screenshot 2024-10-08 at 11 24 36 AM

We also presented the user with batches in the queue (not yet processed). It showed the same information as the completed batches, driven by a query where completed_date is null. The bookplate batches table could have a separate "processed" or "completed" column if that would make presenting completed/in queue information easier.

@shelleydoljack
Copy link
Contributor Author

As an airflow admin user, I can see the status of the dag runs. As a user who has access to upload files to the UI, I do not have the ability to view the DAGs and the statuses of their runs. Creating a table to keep track of bookplate batches (and the views) is a "nice to have" and is not necessary for the work cycle. This could be prioritzed once more of the dags are completed.

@shelleydoljack
Copy link
Contributor Author

This table was used to figure out what needed to be processed when the script to add 979 fields ran on a schedule outside of business hours. Since the DAG to add 979 will run whenever it is triggered, then we don't need to keep track of queued/processed. I'm going to move this to the Icebox since it is not required for the work cylce.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant