Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

changes made to the csv file #50

Merged
merged 4 commits into from
Aug 7, 2024
Merged

Conversation

jsaltane123
Copy link
Contributor

Changes were made to the .csv and associated discovery file, as there were a few inconsistencies, typos and missing variables.
The finding were first raised with the team (Ben, Amelia and Daniel) and then further discussed during a call.
I am attaching a file with detailed description of findings per each ADaM datatable.

admiraldiscovery_issue.docx

Note that the suite was built locally to check the updated table.

…were a lot of inconsistencies between the templates and the table
inst/admiral-lookup-book.csv Outdated Show resolved Hide resolved
inst/admiral-lookup-book.csv Outdated Show resolved Hide resolved
ADFACE,ADSL,"FATESTCD=""MAXTEMP""",Deriving maximum temperature,admiral,derive_extreme_records,https://pharmaverse.github.io/admiral/reference/derive_extreme_records.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
ADFACE,ADSL,ANL01FL,Derive flags for the maximum record per subject per event per vaccination,admiralvaccine,derive_vars_max_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_max_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
ADFACE,ADSL,ANL02FL,Derive flags for the maximum record per subject per event for overall,admiralvaccine,derive_vars_max_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_max_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
ADFACE,ADSL,EVENTFL,Derive flags the record if at least one of the event occurred within the observation period,admiralvaccine,derive_vars_event_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_event_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
ADFACE,ADSL,EVENTFL,Derive flags the record if at least one of the event occurred within the observation period,admiralvaccine,derive_vars_event_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_event_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
ADFACE,ADSL,EVENTFL,Derive flags for the record if at least one of the event occurred within the observation period,admiralvaccine,derive_vars_event_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_event_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R

ADFACE,ADSL,ANL01FL,Derive flags for the maximum record per subject per event per vaccination,admiralvaccine,derive_vars_max_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_max_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
ADFACE,ADSL,ANL02FL,Derive flags for the maximum record per subject per event for overall,admiralvaccine,derive_vars_max_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_max_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
ADFACE,ADSL,EVENTFL,Derive flags the record if at least one of the event occurred within the observation period,admiralvaccine,derive_vars_event_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_event_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
ADFACE,ADSL,EVENTDFL,Derive flags the record if the event is occurred,admiralvaccine,derive_vars_event_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_event_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
ADFACE,ADSL,EVENTDFL,Derive flags the record if the event is occurred,admiralvaccine,derive_vars_event_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_event_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R
ADFACE,ADSL,EVENTDFL,Derive flags for the record if the event is occurred,admiralvaccine,derive_vars_event_flag,https://pharmaverse.github.io/admiralvaccine/reference/derive_vars_event_flag.html,Template Example,https://github.com/pharmaverse/admiralvaccine/blob/main/inst/templates/ad_adface.R

ADOE,ADSL,ABLFL,Derive analysis baseline flag,admiral,restrict_derivation,https://pharmaverse.github.io/admiral/reference/restrict_derivation.html,Template Example,https://github.com/pharmaverse/admiralophtha/blob/main/inst/templates/ad_adoe.R
ADOE,ADSL,ADT,Derive analysis date,admiral,derive_vars_dt,https://pharmaverse.github.io/admiral/reference/derive_vars_dt.html,Template Example,https://github.com/pharmaverse/admiralophtha/blob/main/inst/templates/ad_adoe.R
ADOE,ADSL,ADY,Derive analysis relative day,admiral,derive_vars_dy,https://pharmaverse.github.io/admiral/reference/derive_vars_dy.html,Template Example,https://github.com/pharmaverse/admiralophtha/blob/main/inst/templates/ad_adoe.R
ADOE,ADSL,ANL01FL,Derive flag last result within a visit and timepoint for baseline and post-baseline records,admiral,restrict_derivation,https://pharmaverse.github.io/admiral/reference/restrict_derivation.html,Template Example,https://github.com/pharmaverse/admiralophtha/blob/main/inst/templates/ad_adoe.R
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
ADOE,ADSL,ANL01FL,Derive flag last result within a visit and timepoint for baseline and post-baseline records,admiral,restrict_derivation,https://pharmaverse.github.io/admiral/reference/restrict_derivation.html,Template Example,https://github.com/pharmaverse/admiralophtha/blob/main/inst/templates/ad_adoe.R
ADOE,ADSL,ANL01FL,Derive flag for last result within a visit and timepoint for baseline and post-baseline records,admiral,restrict_derivation,https://pharmaverse.github.io/admiral/reference/restrict_derivation.html,Template Example,https://github.com/pharmaverse/admiralophtha/blob/main/inst/templates/ad_adoe.R

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unsure on this one - others might need to be looked at as well

Copy link
Contributor Author

@jsaltane123 jsaltane123 Jul 22, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bms63 @ddsjoberg @athenamelia Could you please advise me on this one? Is the description correct or shall it be adjusted (further from the suggested version)? This will apply to a few more ANLxxFL variables.

ADPC,OCCDS,BASE,Derive BASE,admiral,derive_var_base,https://pharmaverse.github.io/admiral/reference/derive_var_base.html,Template Example,https://github.com/pharmaverse/admiral/blob/main/inst/templates/ad_adpc.R
ADPC,OCCDS,CHG,Derive change from baseline,admiral,derive_var_chg,https://pharmaverse.github.io/admiral/reference/derive_var_chg.html,Template Example,https://github.com/pharmaverse/admiral/blob/main/inst/templates/ad_adpc.R
ADPC,OCCDS,ASEQ,Derive sequential number for observations within each by group,admiral,derive_var_obs_number,https://pharmaverse.github.io/admiral/reference/derive_var_obs_number.html,Template Example,https://github.com/pharmaverse/admiral/blob/main/inst/templates/ad_adpc.R
ADPC,OCCDS,EXDOSE_next,Derive next dose taken,admiral,derive_vars_joined,https://pharmaverse.github.io/admiral/reference/derive_vars_joined.html,Template Example,https://github.com/pharmaverse/admiral/blob/main/inst/templates/ad_adpc.R
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ummm... i don't think these are CDISC variables??

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is a variable which was just moved to another row, this was not added. But it does look like SDTM EX variable

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If this is not an ADaM variable, should we not just remove? Thanks!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, will remove it

Copy link
Contributor

@bms63 bms63 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wow! This is very thorough! Thank you for doing this update. @ddsjoberg is there a standard convention you all have somewhere or something we should make? Like a simple wiki page referenced at top of file?

@jsaltane123
Copy link
Contributor Author

Changes made on 15-Jul-2024
'additional changes following review' commit

Addressing comments (thanks a lot for the review, @bms63)

  • ADEG dataset – PARAM was renamed to PARAMCD (as description states ‘ Derive a list of parameter codes’
  • As imputation flags were added as separate variables, the description of corresponding date/time/datetime variables should not mention imputation flags. The following variables were adjusted:
    o ADAE – ASTDTM
    o ADEX – ASTDTM and AENDTM
    o ADPC – ASTDTM
    o ADSL – DTHDT

Additional items:

  • ADPPK – ASTDT and AENDT – description was slightly changed: from ‘…from date/time’ to ‘…from datetimes’.
  • Description for PARAM variable was changed to be consistent across the datasets – ‘Derive a list of parameters’ (similar to ADOE and ADIS)
  • Description for ‘PARAMCD’ was changed to be consistent across the datasets – ‘Derive a list of parameter codes’ (similar to ADVS)

@bms63 bms63 requested a review from athenamelia July 15, 2024 21:15
@bms63
Copy link
Contributor

bms63 commented Jul 15, 2024

@athenamelia do you mind reviewing. I believe @ddsjoberg is away this week

Copy link
Collaborator

@athenamelia athenamelia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @jsaltane123 for the updates! This is very thorough. I looked at the spreadsheet and the additional updates to address the comments above -- it looks great!

Minor thing:

  • ADMH with variable label "Derive query variables": variable name is NA. Should we add one of SMQzzNAM, SMQzzCD, SMQzzSC, SMQzzSCN, and CQzzNAM as an example for query variable?

@athenamelia
Copy link
Collaborator

Inconsistency for ASTDT and AENDT description labels across ADaM. "Derive analysis start/end date" vs "Derive... from datetimes".

…bles for ADMH added, description of TRT01P in ADVFQ corrected.
@jsaltane123
Copy link
Contributor Author

Changes made on 16-Jul-2024
commit

Addressing comments (thanks a lot for the review, @athenamelia )

ADMH dataset:

  • empty variable with description ' Derive query variables' was removed;
  • rows for SMQ02NAM, SMQ02CD, SMQ02SC, SMQ02SCN, CQ04NAM, CQ04CD were added;

All datasets:

  • ASTDT description standardized to 'Derive analysis start date'
  • AENDT description standardized to 'Derive analysis end date'
  • ADT description standardized to 'Derive analysis date'
  • ADTM description standardized to 'Derive analysis datetime'
  • ATM - 'Derive analysis time'
  • ATMF - 'Derive analysis time imputation flag'
  • TRT01P - 'Derive planned treatment for period 1' (there was a mistake in ADVFQ)

@athenamelia
Copy link
Collaborator

This is great work, Julija @jsaltane123 ! Thanks for your contribution. @ddsjoberg @bms63 I don't have further comments from my end.

@bms63
Copy link
Contributor

bms63 commented Jul 17, 2024

@jsaltane123 can I add you to the admiral community team. I ping folks for help on issues in different admiral projects

Copy link
Contributor

@bms63 bms63 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks great to me. Let's wait for @ddsjoberg to come back to give final seal of approval.

Also @jsaltane123 - we just had an admiral retrospectives meeting today and a new working group will be starting in later August that will look at ADAM IG Guide and what is missing in admiral. I was thinking of the TREATCOM - Treatment Compliance variable discussion that we had last week when proposing the working group. Want to get involved!?!

@jsaltane123
Copy link
Contributor Author

@bms63 , thanks a lot for considering me for the Admiral community team. I would be happy to join and contribute to the various projects! There are other Ascent colleagues who are also keen to contribute and will introduce them at a later stage.
The new working group focused on the ADAM IG Guide sounds particularly interesting, and I'm excited about the opportunity to help address any gaps in Admiral! :)

@ddsjoberg
Copy link
Collaborator

HI All, I am back! Thanks for the amazing work on this PR!

I think everything looks in order. But just to be sure, can we resolve the outstanding comments? When we resolve, can we make a note whether that suggested change was made, not made (and why)?

@ddsjoberg
Copy link
Collaborator

@jsaltane123 thank you again for your wonderful contribution! 🕺🏼

We just need one last step. Can you run devtools::document() and push the update? I tried to do it myself, but I am blocked from modifying your branch.

@ddsjoberg
Copy link
Collaborator

On second thought @jsaltane123 , I can go ahead and merge this now, then push the redocs separately. You've already done so much for this PR and it's VERY MUCH appreciated!

@ddsjoberg ddsjoberg merged commit d6a6d55 into pharmaverse:main Aug 7, 2024
16 of 17 checks passed
@jsaltane123
Copy link
Contributor Author

@bms63 , @athenamelia and @ddsjoberg thank you so much for the opportunity to contribute and for your guidance :) I look forward to making further contributions!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants