Skip to content

Latest commit

 

History

History
4729 lines (2362 loc) · 169 KB

CHANGELOG.md

File metadata and controls

4729 lines (2362 loc) · 169 KB

CHANGELOG

v0.39.1 (2024-07-25)

Fix

  • fix(installer): fix installer upload (#866)

  • Update release-and-publish.yml: upload installers

  • Update release-and-publish.yml: fix case (489b9c2)

  • fix(VisualReplayStrategy): avoid re-using failing segmentations (0045ebb)

  • fix(installer, audio): postinstall whisper; download installer artefacts (#865)

  • postinstall whisper; download installer artefacts

  • poetry lock (a4470c3)

v0.39.0 (2024-07-25)

Feature

  • feat(installer): upload installers (#863) (47fa551)

v0.38.0 (2024-07-25)

Feature

  • feat: add_centroid in WindowEvent.to_prompt_dict (#840)

  • add centroid in window_dict output

  • black


Co-authored-by: Richard Abrich <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (5118b39)

  • feat(action verification): implement replay action verification (#857)

  • add is_action_event_complete

  • retry_with_exceptions in apply_replay_instructions

  • fix parse_code_snippet

  • add error_reporting.py

  • refactor video.py

  • black/flake8

  • add module docstring

  • CHECK_ACTION_COMPLETE (b288c07)

Unknown

  • fix keyerror if no state in window_dict (001c8fa)

v0.37.0 (2024-07-19)

Feature

  • feat(logging): store application logs (#854)

  • feat: Wrap all processes inside a try catch block

  • chore: Modify files to use the custom logger

  • lint: flake8 lint


Co-authored-by: Richard Abrich <[email protected]> (13bbe48)

v0.36.6 (2024-07-19)

Fix

  • fix(build): escape installer newline, upload installers and executables (#860)

  • escape newline in inno script

  • upload installers and executables (6d878fe)

Unknown

  • feat(build) modify build.py to produce installers (#858)

  • modify build.py to produce installers

  • download_and_install_inno_setup

  • black/flake8

  • remove zipping in build (21e5de1)

v0.36.5 (2024-07-16)

Fix

  • fix(error-reporting): add ignore_errors (#855)

  • add ignore_errors

  • black (dc26a2a)

v0.36.4 (2024-07-12)

Fix

  • fix(VanillaReplayStrategy): replay_instructions -> instructions (#849) (640f926)

v0.36.3 (2024-07-11)

Fix

  • fix(replay): fix video not found (#845)

  • fix:modify Recording class to delete all associated records when recording is deleted (ab1f125)

v0.36.2 (2024-07-06)

Fix

  • fix(release): add ngrok; run release on debug-release branch; fallback to python (#838) (8777574)

Unknown

  • revert until 615fc6ffe560ff0788414c80643308b484012750 (748bdb3)

v0.36.1 (2024-07-06)

Fix

  • fix(release): hard code python path fallback (#837) (1b48f94)

  • fix(release): set PYTHON_PATH in semantic_release; hard-code fallback (#836)

  • Update release-and-publish.yml: set PYTHON_PATH in semantic_release

  • Update pyproject.toml: hard code python path fallback (e6c88d1)

  • fix(release): modify build_command in pyproject.toml (#835)

  • Update release-and-publish.yml: remove build_command

  • Update pyproject.toml: add PYTHON_PATH to build_command

  • Update pyproject.toml: increase verbosity (0f5166e)

  • fix(release): override build_command and include PYTHON_PATH (#834) (88fca89)

  • fix(release): set python path more robustly (#833) (6b382dd)

  • fix(release): add PYTHON_PATH to GITHUB_PATH (#832) (217204b)

  • fix(release): update python-semantic-release to v9.8.4 (#831) (8054d69)

  • fix(release): remove ADMIN_TOKEN from actions/checkout (#830) (094a054)

  • fix(release): replace GITHUB_TOKEN with ADMIN_TOKEN (#829) (c193fe6)

  • fix(release): add token to actions/checkout (#828) (8e1a17d)

  • fix(db): eager loading (#822)

  • add joinedload to eagerly load related entities

  • change get_active_window_data to return empty dict when state is none

  • add eager as parameter in _get

  • add a default parameter for relationships

  • flake8 error fix

  • use direct and indirect relationships

  • chore: refactor code (615fc6f)

  • fix(audio): Fix error when downloading whisper model (#826) (2ad143a)

v0.36.0 (2024-06-28)

Feature

  • feat(logging): redirect stdout (#810)

  • feat: Override std out for application

  • feat: Separate logs by version number and date and use logger instead of print


Co-authored-by: Richard Abrich <[email protected]> (f44795c)

Fix

  • fix(tray): fix tray signals (#812)

  • feat: Override std out for application

  • fix: Fix passing signals around using multiprocessing pipes

  • feat: Separate logs by version number and date and use logger instead of print

  • lint: flake8 lint


Co-authored-by: Richard Abrich <[email protected]> (f231a34)

v0.35.2 (2024-06-27)

Fix

  • fix(build): Fix build issues (#809)

  • fix: Fix build issues

  • fix: Add pyqttoast and whisper explicitly to build

  • black/flake8


Co-authored-by: Richard Abrich <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (48995bb)

Unknown

v0.35.1 (2024-06-23)

Fix

  • fix(ultralytics): fix windows file permission in do_fastsam (#791)

  • fix:windows file permission

  • Changes as per the comments on last commit

  • add max_retries and retry_delay_seconds in args

  • add comments for segmented_image.load()

  • order imports in ultralytics.py

  • build fix

  • remove unnecessary formatting changes


Co-authored-by: Richard Abrich <[email protected]> (742b176)

v0.35.0 (2024-06-22)

Feature

  • feat(SegmentReplayStrategy, drivers): add strategies.replay; refactor adapters -> drivers + adapters (#714)

  • implemented

  • add get_active_window_data parameter include_window_data; fix ActionEvent.from_dict to handle multiple separators; add test_models.py

  • update get_default_prompt_adapter

  • add TODO

  • tests.openadapt.adapters -> drivers

  • utils.get_marked_image, .extract_code_block; .strip_backticks

  • working segment.py (misses final click in calculator task)

  • include_replay_instructions; dev_mode=False

  • fix test_openai.py: ValueError -> Exception

  • replay.py --record -> --capture

  • black/flake8

  • remove import

  • INCLUDE_CURRENT_SCREENSHOT; handle mouse events without x/y

  • add models.Replay; print_config in replay.py (7ef115a)

v0.34.0 (2024-06-20)

Feature

  • feat(onboarding): Add onboarding for new users (#746)

  • feat: Add onboarding for new users

  • feat: Overhaul onboarding into a multistep process

  • docs: Update README.md with usage of the entrypoint module

  • refactor: Remove steppers and move all steps to a single page

  • feat: Move onboarding to a separate page and add bounty card

  • feat: Redirect to onboarding on launch, and move around content


Co-authored-by: Richard Abrich <[email protected]> (bdf153e)

v0.33.6 (2024-06-20)

Fix

  • fix(tray): Fix incorrect argument when visualizing from tary (#780)

Changed order in tray.py

Co-authored-by: Richard Abrich <[email protected]> (4ff4c73)

  • fix(record): remove extra param (#784) (f60a617)

v0.33.5 (2024-06-19)

Fix

  • fix(analytics): Posthog event logging updates (#772)

  • feat: Add openadapt version to posthog events

  • feat: Update tracking text of replay, visualize and delete submenus

  • fix: Fix code in plotting.py not using correct arguments

  • fix: Update broken tests (59c2714)

v0.33.4 (2024-06-18)

Fix

  • fix(visualize): Handle no screenshots (#763)

  • handle no screenshot in visualize.py / plotting.py

  • black/flake8 (92b74f0)

Test

  • test: Add CI scripts to run the app after build (#709)

  • feat: Add scripts to run the app after build

  • feat: Log error in a file

  • chore: Add TODO for future additions of logging


Co-authored-by: Richard Abrich <[email protected]> (e370fe6)

v0.33.3 (2024-06-18)

Fix

  • fix(record): fix performance plotting regression (#774)

  • Fixes regressions introduced in Database access refactor #676 affecting plotting of performance plots.

  • Re-uses record.write_event for video events.

  • Modifies plot_performance to use color-blind-friendly markers

  • black/flake8 (44371e9)

v0.33.2 (2024-06-15)

Fix

  • fix(VisualReplayStrategy): increase default NMS thresh/conf (#758)

  • repair VisualReplayStrategy

  • black/flake8 (dd9e8fa)

v0.33.1 (2024-06-14)

Fix

  • fix(posthog): fix broken posthog api (#753)

  • fix: Fix broken posthog api

  • fix types


Co-authored-by: Richard Abrich <[email protected]> (16d510f)

v0.33.0 (2024-06-13)

Feature

  • feat(scripts.downloads): add scripts/downloads.py (#735)

  • add scripts/downloads.py

  • add total cumulative downloads to title

  • add module docstring

  • pagination

  • add datetime

  • accumulate by release_date

  • black/flake8 (3c20298)

v0.32.0 (2024-06-13)

Feature

  • feat(tray): Add posthog analytics to tray actions (#737)

Co-authored-by: Richard Abrich <[email protected]> (dc0b7ea)

v0.31.0 (2024-06-12)

Feature

  • feat(contrib.som, postinstall): add contrib.som; postinstall.py; other fixes (#679)

  • add vision.get_similar_image_idxs and test_vision.py

  • refactor fixtures

  • add get_size_similarity and tests; update default params in adapters.ultralytics

  • get_image_similarity rgb

  • add caching; win_size

  • short_circuit_ssim; plot_similar_image_groups

  • refactor: adding plotting.py

  • fix test; typo

  • bug fixes; title_params

  • add tests/openadapt/adapters

  • bugfix: imports

  • modify prompt adapter API to accept images instead of base64 images

  • add experiments/handle_similar_segments.py

  • add highlight_masks; increase_contrast

  • add experiments/gpt4o_seg.py; normalize_positions; clean_data; filter_keys; modify get_scale_ratios to accept no arguments; modify crop_active_window to accept window event; fix bugs

  • ultralytics sam

  • add experiments/nms.py

  • add fastsamsom.py, visualizer.py

  • working fastsamsom.py

  • cleanup

  • black; flake8; postinstall.py; test_vision.py

  • restore utils.get_performance_plot_file_path/get_performance_plot_file_path

  • fix ActionEvent.from_dict

  • handle HTTPError in test_openai

  • utils.split_by_separators

  • other fixes

  • remove list python files step

  • consolidate install-dashboard and postinstall

  • install_dashboard from dashboard_dir

  • postinstall error logging (588494c)

Fix

  • fix(build): pip install wheel (#738) (3640f41)

  • fix(tests, utils): fix regressions (#736)

  • recording.monitor_hefith -> recording.monitor_height

  • add test_utils.py

  • release-and-publish.yml: poetry run postinstall

  • black (d28a886)

v0.30.4 (2024-06-11)

Fix

  • fix(RecordingsAPI): catch AttributeError if audio_info is None (#729) (81b4089)

v0.30.3 (2024-06-10)

Fix

  • fix(scrubbing): Catch exceptions when download required spacy model (#733) (b3f73d8)

  • fix(video): add num_copies to write_video_event (#732) (ca04b6d)

v0.30.2 (2024-06-08)

Fix

  • fix(video): fix video playback with force_key_frame (#726)

  • force_key_frame

  • fix embedded video playback

  • disable fix_moov

  • black; flake8

  • fix typo

  • yuv420p -> yuv444p (lossless) (1f67822)

v0.30.1 (2024-06-08)

Chore

  • chore: fix typo in test_video.py (#710) (57a3376)

Fix

  • fix(get_audio_info, visualize): replace use of recording timestamp in functions with recording id (#717)

  • fix(audio): Replace use of recording timestamp in functions with recording id (#727)

Co-authored-by: Shohan Dutta Roy <[email protected]>

  • fix get_audio_info

  • black


Co-authored-by: Shohan Dutta Roy <[email protected]> (1b04fd4)

v0.30.0 (2024-06-05)

Feature

  • feat(dashboard): Add feature to remove action events (#688)

  • feat: Add feature to remove action events

  • fix: Fix database revision (f33b36d)

v0.29.0 (2024-06-05)

Documentation

  • docs(README): add dashboard visualization; improve description of VanillaReplayStrategy (6df4bb9)

Feature

  • feat(vanilla): Implement vanilla baseline (#702)

  • add vanilla.py; update README.md

  • update module docstring

  • add TODO; remove unused code

  • tabs -> spaces

  • modify prompt adapter API to accept images instead of base64 images

  • fix typo

  • add ActionEvent/WindowEvent.to_prompt_dict

  • add prompts/describe_recording.j2; prompts/generate_action_event.j2

  • fixes; log action history

  • fixes; black; flake8

  • add tests/openadapt/adapters

  • add missing test assets

  • DATA_DIR_PATH -> PARENT_DIR_PATH

  • get_completion dev_mode

  • anthropic dev_mode

  • fix tests

  • black

  • flake8

  • ignore .cache in flake8

  • vanilla.INCLUDE_WINDOW_DATA; utils.clean_data/filter_keys

  • flake8 (81074c4)

v0.28.0 (2024-06-05)

Feature

  • feat: Delete/transfer video (#696)

  • feat: Delete recording files when deleting recording

  • fix: Fix share recording feature

  • feat: Share related files when transferring recording

  • fix: Fix tests and lint code


Co-authored-by: Richard Abrich <[email protected]> (889d48c)

  • feat(alerts): Alert user when any exception occurs, via sentry hooks (#685)

  • feat: Alert user when any exception occurs, via sentry hooks

  • chore: Turn ERROR_REPORTING_BRANCH to a static config variable


Co-authored-by: Richard Abrich <[email protected]> (6492120)

v0.27.0 (2024-06-04)

Feature

  • feat: Audio narration (#673)

  • feat: Add audio narration feature while recording

  • feat: Remove implicit scrubbing in display_event function and recursively convert reqd properties to str

  • feat: Add transcribed text to dashboard visualisation

  • feat: Use recording id as foreign key, and add interrupt signal handler in audio recording process

  • feat: Check if the lock is stale when acquiring locks

  • refactor: Convert database lock path to a constant in config file


Co-authored-by: Richard Abrich <[email protected]> (1e11906)

v0.26.2 (2024-06-03)

Documentation

  • docs: Create FUNDING.yml (#690) (3692416)

Fix

  • fix(docs): add nvm install info in Readme.md in manual setup section. (#694) (4f240b6)

v0.26.1 (2024-05-28)

Fix

  • fix(db): Database access refactor (#676)

  • feat: Remove global sessions, and introduce read only sessions for cases where no writing is required

  • refactor: Rename db to session

  • feat: Raise exceptions if commit/write/delete is attempted on a read-only session

  • feat: Add tests for the read only session

  • chore: lint using flake8

  • rename test_database -> db_engine


Co-authored-by: Richard Abrich <[email protected]> (987f6ac)

v0.26.0 (2024-05-27)

Feature

  • feat(dashboard): Dashboard scrubbing (#672)

  • feat: Add ability to download spacy model from within pyinstaller build

  • refactor: Add id column as foreign keys instead of timestamp

  • feat(scrubbing): Add api endpoints and scrubbing feature

  • fix: Fix code after merge with main

  • lint: flake8 lint

  • refactor: Cleanup code and add comments

  • chore: Fix comments

  • chore: Add comments on crud.py


Co-authored-by: Richard Abrich <[email protected]> (3083fef)

v0.25.5 (2024-05-24)

Fix

  • fix(docs): fix typo in README.md (#686) (320bb88)

v0.25.4 (2024-05-22)

Fix

  • fix(installer): Fix build failing due to replicate and other issues (#684) (fdf286c)

v0.25.3 (2024-05-22)

Fix

  • fix(installer): add hidden import replicate (#680) (6621a04)

v0.25.2 (2024-05-19)

Fix

  • fix(app): add hidden-imports to build spec (#678) (d2db305)

v0.25.1 (2024-05-17)

Fix

  • fix(config): Fix path of default config file (#675) (9ffdf67)

v0.25.0 (2024-05-14)

Feature

  • feat: run posthog in production only (#670)

Co-authored-by: Richard Abrich <[email protected]> (bed12ec)

v0.24.1 (2024-05-14)

Fix

  • fix(dashboard): close dashboard from tray (#671) (3f0db86)

v0.24.0 (2024-05-12)

Feature

  • feat(VisualReplayStrategy): Remove model copy logic; avoid unnecessary segmentations (#669)

  • preferences_dir -> root_dir; add data_dir; remove copying logic; disable dashboard from tray; avoid unnecessary segmentations; bugfixes

  • fix json serialize error

  • with session

  • fix template paths

  • black; flake8

  • make dir if not exists

  • fix confest.py: RECORDING_DIRECTORY_PATH -> RECORDING_DIR_PATH

  • fix test_share.py: RECORDING_DIRECTORY_PATH -> RECORDING_DIR_PATH (45c06c3)

v0.23.1 (2024-05-11)

Fix

  • fix: Install latest version before deciding which release to upload to (#668) (c91efd4)

v0.23.0 (2024-05-11)

Feature

  • feat(dashboard): Add recording detail page with screenshots (#616)

  • feat: Add recording detail page with screenshots

  • refactor(screenshots): Refactor code to add more comments and improve styling

  • refactor: Cleanup of redirects and not found env variables

  • feat: Change dynamic route to regular routes with query parameters and use websockets since response is too large

  • add main guard to dashboard/run.py

  • feat(screenshots): Make changes to screenshots ui, add diff to images and add carousel

  • feat(dashboard): Terminate dashboard process on pressing ctrl + c

  • feat: Add write locks for endpoints which need to write to database

  • feat(screenshots): Add utility functions to copy objects so they are independent of the sa session

  • feat(screenshots): Remove diff and add progress loader

  • chore: flake8 lint

  • fix: Filter out invalid action events after copies are made

  • fet: Change favicon and logo on dashboard


Co-authored-by: Richard Abrich <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (0ac599c)

v0.22.0 (2024-05-10)

Feature

  • feat: Run ci steps only if not triggered by the bot commit (#666)

Co-authored-by: OpenAdapt Bot <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (400a73b)

v0.21.0 (2024-05-10)

Feature

  • feat: Add posthog analytics (#655)

  • feat: Add posthog analytics

  • feat: Move posthog config to the python config file (294fe71)

  • feat(tray): performance and UX improvements

  • write_video_event; pre_callback/post_callback

  • add Recording.config; read Screenshot.image from video; asserts if diff_video

  • add FrameCache

  • maybe_obfuscate; video_dir_path; event_type_modifier

  • update .gitignore

  • replace notifypy with pyqttoast

  • add video event to perf_q; fix documentation

  • add build.py main guard

  • reduce visualize import time

  • add RedirectOutput.null_stream

  • add on_ready argument to record; remove Notify

  • add task description input dialog; replace QTimer with Connection

  • configure replay strategy

  • handle argument types in replay dialog; remove replay_instructions where not used

  • show "No recordings available"

  • add delete menu

  • on_ready -> status_pipe; oaThread -> Thread; disable app action; sticky toasts; log_memory arg; view_file false

  • pass args to strategy class; add Config.ROOT_DIR_PATH; matplotlib use Qt5Agg

  • remove extensions.thread

  • Union -> |

  • fix mouse playback bug; sleep in NaiveReplayStrategy

  • improve parse_code_snippet; validate ActionEvent properties; fix ActionEvent.from_dict

  • fix: timestamp int -> float

  • fix: redundant_mouse_move -> remove_move_before_click

  • add ActionEvent.reducer_names

  • add common.MOUSE_CLICK_EVENTS; remove sleep in naive.py; disable remove_move_before_click

  • fix: num_total -> num_total_

  • RECORD_FULL_VIDEO; LOG_MEMORY; num_copies

  • visualize recording_timestamp

  • black

  • flake8

  • fix tests: add row2dicts drop_cols

  • replay status pipe

  • ignore reducer_names in get_action_prompt_dict (88b9726)

Fix

  • fix(build): [email protected] (c3c26e6)

  • fix(build): pip install poetry (#667) (0a64d65)

  • fix(build): poetry env use python3.10 in pyproject.toml

  • Revert "fix(build): poetry install order"

This reverts commit a475ee362efde1983681b570cb62e1037c4bd00e.

  • Revert "fix(build): poetry env use 3.10 (#663)"

This reverts commit c6c176879f703530465ac70a0ecd044394c90688.

  • Revert "fix(build): add setup-python to release job (#662)"

This reverts commit cc6cab34861032393d0264844d3714c0319ebd03.

  • pip install poetry -> poetry env use python3.10 (pyproject.toml) (553a29d)

  • fix(build): poetry install order

  • install poetry before poetry env (a475ee3)

  • fix(build): poetry env use 3.10 (#663) (c6c1768)

  • fix(build): add setup-python to release job (#662) (cc6cab3)

  • fix(build): remove notifypy from build.py (abd2d99)

Unknown

v0.20.1 (2024-05-03)

Fix

  • fix(config): restore Config.ROOT_DIR_PATH (#653) (b33e454)

v0.20.0 (2024-05-02)

Documentation

  • docs(README): add link to calculator demo (54c2b16)

Feature

  • feat(config, build): refactor config; build executables

  • feat(config): Make changes to config to use pydantic settings

  • chore: Refactor all uses of config to use the config object from the config module

  • refactor(config): Remove unused code, fix typos and add comments for clearer information

  • refactor: Add more comments and change variable names

  • fix(record): Fix progress bar

  • feature(config): Re-read config value only if it changes

  • update README


Co-authored-by: Richard Abrich <[email protected]> (ee506f0)

Fix

  • fix(release): Revert to use admin token for release checkout action (#648) (1d80f33)

  • fix(release): Revert to use admin token for semantic release action (#646) (64cd483)

v0.19.0 (2024-04-27)

Feature

  • feat(VisualReplayStrategy): compute image similarity to avoid unnecessary segmentation

  • remove sct_image from Screenshot; fix typo

  • add Image.cropped_image

  • add experiments/imagesimilarity.py

  • bugfix: sct_image -> image

  • find_similar_image_segmentation

  • fix test_crop_active_window (3c185e8)

v0.18.3 (2024-04-22)

Fix

  • fix: video performance

  • remove screenshot_to_np (943adb7)

v0.18.2 (2024-04-22)

Fix

  • fix: video recording

  • screenshot_to_np Image.Image argument

  • remove unused import; update documentation/types (9a0501d)

v0.18.1 (2024-04-22)

Fix

  • fix: performance, windows cursor flicker

  • CAPTURES_DIR -> CAPTURE_DIR_PATH; add capture/main.py

  • save as mp4

  • mss.windows.CAPTUREBLT = 0

  • return PIL.image in utils.take_screenshot() (d354b94)

v0.18.0 (2024-04-16)

Feature

  • feat(VisualReplayStrategy): adapters: ultralytics, som, anthropic, google; remove_move_before_click; vision.py

  • add prompts/, adapters/openai.py, strategies/visual.py (wip)

  • adapters.anthropic

  • add anthropic.py

  • prompt with active segment descriptions

  • Set-of-Mark Prompting Adapter (#612)

  • Update openadapt/config.py

  • remove_move_before_click

  • started_counter; adapters.ultralytics

  • add vision.py

  • add openadapt/adapters/google.py

  • filter_masks_by_size

  • documentation

  • update README

  • add ultralytics

  • exclude alembic in black/flake8

  • exclude .venv in black/flake8

  • disable som adapter; remove logging

  • add adapters.google


Co-authored-by: Cody DeVilliers <[email protected]> (250943f)

v0.17.1 (2024-04-15)

Fix

  • fix(ci): dashboard -> install-dashboard

  • Update install_openadapt.sh

dashboard -> install-dashboard

  • dashboard -> install-dashboard (win)

  • pull_request_target -> pull_request (e3834ed)

v0.17.0 (2024-04-11)

Documentation

  • docs(README): System Overview -> Alpha Architecture

System Overview -> Alpha Architecture (dd1c29e)

  • docs(README): update System Overview diagram

Update system overview diagram (c08caf7)

  • docs(README): update System Overview diagram

Update system overview diagram (3b2dfbc)

  • docs(README): update System Overview diagram

Update system overview diagram (de9fad2)

  • docs(README): update System Overview diagram

Update system overview diagram (13a9f23)

  • docs(README): update System Overview diagram

Update system overview diagram (ff1e4d9)

  • docs(README): update System Overview diagram

Update system overview image (086e42f)

  • docs(README): update System Overview diagram (ca5f093)

  • docs(README): update System Overview diagram (7ca2086)

  • docs(README): update System Overview diagram

Update System Overview diagram (aee1078)

Feature

  • feat(dashboard): add web dashboard

  • feat: Complete initial setup of web dashboard

  • feat(recordings): Add simple view to start, stop and list recordings

  • fix: Fix sqlite thread issue and a few dashbaord ui improvements

  • feat: Add script to download npm dependencies and update installer script

  • chore: Code cleanup and workflow fix (0050cea)

v0.16.2 (2024-03-08)

Documentation

  • docs(README): add image of system tray icon and client GUI app (985cc6e)

  • docs(README): update System Overview diagram (edf2241)

  • docs(README): update System Overview diagram (1b12ffb)

  • docs(README): update System Overview diagram

  • Update README.md

Update system overview diagram (15f2818)

  • docs(README): add notable works-in-progress under contributing (e44aa1f)

  • docs(README): update system overview image (#587)

  • Update README.md

Update system overview image

  • Update README.md (91c3eab)

  • docs(README): document root directory requirement (a021c2b)

  • docs(README): poetry shell (dd9dc9f)

Fix

  • fix(app): use default logo for tray icon (21f229b)

Refactor

  • refactor(visualize): /visualize.py to /app; move deprecated/visualize.py to /

  • mv visualize.py -> app.py; restore deprecated/visualize.py

  • remove deprecated

  • swallow AssertionError regarding timestamps

  • fix logo path


Co-authored-by: Aaron <[email protected]> (9ed9ac3)

v0.16.1 (2024-02-29)

Documentation

  • docs(README): remove redundant text from image (76b55fd)

Fix

  • fix(video): add migration script (b769c4a)

v0.16.0 (2024-02-29)

Documentation

  • docs(README): document AudioInfo.words_with_timestamps (7759996)

  • docs(README): add System Overview image (8b56a83)

  • docs(README): early loom demo (729e0be)

Feature

  • feat: video

  • replace multiprocessing with pyav

  • add config.RECORD_WINDOW_DATA

  • video_write_q

  • fix get_timestamp; extract_frames_to_pil_images with pyav

  • add video.py; ActionEvent.original_timestamp

  • use global SCT in get_monitor_dims

  • fix tests

  • fix window._windows.get_active_window_state (missing type)

  • add tests/openadapt/test_video.py

  • flake8

  • black

  • poetry lock (20e08b8)

Unknown

  • Update README.md (#566) (c7f8af4)

  • docs(README) (000db3c)

  • Update README.md (#558) (028f6e8)

  • Update README.md (#557)

  • Update README.md

Add links to Architecture and RFC

  • Update README.md

  • Update README.md (ad6de5b)

  • docs(README)

  • Update README.md

Add contract positions

  • Update README.md

Improve contracts section (275db79)

v0.15.1 (2023-12-12)

Documentation

  • docs(README): Transformers -> LLMs

Transformers -> LMMs (ef4c901)

  • docs: README (aca53f5)

  • docs: features

  • Update README.md

  • Update README.md

  • Update README.md (aaf7727)

  • docs: README (c8bb1a7)

Unknown

  • Merge pull request #223 from Mustaballer/share-magic-wormhole (cf81f1a)

  • Update openadapt/config.py

Co-authored-by: Richard Abrich <[email protected]> (b79f3b5)

  • Update openadapt/config.py

Co-authored-by: Richard Abrich <[email protected]> (39b334e)

v0.15.0 (2023-11-11)

Feature

  • feat(openadapt.privacy.providers): add private_ai as a scrubbing provider (#486)

  • ran black

  • add blank file for priavte ai

  • add class PrivateAIScrubbingProvider

  • add pvt_ai api key in config

  • ran pre-commit run --all

  • add scrub_text function

  • progress for image redaction

  • format

  • complete scrub_image

  • start scrub_pdf

  • add pdf redaction code

  • add more wrapper for invalid reponse from priavate ai

  • try to fix pytest

  • try to fix pytest

  • remove lst

  • remove uncessary methods

  • text scrubbing test all passses

  • pdf_redaction test works

  • add test_image_redaction test in pyetst

  • add easy ocr to poetry

  • pytest is fixed

  • remove versino files

  • remove un-neccasry files

  • add code to remove uncessary files after pytest

  • addressed OpenAdaptAI#486 (comment)

  • address comment OpenAdaptAI#486 (comment)

  • reduce line chars

  • addressed comment: OpenAdaptAI#486 (comment)

  • fix flake8

  • use f strings

  • address comment: OpenAdaptAI#486 (comment)

  • address comment: OpenAdaptAI#486 (comment)

  • change to value error

  • remove .keys()

  • add constants

  • fix flake8 erros

  • use BytesIO

  • address comment OpenAdaptAI#486 (comment)

  • rna black

  • final commit

  • remove unused code

  • refactor typo

  • rename redact_file_path to redacted_file_path

  • use BytesIO wherever possible

  • fix flake8

  • add documentation links

  • Apply suggestions from code review

  • Update tests/openadapt/privacy/providers/test_private_ai_scrub.py

  • fix poetry.lock

  • poetry.lock


Co-authored-by: Krish Patel <[email protected]> Co-authored-by: Richard Abrich <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (396bbb5)

Fix

  • fix(install): add vs redistributable installation in powershell script (#490)

  • VS C++ redist installation

  • add VS C++ redist installtion


Co-authored-by: Krish Patel <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (086a5ca)

v0.14.0 (2023-11-10)

Feature

  • feat(openadapt.record): implemented notifications on record (#510)

  • implemented notifications on record

fixed deprecated/visualize

Unknown

v0.13.2 (2023-10-16)

Fix

  • fix: resolve repository not found error in mac install.sh script (#502)

  • Update install_openadapt.sh

  • Update install_openadapt.sh (eb3c8c3)

Unknown

  • Update README.md (#493)

  • Update README.md

replace slack with discord (5a6530a)

  • Merge remote-tracking branch 'upstream/main' into share-magic-wormhole (ca04296)

  • fix wormhole sharing (a94c303)

v0.13.1 (2023-08-30)

Fix

  • fix(tests.openadapt.privacy.providers): failing test_comprehend_scrub.py (#488)

  • skip all the tests if ther is an issue wiht aws config files, either they are not htere or incorrect values are porided

  • format (cec2a53)

Unknown

  • Merge pull request #483 from OpenAdaptAI/modify-install-script (5fa12eb)

  • Merge branch 'main' into modify-install-script (73bfad4)

v0.13.0 (2023-08-29)

Feature

  • feat(privacy.providers): add aws_comprehend as scrubbing provider (#476)

  • add aws_comprehend provider module

  • fix typo

  • add boto3 and botocore to poetry

  • ran poetry update

  • add the AWS Comprehend Class

  • update the script

  • create test module to test comprhend

  • refactor name

  • add full fleged test module

  • try to fix failing tests

  • try to fix failing tests

  • fixed pytest

  • format test file

  • fix all flake 8 formattings

  • add naming meaning for NER

  • remove repeated code and make a TextMixin

  • format

  • change scrub enabled to false after testing visualization

  • remove redundant rmethods

  • add enum style provider names

addressing: OpenAdaptAI#476 (comment)

  • fix all flak8 errors

  • add files for private_ai scrubbing provider

  • change name

  • add scrub text function in PrivateAIScrubbingProvider

  • try to skip tests if api key is incorrect or missing or the syntax used in code is incorrect

  • pytest passes for test_private_ai

  • add temp code for pdfs redaction

  • remove the PRIVATE_AI provider code as it will be added in seprate pr

  • remove omre prvt_ai files

  • ran black


Co-authored-by: Richard Abrich <[email protected]> (33fe244)

Unknown

  • Merge branch 'main' into modify-install-script (705a2f0)

v0.12.0 (2023-08-29)

Feature

  • feat: manage recording database (#451)

  • implemented db module

  • use click + loguru (5b25b90)

Unknown

  • update poetry.lock file and some formatting (a03bd59)

  • Merge branch 'main' into share-magic-wormhole (24a3e79)

  • fix formatting (d668901)

  • Merge branch 'modify-install-script' of github.com:OpenAdaptAI/OpenAdapt into modify-install-script (4e52dc3)

  • address formatting errors (2fa3fde)

  • Merge branch 'main' into modify-install-script (b5ad05c)

v0.11.0 (2023-08-29)

Feature

  • feat: add capture.py - also fixes audio recording (#362)

  • merge

  • Create capture.py

  • Update capture.py

  • Update capture.py

  • it's finally fixed

  • add dependencies

  • comment

  • move code + use config.CAPTURE_DIR_PATH

  • remove debug lines

  • Update capture.py

  • OpenAdaptCapture -> Capture

  • add camera

  • Let's have this off by default.

  • hotfix

  • fix

  • linting

  • Create capture.py

  • windows

  • cleanup + lint

  • Update _windows.py

  • add audio + new windows recording

  • screen_recorder.free_resources()

  • Update _windows.py

  • isort

  • add playback recording

  • Update replay.py

  • Update replay.py

  • Update README.md

  • Revert "Update README.md"

This reverts commit 706410358d5e47ceccb34b77d82d5ffd0f3821a8.

  • Update README.md

  • Revert "Revert "Update README.md""

This reverts commit 0fe81563e88417d61012e24e1dc55befa960c2ed.

  • Update README.md

  • run pre-commit

  • Update pyproject.toml

  • Update openadapt/replay.py

  • Update openadapt/replay.py

  • Update openadapt/replay.py

  • Update replay.py

  • update poetry.lock


Co-authored-by: Richard Abrich <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (581b9b8)

v0.10.0 (2023-08-29)

Feature

  • feat: use sentry.io (#386)

  • sentry

  • check for main branch

  • Update openadapt/config.py

  • Update openadapt/config.py

  • ERROR_REPORTING_ENABLED

  • Update config.py

  • update poetry.lock

  • Update openadapt/config.py


Co-authored-by: Richard Abrich <[email protected]> (90bfe8f)

v0.9.0 (2023-08-28)

Chore

  • chore: add invalid configuration assertion in naive.py (#471)

  • Update naive.py

  • simplify logical expression

  • github action check (6040fae)

  • chore: Silence pytest DeprecationWarnings (#407)

  • Update pyproject.toml

  • tomlkit

  • Update config.py

  • remove config (212452c)

  • chore: modify install script to execute on user's repo and branch (21e4942)

  • chore: validate functionality of status checks (#477)

  • chore: validate functionality of status checks

  • test removing install script testing

  • try removing docstring form module to see if its picked up

  • add reference to pull request

  • add removed docstring back for app init file

  • add missing check out statement (1485ae4)

Feature

  • feat: enhanced visualize.py with NiceGUI (#406)

  • Create visualize1.py

  • changes

  • fix actions + add dark mode + remove unused code

  • Update visualize1.py

  • Update visualize1.py

  • bump ^ nicegui == 1.2.24

  • splitter

  • add plot

  • updated

  • add search button

  • isort

  • formatting

  • make plot dynamic

  • Update visualize1.py

  • make logo dynamic

  • comments

  • missed one

  • fixed plot bug

    • max table children, deprecate old visualize
  • Update visualize.py

  • Update config.py

  • Update config.py

  • Update config.py

  • refactor: show -> view_file

  • Update visualize.py

  • Update visualize.py

  • downgrade fastapi

  • update config

  • linting

  • remove debug print

  • disabled on_select

  • Update visualize.py

  • fix visualization with tray

  • merge privacy api

  • Update visualize.py

  • pre-commit

  • Update poetry.lock (8031a9d)

Refactor

  • refactor: failing actions (#474)

  • add missing dicstrings

  • make docstring a bit longer

  • fix all flake8 errors

  • Add documentation on status checks

  • Update README.md


Co-authored-by: Mustafa Abdulrahman <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (09f4e71)

  • refactor: style errors from productivity measurement PR (#480)

  • check for long gaps in recording

  • display basic productivity data in html page similar to visualize

  • show images for each window change

  • show productivity info for each window

  • WIP find tasks/cycles of ActionEvents

  • WIP find tasks/cycles of ActionEvents

  • WIP implementing brent's algorithm

  • implemented brent's algorithm

  • add task duration info + style changes to display

  • comments

  • floyd's algorithm and basic implementation of counting errors

  • implement longest repeated non-overlapping substring algorithm

  • removed unused code

  • small bug fixes

  • no empty window titles

  • small fixes

  • add title

  • edge case

  • make longest repeated substring recursive

  • changed window/tab switching

  • add number of actions in a task

  • add comments

  • make sure no non-repeating tasks are found

  • fix off by 1 error with window event screenshots

  • remove unused functions, comments, and some refactoring

  • docstrings

  • black

  • Undo changing PLOT_PERFORMANCE

  • style changes (2089e74)

Unknown

  • Update README.md (250949f)

  • Merge branch 'main' into share-magic-wormhole (5b9bbe0)

  • add default values when no parameters are passed (e8775e8)

  • Productivity measurement (#234)

  • check for long gaps in recording

  • display basic productivity data in html page similar to visualize

  • show images for each window change

  • show productivity info for each window

  • WIP find tasks/cycles of ActionEvents

  • WIP find tasks/cycles of ActionEvents

  • WIP implementing brent's algorithm

  • implemented brent's algorithm

  • add task duration info + style changes to display

  • comments

  • floyd's algorithm and basic implementation of counting errors

  • implement longest repeated non-overlapping substring algorithm

  • removed unused code

  • small bug fixes

  • no empty window titles

  • small fixes

  • add title

  • edge case

  • make longest repeated substring recursive

  • changed window/tab switching

  • add number of actions in a task

  • add comments

  • make sure no non-repeating tasks are found

  • fix off by 1 error with window event screenshots

  • remove unused functions, comments, and some refactoring

  • docstrings

  • black

  • Undo changing PLOT_PERFORMANCE (56d22a8)

v0.8.1 (2023-08-21)

Chore

  • chore(*): change installation of spacy weights to runtime (#462)

  • remove spacy from manual steup instruciton in README.md

  • remove spacy installion from both the install scripts

  • add todo

  • test runtime code for spacy installtion

  • pyetst passes even if spacy model is not installed

  • addressing:

OpenAdaptAI#462 (comment)

  • add spacy-trnasformers

address comment: OpenAdaptAI#462 (comment)

  • skip all the tests in test_scrub if spacy miodel is ont installed

  • format (479937e)

Fix

  • fix: enhance publish action and authors in pyproject.toml (#463)

  • fix: enhance publish action and authors in pyproject.toml

  • modify release-and-publish.yml

  • change author name to OpenAdapt.AI Team

  • use pull_request_target to trigger status checks for any git branch (c7813c2)

  • fix: enhance publish action and authors in pyproject.toml (dc5f2b6)

Refactor

  • refactor: add Privacy design API (#439)

  • add Privacy API design code

  • add Presidio.scrub_text

  • update script to remove linting error

  • add test script

  • try to fix the pytest error

  • try to fix failing test_scrub_api.py

  • fixed the pytest error

  • change the test file to use the providers code

  • refactor presidio_scrub

  • fix pytest test_presidio_scrub_text

  • fix pytest

  • update the scrub_image method header

  • add module docstrings

  • update base.py

  • update providers

  • update providers

  • add noqa

  • update flake8 to ignore flake8 F821 undefined name '...' error

  • remove noqa from line now

  • update flake8: fix undefined error in pylint and falek8

  • update privacy api

  • fix all pylint errors

  • fix all pytlint errors

  • fix all pylint errors in base.py

  • now pytest passes with 6 warnings

  • update visualize to use the privacy api providers code

  • now visualization works with new Privacy API

  • change scrub ebaled to False

  • fix pytest

  • remove scrbu.py old moidule

  • format test script

  • format base.py and presidio.py

  • remove scrub module

  • fix merge

  • add spacy runtime code

  • remove pytestmark unused variable

  • tests get skippped if spacy is not installed

  • update utils

  • format for final commit (5151cb5)

Unknown

  • resolve merge conflicts and linting errors from recent merge (0e8d620)

  • Merge branch 'main' into share-magic-wormhole (1b2eef3)

  • fix poetry conflicts and conflicting files (8ea0ee4)

  • test publish to test pypi (09dd4d6)

  • Merge remote-tracking branch 'upstream/enhance-publishing' into share-magic-wormhole (8b1299d)

  • change author name to OpenAdapt.AI Team (c77f339)

  • modify release-and-publish.yml (ebea2cb)

  • Merge branch 'main' into share-magic-wormhole (75b324d)

v0.8.0 (2023-08-10)

Chore

  • chore: resolve failing publish github actions (#458)

  • check if modified flake8 works

  • Add release github action

  • Add oa-pynput and oa-atomacos and refactor accordingly

  • Use simpler publish github action and rename to release-and-publish.yml

  • add preview check in main.yml

  • add documentation on publishing direct dependencies

  • chore: resolve publishing github action errors (7b57505)

Feature

  • feat: Implement System Tray Icon (#300)

  • add tray icon

  • move to tray.py

  • add notifications & guards

  • pyinstaller currently broken

  • Update tray.py

  • Update cards.py

  • hide icon in taskbar + minor improvements

  • add dropdown for visualize

  • Update tray.py

  • Update tray.py

  • add py6tray + notifier

  • BYE BYE PYSTRAY !!!

hello dependency inversion?

  • os.sep + fix console + other

  • use path.join

  • run -> _run

  • add replays

  • fix conflicting action items

  • fix database is locked + threading

  • type annotations

  • Update cards.py

  • Create visualize1.py

  • Revert "Create visualize1.py"

This reverts commit 753f6919e7566b89686922c4e6b2a4fddf33ef04.

  • fix typo

  • fix merge conflicts : still broken

  • fix

  • Revert "fix"

This reverts commit 9d844467a9a9f16e219175eb60734b709c6f7b76.

  • Revert "fix merge conflicts : still broken"

This reverts commit 82e62d95093e6114653f59b8a7ea94233efc60e1.

  • Update pyproject.toml

  • styling / linting

  • Update tray.py

  • Update build.py

  • return vals

  • Update build.py

  • show app

  • changes (9f2a04e)

Unknown

  • fix pytest (#460) (1049589)

  • update poetry.lock (4d66584)

  • Merge branch 'main' into share-magic-wormhole (453d2c2)

v0.7.1 (2023-08-10)

Chore

  • chore: add pypi action and oa-atomacos and oa-pynput packages (#456) (a62d7f3)

  • chore: suppress identical warnings (#389)

  • chore: suppress identical warnings

  • add max_num_warnings_per_second to limit number of allowed warnings per cond

  • remove MAX_NUM_REPEAT_WARNINGS and check for max num warnings per second in utils.py

  • Update openadapt/config.py

  • address linting errors and set new variable

  • use class for filter_log_messages and track message_timestamps with instance variable

  • create logging.py to replace logging class using namespace

  • test github actions with empty commit

  • replaced variable name with MESSAGES_TO_FILTER

  • Update openadapt/logging.py


Co-authored-by: Richard Abrich <[email protected]> (7648210)

Fix

  • fix: pypi direct dependency failure (#459)

  • remove trf from toml and then ran poetry update

  • update all neccessary files (d638469)

Unknown

Co-authored-by: M <[email protected]> (ea25b53)

  • resolve merge issues (c3173f8)

  • Merge branch 'main' into share-magic-wormhole (1a10f8a)

v0.7.0 (2023-07-28)

Feature

  • feat: scrub toggle for gui (#375)

  • add scrub toggle + write dark_mode to env

  • Update config.py

  • Update util.py

  • Update config.py

  • address comments

  • Update config.py

  • run isort

  • from first

  • Update openadapt/config.py

  • Update openadapt/config.py

  • Update openadapt/config.py

  • Update openadapt/config.py

  • Update openadapt/config.py

  • Update openadapt/config.py

  • add env file path (also where did the toggle go??)

  • Update config.py

  • Update config.py

  • Update config.py

  • isort

  • Update util.py

  • linted


Co-authored-by: Richard Abrich <[email protected]> (1e96a4f)

v0.6.1 (2023-07-28)

Fix

  • fix: modify flake8 config (#429)

  • style: modify flake8 config

  • add platform check for macOS in pyobjc-framework-avfoundation version

  • remove file exclusion in .flake8 and add ignore comment in openadapt/strategies/init.py

  • resolve lint errors from recent merge (f03be2f)

v0.6.0 (2023-07-26)

Feature

  • feat(crud): compute and save screenshot diff (#367)

  • feat(crud): Compute and save screenshot diff

  • Add 2 columns in screenshot table to store png_diff_data and png_mask_diff_data.

  • CRUD now supports calculation and save screenshots diff data on the flight.

  • feat(config): Add SAVE_SCREENSHOT_DIFF environment variable

  • SAVE_SCREENSHOT_DIFF indicates that 2 neighbors screenshot will be compared and the difference will be saved to db

  • feat(crud): add missing import after merge

  • refactor(crud): add missing type annotations

  • refactor(crud): add missing type annotations (9189bca)

Unknown

  • address flake8 errors (f29f199)

  • resolve merge conflicts (2f66b8a)

  • Merge branch 'main' into share-magic-wormhole (ada2aad)

v0.5.8 (2023-07-25)

Fix

  • fix(install): improve powershell script (Issue #372) (#409)

  • fix: git reinstallation even if it si present

  • fix: Error Message:

Remove-Item : Cannot remove the item at 'C:\Users\Krish Patel\hi' because it is in use. At line:1 char:9

  •     Remove-Item -LiteralPath $setupdir -Force -Recurse
    
  •     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    
    • CategoryInfo : InvalidOperation: (:) [Remove-Item], PSInvalidOperation Exception
    • FullyQualifiedErrorId : InvalidOperation,Microsoft.PowerShell.Commands.RemoveIt emCommand
  • fix: issue that poetry shell gives "..runnning scripts is disabled on the command line"

  • fix: bug #4 issue to support multiple version of python (acc. to OpenAdapt standards)

  • add start mesage to know why sometimes the installtion command exits

  • fix the edge case where the new terminal PWD is not set to the OpenAdapt folder that was installed

  • Update install/install_openadapt.ps1


Co-authored-by: Richard Abrich <[email protected]> (fb3ae1e)

v0.5.7 (2023-07-25)

Chore

  • chore: format changes with black, and google python docstring, install script testing (#289)

  • ran black

  • use poetry for install

  • Add caching to main.yml for faster github action checks

  • Add missing job to main.yml

  • try ubuntu latest instead

  • change readme type to string instead of array in pyproject.toml

  • Update poetry version in main.yml

  • try macos

  • commented out tests

  • see if black command works

  • see if black command runs properly

  • use black github action

  • fix parsing

  • use supported black github action

  • ignore venv as well

  • change args for flake8 action

  • try flake8 exclude

  • manually add and use flake8

  • change docstring keyword

  • Chain commands for installing flake8

  • exclude .venv

  • merged latest changes and add download instruction

  • remove import comment

  • try python command with ubuntu

  • add tesseract-ocr

  • add homebrew option

  • add cache for tesseract

  • add ntlk command with poetry

  • ran black

  • Add .flake8 and add flake8 to poetry

  • Add max length to flake8, add windows job with new install script, and address linting errors

  • add some ignore errors in flake8

  • Adress more flake8 lint errors

  • Change max line length

  • ran black

  • resolve new changes and ran black

  • remove "import nltk; nltk.download('punkt')" command

  • resolve lint errors in record.py

  • remove unnecessary commas

  • Address D415, sentence/comma missing on first line error

  • Resolve F403

  • Address D200, single line doctstrings

  • Addressed E731, F841, D205 errors

  • resolve F401, unused imports

  • Address return type annotations

  • Add type annotations for function arguments

  • ran black

  • Address 'Multi-line docstring summaries should start at the first line'

  • Revert main.yml to test if all checks pass

  • fix syntax issue in main.yml

  • Use cache for install poetry dependencies

  • Revert main.yml and convert black action to oneliner with poetry

  • Address lint errors for newly merged changes

  • Try caching tesseract install

  • test if tesseract is cached

  • try cache brew package

  • try cache brew again

  • Remove failing tesseract cache

  • Address lint errors from recent merge

  • replace test command

  • address comments on annotations and ran black

  • change todo

  • Shorten word line max length to 88 for comments

  • try executing script

  • keep windows runner as todo

  • comment poetry shell in install_opendapt.sh

  • add error flag in mac install script to avoid poetry shell in github actions

  • try to see if this will pass

  • update main.yml

  • Address incorrect function annotations in record.py

  • Address annotation errors in _windows.py

  • Addressed more general annotations

  • Address incomplete annotations in util.py

  • run isort and other precommit hooks with custom black config on all files

  • Update openadapt/crud.py

  • replaced more 'Any' type annotations

  • resolve lint errors from recent merge

  • ran black

  • resolve circular imports, and address Any annotations


Co-authored-by: Aaron <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (c815924)

Fix

  • fix: issues after latest merge (#424)

  • merge

  • hotfix

  • fix: resolve annotation errors and restore incorrectly removed code in lint PR

  • fix

  • Update models.py

  • run black

  • Update openadapt/models.py


Co-authored-by: Mustafa Abdulrahman <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (2d4e8c6)

Unknown

  • update unit tests (76f14b0)

  • modify conftest.py and fixtures.sql to insert data to every table for fixture (653e785)

  • remove unittest class and fix failing test case for receiving recording, and clean up share.py (644c83a)

  • refactor copy_recording_data (786e063)

  • remove unnecessary function and todo comment (9b7f7af)

  • add command to visualize recording (18a4918)

  • extract db file upon receiving recording (625c192)

  • Copy all data relating to recording_timestamp in all tables (2f1548d)

  • copy alembic migrations (2149adc)

v0.5.6 (2023-07-20)

Chore

  • chore: add preview option to black pre-commit hook and update README (#405) (6a42eb7)

  • chore: configure isort with black profile and add black precommit hook (#384)

  • chore: configure isort with black profile and add black precommit hook

  • update black version

  • add advanced isort settings to match CONTRIBUTING.md (2e7496b)

Documentation

  • docs: replace MLDSAI with OpenAdaptAI in README.md (#402) (750cf1d)

  • docs: update README (installation table) (#398) (1212198)

  • docs: update readme (take transpose of installation table) (#397) (fe39c73)

  • docs: Update README.md (#390) (8745969)

Fix

  • fix(merge_consecutive_keyboard_events): Fix reference before assignment (#411)

Co-authored-by: Seyed Morteza Hosseini <[email protected]> (e136b28)

Unknown

  • modify env names and add asserts to share.py (5893b3e)

  • modify copy deb function to return recording data and remov comments and unused set_db_url (6196876)

  • Merge branch 'share-magic-wormhole' of https://github.com/Mustaballer/puterbot into share-magic-wormhole (7a67386)

  • use new approach for copying db (2f2c0dd)

  • Merge branch 'main' into share-magic-wormhole (d4d3f1c)

v0.5.5 (2023-07-17)

Fix

  • fix: loguru exception handling for invalid recordings (#361)

  • raise ValueError

  • improve exception handling

  • Update crud.py

  • use assert

  • reorganize catch

  • Update openadapt/replay.py

  • Update openadapt/visualize.py

  • Update openadapt/events.py

  • Update openadapt/crud.py


Co-authored-by: Richard Abrich <[email protected]> (7aba45b)

v0.5.4 (2023-07-17)

Fix

  • fix(utils): prevent duplicate log messages (#339) (#366)

  • fix(utils): prevent duplicate log messages (#339)

Acquire a lock in utils.configure_logging. Otherwise this function has a race where two threads can both call logger.remove(), and then both call logger.add(), creating two identical sinks.

  • refactor(record): remove redundant configure_logging calls

configure_logging is already called at the module level so there's no need to call it with identical arguments in various functions.

  • fixup! fix(utils): prevent duplicate log messages (#339) (cf1a782)

  • fix: add test fixtures (#356)

  • fix: add test fixtures

  • revert test_summary.py (0ee5397)

v0.5.3 (2023-07-17)

Fix

  • fix: support more objective-c objects (#323)

  • Update _macos.py

  • Update _macos.py

  • Update _macos.py

  • add bug report option

  • Update _macos.py

  • undo formatting

  • refactor

  • split

  • remove debug line

  • Update _macos.py

  • Update _macos.py

  • Update _macos.py

  • Update _macos.py

  • reorganize

  • Update _macos.py

  • Update _macos.py

  • nonetype

  • Update _macos.py (be0774f)

v0.5.2 (2023-07-17)

Chore

  • chore: add isort as pre-commit hook (#319)

  • Add precommit hooks for isort, check-yaml, end-of-file-fixer, trailing-whitespaces

  • Updated README on setting up precommit hooks

  • Add updated poetry.lock

  • Fix step numbering of pre-commit section in README.md (72da341)

Documentation

  • docs: Create Use Case issue template (#324)

  • initial draft

  • new line issue

  • update link

  • address comment

  • add numbers (20fb5a3)

  • docs: update install section of README.md (#344)

  • run poetry lock --no-update

  • fix: update CONTRIBUTING.md

fix typo in 3 words and make pytest code word

  • fix: add required dependencies

  • add seup.md

  • add setup.md

  • remove typo

  • rename temporarily

  • rename to SETUP.md

  • update README to include more documentation on

-- when someone should use the install script vs. follow the steps here?

  • remove requirements.txt

  • add link to installation

  • rename typo: prerequisite

  • link to start: https://openadapt.ai/#start

  • reomve .venv as requirements.txt is no longer used

  • update installation instructions

  • update the Windows Installtion command (in favour of):

  1. https://github.com/OpenAdaptAI/OpenAdaptWeb/pull/30/files#r1252126510
  2. https://github.com/OpenAdaptAI/OpenAdaptWeb/pull/30/files#r1252128457

OpenAdaptAI#344 (comment)

  • address the comment:

https://github.com/OpenAdaptAI/OpenAdapt/pull/344/files#r1252175602

  • add .venv to address the comment:

https://github.com/OpenAdaptAI/OpenAdapt/pull/344/files#r1252172932

and

https://github.com/OpenAdaptAI/OpenAdapt/pull/289/files#r1252150636 (755dd55)

Fix

  • fix: windows.get_active_window() (#333)

  • return top_window of the active app

  • remove runtime exception

  • handle runtime error

  • handle COMerror

  • add logger.warning

  • add logger.warning

  • add get_properties

  • remove unnecessary imports

  • remove -> Desktop

  • monkey patching

  • fix get_properties

  • monkey patch class

  • fix monkey patching

  • format with black (d3f07c9)

Unknown

  • use .env.example for creating .env and removed unnecessary exceptions (3992d1c)

  • Add .env.example and generate env in config.py (2d54e83)

  • update config.SCRUB_ENABLED to False (#373) (3f32883)

  • merge with latest main (04c69b8)

  • delete temp .env if ctrl+c during sharing (e675227)

  • Add missing docstring in db.py (8317634)

  • ran black and update poetry.lock (5e52b5c)

  • Add exception handling when ctrl+c during sharing that deletes db and zip file and reverts db environment. Also add type and return annotations (01eef24)

  • Merge branch 'main' into share-magic-wormhole (1096a15)

v0.5.1 (2023-07-04)

Fix

  • fix: add pympler and psutil (f853839)

v0.5.0 (2023-07-03)

Feature

  • feat: add progress bar in record.py and visualize.py

  • run poetry lock --no-update

  • add alive-progress via poetry and in code

  • add progress bar in visualization

  • add a check for MAX_EVENT = None

  • update the title for the Progress bAr (better for USer pov)

  • update the requirement.txt

  • ran black --line-length 80 &lt;file&gt; on record.py and visualize.py

  • remove all progress bar from record

  • add tqdm progress bar in recrod.py

  • add tqdm for visualiztion

  • remove alive-progress

  • consistent tqdm api

--add dynamic_cols: to enable adjustments when window is resized

Order: --total -description --unit --Optional[bar_format] --colour --dynamic_ncols

  • Update requirements.txt

Co-authored-by: Aaron <[email protected]>

  • Address comemnt: OpenAdaptAI#318 (comment)

  • remove incorrect indent

  • remove rows

  • try to fix distorted table in html

  • add custom queue class

  • lint --line-length 80

  • fix NotImplementedError for MacOs -- using custom MyQueue class

  • rename custom -> thirdparty_customization

  • rename to something useful

  • address comments

  • rename dir to customized_imports

  • rename to extensions OpenAdaptAI#318 (comment)


Co-authored-by: Aaron <[email protected]> (3e12fd4)

v0.4.0 (2023-07-03)

Feature

  • feat(install): download and install MacOS dependencies

  • add messages

  • add download python line

  • created cleanup func

  • helper functions created

  • partially down python downloading

  • python installation script complete

  • added git (and brew)

  • added git (and brew)

  • add tesseract and refactor

  • works on current macbook

  • install python with brew

  • install python with brew

  • check if pyenv is needed

  • merge2

  • merge2

  • simplify brew call

  • finished testing

  • Less output

  • split line

  • Revert adding svg file This reverts commit 5601407207b085c254cf86b2f425be2eddd741c1.

  • remove unnecessary things

  • remove ps1 edit

  • remove ps1 edits

  • make the ps1 the same

  • Remove space

  • add poetry and aesthetic changes

  • small changes

  • add brew to path if needed

  • switch to pip3

  • switch to pip3.10 (25b70c0)

v0.3.1 (2023-07-03)

Fix

  • fix(window): prevent SegmentationFault (cf0fc0b)

v0.3.0 (2023-07-02)

Feature

  • feat(record): memory profiling

  • tracemalloc

  • pympler

  • todo

  • changed position of tracemalloc stats collection

  • updated requirements.txt

  • memory leak fix and cleanup

  • removed todo

  • changed printing to logging

  • alphabetical order

  • changes to tracemalloc usage

  • plot memory usage

  • memory writer terminates with performance writer

  • add MemoryStat table to database

  • remove todo

  • switch from writing/reading memory using file to saving/retrieving from database

  • add memory legend to performance plot

  • prevent error from child processes terminating

  • style changes

  • moved PLOT_PERFORMANCE to config.py

  • only display memory legend if there is memory data

  • moved memory logging into function

  • removed unnecessary call to row2dicts

  • rename memory_usage to memory_usage_bytes

  • replaced alembic revision

  • remove start_time_deltas; minor refactor

  • fix indent


Co-authored-by: Krish Patel <[email protected]> Co-authored-by: Richard Abrich <[email protected]> Co-authored-by: Richard Abrich <[email protected]> (ef0d5eb)

v0.2.0 (2023-07-02)

Documentation

  • docs: contributing

  • Update README.md

  • Update pull_request_template.md

  • Add import order

  • Add Poetry conflicts

  • Add Richard's better import order explanation: (5b9f735)

Feature

  • feat: stop listener

  • created listener for "oa.stop" sequence

  • fixed issue with comparing objects of diff types

  • moved list of sequences to config.STOP_SEQUENCES and changed code to accomadate multiple stop sequences, + minor changes to naming and logging

  • moved list of stop sequences to config.STOP_SEQUENCES

  • filter out stop sequence in crud.get_action_events

  • combined keyboard listeners for macOS compatability

  • style changes

  • code cleanup

  • special char support

  • change to config.STOP_STRS and split by character in record.py and crud.py

  • black

  • add todo and fix special char functionality

  • fix filter_stop_sequences

  • added SPECIAL_CHAR_STOP_SEQUENCES and STOP_SEQUENCES that combines STOP_STRS and SPECIAL_CHAR_STOP_SEQUENCES

  • STOP_SEQUENCES moved to config.py

  • black

  • black (385963c)

Unknown

  • Update config.py (#332) (aa49489)

v0.1.0 (2023-06-29)

Chore

  • chore(release): Use PAT token to bypass branch protection for release github action (#326)

  • feat(release): Initial development version 0.1.0

  • use PAT token to bypass branch protection for release github action (d456bc2)

Documentation

  • docs: Add note on making major release in CONTRIBUTING.md (e097189)

Feature

  • feat(install): install tesseract, remove vcredist (windows)

  • test only tesseract

  • test only tesseract

  • test tesseract only

  • uncomment the last line

  • try to redirect

  • change the description for failed message

  • add OCR

  • test python

  • format function calling

  • Update Description

  • prepare for git test

  • test Git

  • update the VSCppRedistCMD

  • using Write-Host

  • Use ';' for the return command

  • full test

  • add description for all arguments

  • test tesseract on pc with out it

  • fix order for the installtion

  • uncomment the remove-gitinstaller

  • Stop deletion of Openadapt if the pytest fails

  • add the Cleanupfailure parameter to the apt comman

  • make user oriented messages

  • rewrite comments

  • do not exit on pytest fail

  • remove VS C++ Redistributable

  • remove VS C++ installtion consts

  • fix pytest fail exit

  • redirect the output to null

  • rename the param

  • remove unneccessary line

  • try a new powershell window for poetry shell

  • add colours to messages

  • try to fix NSIS error

  • fix file name

  • different approach to fix NSIS

  • different approach to fix tesseract

  • try to fic NSIS error

  • try to fix NSIS error

  • remove line

  • remove uneccssary comment

  • remove unsupported dcostrings

  • remove unused arugs

  • redirect output to null

  • ran poetry lock --no-update to fix the warning

  • Address comment: OpenAdaptAI#312 (comment)

  • Address comment: OpenAdaptAI#312 (comment)

  • Address comment: OpenAdaptAI#312 (comment)

  • imporve resuability and readability

  • remove redirection to null (ddb7d78)

  • feat(release): Initial development version 0.1.0 (#325) (5ab0e01)

Unknown

  • Merge branch 'main' into share-magic-wormhole (088f370)

  • ran black -l 60, and it used call chain (4c59c10)

  • Merge pull request #178 from Mustaballer/publishing-with-pypi

Automatic Publishing with PyPi (a37b62f)

  • restore original db name instead of literal (b801caf)

  • use tempfile in test_share.py and address minor changes (3434a00)

  • moved functions in crud.py to db.py (dafca05)

  • Update CONTRIBUTING.md referring to comments (84b623e)

  • Merge pull request #306 from dianzrong/expand-on-demo-replay-strategy

Fix Summary test (d56dd57)

  • Merge pull request #229 from angelala3252/feat/tracing

Implement tracing (5cdc8fd)

  • Merge pull request #315 from MLDSAI/feat/max_table_str_len

max_table_str_len (c92e2e6)

  • max_table_str_len (4051804)

  • Merge pull request #201 from dianzrong/update

Implement Updating (27b89b7)

  • Merge pull request #313 from MLDSAI/feat/obfuscate_config_logs

config.obfuscate (495a280)

  • don't obfuscate defaults (abac4e5)

  • remove publish action and rename to release.yml (9b340ee)

  • config.obfuscate (79c41f5)

  • ran black (f58fd5f)

  • ran black (2211f78)

  • reformat file and group constants together in config.py (afd9810)

  • Remove unnecessary function and pass test cases (9819330)

  • comments (a87e202)

  • Merge pull request #310 from KrishPatel13/feature/install

Add Tesseract OCR in for powershell script (ac27a79)

  • remove python3.10 as it works on mac not on window (52b0f58)

  • for cosistency remove the paranthesis (47019d6)

  • refresh the path everytime (55b288a)

  • remove uneccessary code (16c18e5)

  • ran format document (acef0be)

  • add function for Vs C++ redist

and beautify hte code for better readability (2029cc4)

  • made a function for git installtion (babe791)

  • remove redundant if condition and also fails on windows: as python3.10 is not a valid command (388ce67)

  • simplify the refresh command (ab56341)

  • fix merge conflict and use better approach for overwriting env (cbee5e8)

  • Merge branch 'main' into share-magic-wormhole (0977859)

  • try resolve merge conflict with poetry.lock (53f11f5)

  • modify export_sql to use paramerterized queries to prevent sql injection (9dc1850)

  • Organize Tesseract Installation (d3f479e)

  • Merge pull request #292 from KrishPatel13/feature/scrub_mp4

Scrubbing for mp4 files (fee2c72)

add pywinauto using poetry (5c443a9)

  • temporary changes to time performance of specific lines (683c3cf)

  • Merge branch 'MLDSAI:main' into feature/scrub_mp4 (8b23e20)

  • Merge branch 'fix/pywinauto' of https://github.com/KrishPatel13/OpenAdapt into fix/pywinauto (fc9755f)

  • add marker for pywinauto and ran poetry update (ee0a8e2)

  • Merge branch 'MLDSAI:main' into fix/pywinauto (224cde1)

  • Merge pull request #297 from dianzrong/expand-on-demo-replay-strategy

Refactored test to use custom replay strategy (767e362)

  • Merge pull request #299 from MLDSAI/abrichr-patch-3

Update README.md (3b72e81)

Update README.md (cf0c339)

  • Update README.md (66c3d70)

  • Merge pull request #207 from 0dm/clear-data

added openadapt.renew (15a5cca)

  • Merge pull request #268 from 0dm/poetry

Use Poetry for dependencies (bde3816)

  • remove license and update readme image (c6f30f1)

  • Merge pull request #204 from jesicasusanto/feat/windowstate_for_windows

Windowstate for windows (f837d62)

  • reorder authors alphabetically, and add placeholder license (983781c)

  • adjusted imports, added to readme (5a75be9)

  • add spacy files (e9d053a)

  • update for nicegui (b20b060)

  • Merge remote-tracking branch 'upstream/main' into poetry (17a12ad)

  • add noqa + newline after docstring (482ab56)

  • add docstring to main (a8fa74f)

  • serialize_rect -> dictify_rect (580c294)

  • split docstrings to be <= 80 chars per line (8f0b179)

  • Merge branch 'publishing-with-pypi' of https://github.com/Mustaballer/puterbot into publishing-with-pypi (567ea8f)

  • Update author list pyproject.toml (1a65973)

  • Merge pull request #266 from dianzrong/add-contributing-md

Update Contributing Templates (8653d0c)

  • Merge branch 'main' into share-magic-wormhole (395fa00)

  • Merge pull request #215 from Mustaballer/github-actions-lint-tests

Github actions for automatic testing and linting (0cd5c54)

  • Merge pull request #272 from KrishPatel13/feature/semantic_scrub

Feature/semantic scrub (a11b76b)

  • add comment for SCRUB_COLOR and remove unused import (e2bcbca)

  • removed test_window (09680c6)

  • Merge branch 'main' into clear-data (ab0c6b3)

  • fix visualizatoin->red color (93b32b8)

  • Merge pull request #169 from jesicasusanto/feat/sam_mixin

add sam_mixin.py (8fd1af7)

  • Merge branch 'main' into feat/sam_mixin (e3b4056)

  • Merge pull request #67 from dianzrong/expand-on-demo-replay-strategy

SummaryReplayStrategyMixin (2c0e860)

  • Merge pull request #135 from 0dm/add-GUI

GUI + Installer (3e1ebb9)

  • turn values into placeholders (40fd85e)

  • fix visualization error:

color must be int or single element tuple (ab4427c)

  • add scrub_cahr for force_scrubbing key char (438b22f)

  • Remove SCRUB_CHAR from config (b6ab737)

  • Merge branch 'main' into github-actions-lint-tests (eba635e)

  • Aesthetic changes to PR template (e5973d4)

  • Removed operators from scrub and changed the test_scrub (d03aae7)

  • Add .idea to gitignore (5a28170)

  • Merge branch 'main' into publishing-with-pypi (cbdf887)

  • Merge branch 'main' into share-magic-wormhole (b4b7879)

  • Merge branch 'MLDSAI:main' into feat/windowstate_for_windows (43ead42)

  • Merge branch 'MLDSAI:main' into feat/sam_mixin (a0f17c3)

  • undo changes (f6e0caf)

  • fix conflict (347eb3d)

  • fix merge conflict (ba4348a)

  • Update pyproject.toml (8871555)

  • Revert "merged changes"

This reverts commit 2066147107c63379ac20cdc95ba3d3fa63fe2603. (12c9243)

  • Revert "remove uneccesary files and"

This reverts commit 806e717049ae4ad76843134c907fa604534b5b28. (fb170e1)

  • Revert "Fix for Visualization"

This reverts commit 6d717f535a15867727065e48d0b7e92c3904204e. (7fc3439)

  • comments (330d999)

  • Update pyproject.toml (d814d8a)

  • added scripts (1eb2085)

  • Update pyproject.toml (853fef2)

  • create pyproject (2e6b487)

  • Request test output (ff8614a)

  • Merge branch 'main' into feat/tracing (70bf019)

  • Merge pull request #248 from dianzrong/add-contributing-md

Make OS Option Optional (6a77a3a)

  • Merge pull request #263 from MLDSAI/abrichr-patch-2

Update README.md (1095399)

  • Update README.md (dd1725b)

  • Add value to feature request (1cd9acc)

  • Simpler bug form (3cd2876)

  • Add <br> (047afce)

  • Update bug_form.yml (9fbd59e)

  • remove optional sections (27072ff)

  • Attempt to add new lines (9630394)

  • Remove optional required sections (6d3ead0)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (794925c)

  • remove uneccesary files and add .idea in .gitignore (806e717)

  • Fix for Visualization (6d717f5)

  • merged changes (2066147)

  • Merge pull request #256 from MLDSAI/abrichr-patch-2

Update README.md (8c1c84b)

  • Update README.md (1123353)

  • Merge pull request #254 from MLDSAI/abrichr-patch-2

Update README.md (fe255ce)

  • Update README.md (af72ed6)

  • Merge pull request #253 from MLDSAI/abrichr-patch-2

Update README.md (a1b5daa)

  • Update README.md (da1dd46)

  • Update new feature template (717a1c1)

  • Make OS optional (fbe5008)

  • Merge pull request #247 from MLDSAI/abrichr-patch-2

Update README.md (912566a)

  • Update README.md (0818046)

  • Merge pull request #245 from MLDSAI/abrichr-patch-1

Update README.md (f1e3ca2)

  • Update README.md (685b20c)

  • Update README.md (19fbab4)

  • Update README.md (0306a38)

  • Update README.md (6524683)

  • Merge remote-tracking branch 'upstream/main' into clear-data (b88fa55)

  • add todo for future improvement (4fb0ba5)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (c54103c)

  • Merge pull request #161 from dianzrong/add-contributing-md

Create CONTRIBUTING.md (f5cbdd2)

  • Merge pull request #241 from 0dm/scrubbing-changes

Scrubbing changes (180a774)

  • Merge pull request #243 from KrishPatel13/update/install

Add TODO in Installation Scripts (7ce0479)

  • add link in TODO (6369256)

  • add TODO: Tesseract OCR installation (5f6610e)

  • Correct typo (386c14f)

  • resolve merge conflicts (df22ff8)

  • Merge pull request #142 from AvidEslami/crop_active_window

Crop Screenshot to fit the Bounds of a WindowEvent (#108 (e3fd5c7)

  • Merge branch 'main' into clear-data (b5fdc81)

  • add black (5501191)

  • requested changes (76b1396)

  • fix window data to have hierarchy (4a58ad4)

  • changes (b20a4d9)

  • false by default (9975a09)

  • Merge remote-tracking branch 'upstream/main' into silence-warnings (3cd8daa)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (df78d57)

  • Add github action bot name and email (1ff6435)

  • Merge pull request #239 from KrishPatel13/main

Fix Pytest (b92309c)

  • Fix Pytest (d399970)

  • rename localfilepicker (bbb3fca)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (0666809)

  • doc: fix incorrect version bump example (281b77c)

  • enqueue log messages to make logging multiprocess-safe (eb3deb0)

  • Merge pull request #211 from KrishPatel13/feature/scrub-final

feat(scrub): Scrubbing and Fix Atomacos (d784d37)

  • Merge pull request #225 from 0dm/pickling_investigation

Use pickle.HIGHEST_PROTOCOL (45b77ce)

  • ran black on scrub.py (5ceea9a)

  • Merge branch 'MLDSAI:main' into feat/windowstate_for_windows (1638d96)

  • add serialize_rect function (b5d9d7e)

  • addressed reviewed comments (075cfff)

  • Add publish action to github, reformat CONTRIBUTING.md, set up git release config pyproject.toml (e63d455)

  • serialize RECT object (d0a0800)

  • Merge branch 'MLDSAI:main' into feature/scrub-final (23b5228)

  • fix get_descendants_info performance (371b7c2)

  • allow for python3 -m openadapt.app (6789dcd)

  • Merge branch 'silence-warnings' into add-GUI (45a651f)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (cc0107f)

  • Merge remote-tracking branch 'upstream/main' into clear-data (b922155)

  • Merge remote-tracking branch 'upstream/main' into silence-warnings (cf3b7ce)

  • Merge remote-tracking branch 'upstream/main' into pickling_investigation (9ea3953)

  • Merge branch 'MLDSAI:main' into feat/tracing (3da5b64)

  • removed indentation since not necessary with logging (65fb226)

  • added tracing for most functions (except those that would be redundant) (e325c2e)

  • Merge branch 'publishing-with-pypi' of https://github.com/Mustaballer/puterbot into publishing-with-pypi (84c2e14)

  • Merge branch 'main' into publishing-with-pypi (89386f3)

  • use repository_username and repository_password instead of pypi_token in release.yml (e19dcfd)

  • Merge pull request #217 from KrishPatel13/install

Add openadapt/install (7db7cc9)

  • add pickle dumps state (28b409f)

  • use highest_protocol (76fb5ec)

  • fix typo (c36f13e)

  • Add CONTRIBUTING.md (871d1e7)

  • merge (9b64cc7)

  • better checks if changes are needed (8e66364)

  • Check if stashing is needed (d564bf4)

  • check if stashing is needed (cf9afa6)

  • added pull request template (bdb3ba8)

  • Copy from closed PR magic wormhole working code and test cases (8c0a78d)

  • add issue template to contributing (92889d9)

  • new feature template and add config to templates (6821222)

  • remove print (192217a)

  • add docstrings (feaf63a)

  • change docstring (5d92e22)

  • remove ws, reduce market point size (d582549)

  • update gitignore (38cf23c)

  • sync branch (7778049)

  • update .gitignore and requirements.txt (f7e2517)

  • fix inaccurate mask by adding more input points (90be2d1)

  • black sam.py (abcd31d)

  • remove unnecessary lines of code (ad39a80)

  • added test for to check for duplicate descendants (fe0c267)

  • def get_descendants_info (40ed70b)

  • use regex for excluding src and alembic directories (74e58c2)

  • exclude src from black check (9c2daa0)

  • Try Krish approach for failing dependency in requirements.txt (2460ca3)

  • add version to black, and moved around in requirements.txt (ce320b6)

  • use config file (8c70f6f)

  • use config.DB_FPATH (b7ed43e)

  • Update CONTRIBUTING.md with issues (c9fab2f)

  • renamed the template folder (d595c35)

  • Rename bug_form.yaml to bug_form.yml (598efe0)

  • Initial bug form (22dd66d)

  • improve formatting (bbbfde9)

  • refactor openadapt to OpenAdapt (853331b)

  • puterbot -> openadapt (aa6e5a3)

  • remove optional scrubbing for images for now (ad01102)

  • organized the requirements.txt (392a465)

  • created mock unit test (e505888)

  • fixed recording stop button (a680c4d)

  • save & sync switch states (e3732a3)

  • suggestions implemented (a61c812)

  • remove unused file (56d3cff)

  • fic utils.py L477 Todo (f495c4c)

  • add openadapt/install add install_openadapt.ps1 (from OpenAdaptAi/install repo) add install_openadapt.sh (from OpenAdaptAi/install repo) update spacy model from _lg to _trf (760be83)

  • fix main (c4edfef)

  • change state to include all props (86766ef)

  • Merge branch 'clear-data' into add-GUI (f165494)

  • remove commented line (93e9ba1)

  • added changes from review, fixed pyinstaller (77818ec)

  • Exclude migration files in black check and lint checks (d4c4b7a)

  • code reformating (389d373)

  • add scrubbing features (dab2967)

  • Copied main.yml from closed PR, and replaced reST doctsring style with Google Python Style (a9a062a)

  • scrubbing in diff images (37968e5)

  • refactor

added some comments and moved to scripts/reset_db.py (b728c98)

  • remove blank lines (318c344)

  • resolves a TODO in utils Moved DIRNAME_PERFORMANCE_PLOTS = "performance" in config (f72de4c)

  • Added function docstrings

fix typo is_seperated (d5b303d)

  • moved the text_sep, prefix and suffix from models.py to config also move language to config also moves the masking char to scrub (c69caf3)

  • Added Testing Section (8ec83b0)

  • purely summarizes now (f197253)

  • Update Readme convert back all hyphenated and scrubbed text back to hyphenated form (99bbb9a)

  • ran black, flake-8 and pylint (89430e2)

  • 255 -> (255,) single element tuple (80edc68)

  • implement get_active_element_state(x, y) (113933e)

  • Merge branch 'feat/windowstate_for_windows' of https://github.com/jesicasusanto/PAT into feat/windowstate_for_windows (37da667)

  • implement get_window_state() (97a9eba)

  • add .db-journal in .gitignore (03c1fc0)

  • fixed 255 -> (255,0,0) in config due to failing test (faab021)

  • Scrubbing Before Visualization Final Version (1296995)

  • make action_event a required parameter (df80ac0)

  • Refactored start.py to increase Python usage (c5ff8b7)

  • encapsulated into method "run_app" (25d82b5)

  • Added semantic release tool to pyproject.toml and updated github action (97863ee)

  • switch approach to incorporate scale_ratios (376cc66)

  • last line may need to be changed (fe77bb9)

  • Changed the update file to be a python file (b29905a)

  • added openadapt.renew (f6fba8a)

  • trying to fix the scrubbing configurations (b4a3b60)

  • Add scrub module Add test_scrub module Add Scrubbing config in config.py Add presidio and required packages in requirements.txt (ce67fd1)

  • allow window_event to be passed, if not passed retrieve from action_event relationship (2cafcf3)

  • Merge branch 'MLDSAI:main' into crop_active_window (69642a4)

  • Merge branch 'MLDSAI:main' into feat/windowstate_for_windows (e26c201)

  • implement get_active_window_meta() (3ec8b1f)

  • Create update.sh

Initial commit (b909b8d)

  • remove newline (e044d13)

  • more configurable (400370c)

  • Merge branch 'silence-warnings' into add-GUI (33f8cc9)

  • added filter for loguru (b534bc4)

  • add SHOW_PLOTS (8ea9773)

  • add RESIZE_RATIO (f221598)

  • undo whitespace (ce3bcbf)

  • removed code for testing (e63ae6b)

  • removed code for testing (56ae587)

  • fixed sam.py (a0989b6)

  • fixed indent and added visualization (ba40792)

  • Remove unnecessary changes (6b8a564)

  • Merge pull request #191 from MLDSAI/abrichr-patch-1

Update config.py (2bbe036)

  • Update config.py (d615950)

  • Merge pull request #122 from MLDSAI/feat/save-event-performance

Save performance data to db (5ce11ea)

  • migration (04cb8db)

  • fix (d2eaed3)

  • fix (60de470)

  • fixes (e0a1b23)

  • Merge branch 'main' into feat/save-event-performance (b576793)

  • Merge branch 'main' into feat/save-event-performance (f31d094)

  • fixes (4aca87d)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (bfd4af7)

  • add PerformanceStat alembic migration script (7130b49)

  • Merge pull request #182 from MLDSAI/abrichr-patch-1

Update README.md (08dac61)

  • Update README.md (a0e8b71)

  • Merge pull request #120 from atineoSE/macOS_improvements

MacOS improvements (20976c5)

  • documentation (e1d4496)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (c5cb169)

  • Merge branch 'main' into macOS_improvements (0d40517)

  • Merge pull request #179 from MLDSAI/abrichr-patch-1

Update README.md (75041fc)

  • Update README.md (c27fc3b)

  • Updated README with hosted image instead of relative image for visualize.py (f498c7d)

  • Added github actions for automatic publishing when releasing a new version (059651e)

  • Create pyproject.toml config using Test PyPi (686505d)

  • Merge pull request #176 from MLDSAI/fix/window

wrap with try/except (2777019)

  • import pickle (be6e7e0)

  • revert; try pickling (3fcbb17)

  • try except in trigger_action_event (cba2573)

  • wrap with try/except (a457f50)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (8fc3d40)

  • remove unnecessary imports (a87f667)

  • remove unnecessary imports (95c9aa9)

  • add bbox functions (66a28a8)

  • Merge branch 'MLDSAI:main' into feat/sam_mixin (6b6b287)

  • Merge pull request #151 from MLDSAI/feat/window_state

Window state (4ea4ba8)

Updated README to note trackpad/touchpad limitations (fe8be21)

  • add sam_Mixin (8f2d67e)

  • create sam_mixin (63a569f)

  • modularization + fixes (f9b7029)

  • Add Github Action info

Added the exact linter used in the GitHub Action (23ca868)

  • implemented pyinstaller (fa43c57)

  • added file picker for import

todo: work on export (03b5295)

  • Merge remote-tracking branch 'upstream/main' into add-GUI (062cde9)

  • Create CONTRIBUTING.md

Rough draft (20abe2a)

  • Add instructions for troubleshooting (cf1bee4)

  • Improve description (1346f09)

  • Add information on how to set up permissions on macOS (a7c0ad9)

  • Ignore packages in editable mode (e0df478)

  • Add missing dependencies and import pynput in editable mode (907b6de)

  • deprecate old ui, add import/export recording (c8ad9fe)

  • Reformatted limitations in the README and added that most touchpad and trackpad gestures aren't supported (88aecca)

  • working StatefulReplayStrategy (fc8cb2a)

  • share button

could use it for exporting? or just sharing openadapt (a95661f)

code needs a little bit of clean up but is functional (359fbaf)

#109 renamed all instances of puterbot to openadapt (754b854)

  • MAX_TABLE_CHILDREN (b8481ee)

  • save window state (mac) (99dc235)

  • Merge branch 'MLDSAI:main' into expand-on-demo-replay-strategy (1f09c07)

  • Fixed initializer (13a930b)

  • small error with initializer (fbc2486)

  • Merge branch '#109' into add-GUI (09d1303)

  • resolved merge conflict (8508583)

  • Merge remote-tracking branch 'upstream/main' into #109 (3bd935c)

  • Revert "Merge branch 'main' into #109"

This reverts commit cb5373b6238b91c4576aca04228f3c416c1f5e6e, reversing changes made to 796e35a2ccf7c12df3b20a5903355ab4d07ab68a. (605e3fb)

  • Merge branch 'main' into #109 (cb5373b)

  • Created tests for the helper functions in summary_mixin.py (3895474)

  • Moved SummaryReplayStrategyMixin up (8aab461)

  • Formatting changes and changed ascii text to only contain words (becb3a8)

  • Additional formatting changes (e0ddbe8)

  • Used black and the Google Python style guide to imrpove formatting. (2dcf6cd)

  • Removed finding the last screenshot (a0ead1f)

  • Merge pull request #119 from 0dm/#103

#103 : Rename InputEvent(s) to ActionEvent(s) (27efb0a)

  • Update app.py

added logo button (8220fe4)

  • Add Functioning GUI

requires tkinter (c2db59d)

  • #103 : Refactor InputEvent => ActionEvent (7e537d4)

  • Revert "resolved #103"

This reverts commit b7c99373fb35e54f7e2efdafa09baa5aa818992c. (659b9d7)

  • Add newline (0844f9c)

  • Merge remote-tracking branch 'upstream/main' into #109 (796e35a)

  • Use _insert for writing perf stats to db (1564d56)

  • Merge pull request #129 from MLDSAI/fix/prompt_truncation

fix prompt truncation; fix diff_mask (0ab8213)

  • fix prompt truncation; fix diff_mask (dd045ef)

  • #109 renamed all instances of puterbot to openadapt (0e4e0ca)

  • Revert performance plot to off by default (c1cb8de)

  • Save event performances data. Closes #85 Fixes #93 (8ced5bd)

  • Merge pull request #121 from MLDSAI/abrichr-patch-1

Update README.md (4f22e89)

  • Update README.md (447969d)

  • resolved #103

🔨 (b7c9937)

  • Merge pull request #115 from MLDSAI/abrichr-patch-1

Update README.md (3f310d0)

  • Update README.md (089295e)

  • Merge pull request #110 from MLDSAI/abrichr-patch-1

Update README.md (2aa96d2)

  • Update README.md (1566cdf)

  • Merge remote-tracking branch 'upstream/main' (b49d1cd)

  • Merge pull request #107 from MLDSAI/abrichr-patch-1

Update README.md (e944074)

  • Update README.md (e0ed5fa)

  • Merge pull request #106 from MLDSAI/abrichr-patch-1

Update README.md (9eb420d)

  • Update README.md (793ef07)

  • Merge pull request #101 from MLDSAI/abrichr-patch-1

Update README.md (02b718c)

fastapi on localhost (cdaee2a)

  • Update README.md (29419e1)

  • Integrated SummaryReplayStrategyMixin into the DemoReplayStrategy (e6c67fb)

  • Refactored into a into a SummaryReplayStrategyMixin. Am open to changing the function parameters of get_summary and what attributes SummaryReplayStrategyMixin has (2116cf6)

  • Small type change (fad5430)

  • Removed print statements (b897ac8)

  • Added the needed libraries for DemoReplayStrategy (9c570fd)

  • Changed the method in which the OCR and ASCII texts are summarized and compared. (0a53330)

  • Changed the way window_changed was added (626c209)

  • Fixed error (d4968b6)

  • Merge remote-tracking branch 'origin/main' (33ee2d5)

  • Used ASCII to check the summarization of the OCR text (f34cec2)

  • Merge branch 'MLDSAI:main' into main (daaf679)

  • Used the OCR text to note in the prompt to add a note at the front of the string to indicate whether the screen changed (f5e935d)

  • Update README.md (17f8e64)

  • Update README.md (d37b157)

  • Update README.md (02cfb5a)

  • Merge pull request #31 from MLDSAI/fix/sys_platform

pywin32 on windows only (76aa27b)

  • pywin32 on windows only (228a4b3)

  • get_screenshot -> take_screenshot (18327f0)

  • Update README.md (8a563bb)

  • rename completion_history -> result_history (6892cf4)

  • add InputEvent.str; improve demo (549ef67)

  • Merge pull request #25 from MLDSAI/feat/ascii

add ascii_mixin.py (cb28427)

refactor screenshots (da13e5f)

  • Screenshot.take_screenshot; fix fps (0657e43)

  • refactor screenshots (f34c5f6)

  • Merge pull request #21 from MLDSAI/feat/llm_ocr_demo

add llm_ocr_demo.py and related mixins (09e36f8)

add round_timestamps (601208c)

  • NUM_TIMESTAMP_DIGITS=6 (74b2410)

  • read/write properties instead of globals in NaiveReplayStrategy (5828baa)

  • add round_timestamps (2e2e2a7)

  • Update README (fd7e825)

  • update visualize.png (d486d6f)

  • update README (eaa76a7)

  • Merge pull request #18 from MLDSAI/feat/replay_strategies

Add puterbot/strategies (a75665b)

  • Merge branch 'main' into feat/replay_strategies (76097e4)

  • add missing pywin32 (91942a3)

  • update README (44cafc4)

  • Update README and docs (7969e98)

  • add assets/visualize.png; add back_populates; update README (4461031)

  • Add puterbot/strategies (a7ce3e8)

  • Update README.md (f8f3438)

  • Update README.md (6ec32b6)

  • Merge pull request #16 from MLDSAI/feat/task_description

add Recording.task_description; recording.py types and documentation (0325fc3)

  • add Recording.task_description; recording.py types and documentation (0299a05)

  • Update README.md (93bfdf9)

  • Update README.md (b69a3b7)

  • Merge pull request #10 from MLDSAI/ag23

Update README (91c57f0)