Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PDF and DOCX support in Write File - Feature Improvement, close #548 #928

Merged
merged 18 commits into from
Aug 25, 2023

Conversation

Arkajit-Datta
Copy link
Contributor

@Arkajit-Datta Arkajit-Datta commented Jul 30, 2023

Description

The Write File Tool can now support writing the results and discussions in a PDF or a DOCX file, with proper formatting and images embedded.

Related Issues

#548

Solution and Design

  1. Libraries called pdfkit and htmldocx are being leveraged to do the writing process.
  2. The content initially used to be stored in a Txt file using the write tool is formatted and styled through an HTML file using an LLM.
  3. Images generated by the agent are extracted and embedded in the same HTML file.
  4. This HTML file is now stored in various formats like PDF & DOCX.

Test Plan

  1. Asking the Agent to store the results in a PDF or DOCX file.
  2. Navigate to the workspace folder to find the generated PDF or DOCX.

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Docs update

Checklist

  • My pull request is atomic and focuses on a single change.
  • I have read the contributing guide and my code conforms to the guidelines.
  • I have documented my changes clearly and comprehensively.
  • I have added the required tests.

@CLAassistant
Copy link

CLAassistant commented Jul 30, 2023

CLA assistant check
All committers have signed the CLA.

@Arkajit-Datta
Copy link
Contributor Author

@TransformerOptimus @luciferlinx101 @Fluder-Paradyne can you please review this PR. Thanx!

@Arkajit-Datta Arkajit-Datta reopened this Aug 10, 2023
@Arkajit-Datta
Copy link
Contributor Author

Hey @TransformerOptimus , @Fluder-Paradyne , @luciferlinx101 . I have fixed the image generation tool update bug. Now the images are again getting embedded whenever generated. Have checked the whole flow. Please review the current changes. Thanks a lot!

@Phoenix2809
Copy link
Contributor

Just tested this out, tried saving files as a PDF and as DOCX. It's exporting as a HTML. I had asked the agent to save it as a PDF or DOCX but the final output was in HTML.

@codecov
Copy link

codecov bot commented Aug 24, 2023

Codecov Report

Patch coverage: 38.33% and project coverage change: -0.28% ⚠️

Comparison is base (0ea717b) 58.50% compared to head (3c0a578) 58.22%.
Report is 5 commits behind head on dev.

Additional details and impacted files
@@            Coverage Diff             @@
##              dev     #928      +/-   ##
==========================================
- Coverage   58.50%   58.22%   -0.28%     
==========================================
  Files         206      206              
  Lines        9654     9755     +101     
  Branches     1016     1029      +13     
==========================================
+ Hits         5648     5680      +32     
- Misses       3741     3808      +67     
- Partials      265      267       +2     
Files Changed Coverage Δ
superagi/tools/tool_response_query_manager.py 43.75% <ø> (ø)
superagi/tools/file/write_file.py 40.74% <28.35%> (-53.38%) ⬇️
superagi/resource_manager/file_manager.py 47.93% <48.00%> (-2.67%) ⬇️
superagi/models/agent_execution_feed.py 70.96% <100.00%> (ø)
...ols/image_generation/stable_diffusion_image_gen.py 83.92% <100.00%> (-0.29%) ⬇️

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@Fluder-Paradyne Fluder-Paradyne merged commit 8b01357 into TransformerOptimus:dev Aug 25, 2023
2 of 5 checks passed
Fluder-Paradyne added a commit that referenced this pull request Sep 27, 2023
* fix

* fixing the toolkit config in iteration workflow

* List file s3 fix (#1076)

* List File S3

* Unit Test Added

---------

Co-authored-by: Taran <[email protected]>

* workflow changes

* minor seed file fix

* frontend fixes (#1079)

* fixed api_bug (#1080)

* add one condition (#1082)

* api fix (#1087)

* Tools error fix (#1093)

* webhooks frontend + api calls complete almost

* Tool-LTM(Updated) (#1039)

* Toolkit configuration fix (#1102)

* webhooks compplete frontend

* schedule agent fix (#1104)

Co-authored-by: Rounak Bhatia <[email protected]>

* Models superagi (#936)

Models Superagi

* Models superagi (#1108)

Bug Fixes

* Changes for no receiver address

* made changes to github helper

* Models superagi (#1112)

* Models superagi (#1117)

* Models fixes (#1118)

* Models Frontend Changes

* Models Frontend Changes

* Models Frontend Changes

* \n bug resolved (#1122)

* PDF and DOCX support in Write File - Feature Improvement, close #548 (#928)

* Added functions to write various file types and a file handler too

* FileManager updated to handle and save HTMLs.

* adding PDF + DOCX support to save images

* Added Wkhtmltopdf package installation run commands in docker

* Added get_all_responses feature for extractng the response for particular tools

* Added Image embedding feature, this will extract and embed the images generated by the agent during the run

* renaming functions and refactoring

* renaming functions and refactoring

* Update Dockerfile

* removing unsused classmethods

* Finding generated images and attached files in the write tool. Images are fetched inorder to be embedded in the respective file type.

* Adding the filename and paths to the Resource Manager S3 storage

* Code Cleanup

* added logger: Fix for the failing TEST

---------

Co-authored-by: Fluder-Paradyne <[email protected]>

* Revert "PDF and DOCX support in Write File - Feature Improvement, close #548 (#928)" (#1124)

This reverts commit 8b01357.

* expose port

* latest safetensors breaking in macs (#1134)

* Changes in save template  (#1120)

* fix

* changes in save template

* changes in save template

* bug fixes

* changes in save template

* changes in save template

---------

Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: namansleeps <[email protected]>

* Main to dev sync (#1139)

* Models fixes (#1126)

* Models Frontend Changes

* Models Frontend Changes

* Models Frontend Changes

* Backend Compatibility for New/Existing users on local

* DEV api key requirements

* removing print statements

* removing print statements

* removing print statements

* removing print statements

* backend compatibility

* backend compatibility

* backend compatibility

* added filters in the webhooks

* fix

* added filters in the webhooks

* Models fixes (#1145)

Fixes related to Models Feature

* Jira Bug Fix

* Jira Bug Fix 2.0

* Jira Bug Fix 3.0

* added filters in the webhooks

* Models fixes (#1147)

Model Feature Fixes

* Bug fix model redirection (#1148)

Bug Fix - Model URL Redirection

* added tool config for dalle

* removed model dependency on dalle tool

* Remove hardcoded creds

* fixed env error

* removed refactoring from main

* removed refactoring

* removed refactoring

* handled error

* stop agent from executing if model is not found (#1156)

* entity details (#1158)

* Metric frontend (#1152)

* added filters in webhooks

* added filters in webhooks

* minor changes

* webhooks complete

* minor changes for PR

* minor changes for PR

* Publish agent template to marketplace (#1106)


* publish agent to marketplace

---------

Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: namansleeps <[email protected]>

* added filters in webhooks

* added filters in webhooks

* resolving conflicts

* added filters in the webhooks

* lint issue fixed

* bug fix of prev PR

* fix for new run and edit agent

* error handling

* added filters in webhooks

* fix for knowledge search tool

* Docker digitalocean deployment

* changed branch name

* added filters in the webhooks

* changes

* removed region

* added button

* change in branch

* added filters in the webhooks

* Update conftest.py

* Added filters in the webhooks (#1140)

* webhooks frontend + web hooks with filters

---------

Co-authored-by: namansleeps <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>

* Models calls logs dev (#1174)

Call logs organisation level bug fix

* models scroll fix, format of log timestamp fix, adding of loader to models, toolkit metrics dropdown bug fixed, publish agent dropdown bug (#1171)

* Update app.yaml (#1179)

* fixes related to webhooks

* fixes for webhooks

* Fixes for webhooks (#1181)



* fixes for webhooks

---------

Co-authored-by: namansleeps <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>

* bugs by qa (#1178)

* Fix for schedule agent (#1184)

Co-authored-by: Tarraann <[email protected]>

* Entity fix (#1185)

* fixes for webhooks

* fixes for webhooks

* fix added for index state (#1188)

* fix added for index state

* Update KnowledgeTemplate.js

---------

Co-authored-by: Tarraann <[email protected]>

* API bug fixes for SDK (#1189)

* fix api's for sdk

* removed unused imports

---------

Co-authored-by: jagtarcontlo <[email protected]>

* Main to dev sync v12 (#1193)

sync back to dev

------
Co-authored-by: Taran <[email protected]>
Co-authored-by: TransformerOptimus <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>
Co-authored-by: Maverick-F35 <[email protected]>
Co-authored-by: BoundlessAsura <[email protected]>
Co-authored-by: Akshat Jain <[email protected]>
Co-authored-by: sayan1101 <[email protected]>
Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: Kalki <[email protected]>
Co-authored-by: Tarraann <[email protected]>
Co-authored-by: rakesh-krishna-a-s <[email protected]>
Co-authored-by: Captain Levi <[email protected]>
Co-authored-by: andrew-kelly-neutralaiz <[email protected]>
Co-authored-by: James Wakelim <[email protected]>

* added button

* GitHub pull request tools (#1190)

* adding github review tools

* cleanup and adding code review prompt

* fixing comments

* PDF and DOCX support in Write File - Feature Improvement, close #548 (#1125)

Co-authored-by: Fluder-Paradyne <[email protected]>
Co-authored-by: Abhijeet <[email protected]>

* minor documentation fix

* Design bugs (#1199)

* fetching token limit from db

* Revert "PDF and DOCX support in Write File - Feature Improvement, close #548 (#1125)" (#1202)

This reverts commit 26f6a1d.

* Unit Test Fix (#1203)

* adding of docs and and discord link correction (#1205)

* openai error handling

* error_handling

* api call only when agent is running

* Feature : Wait block for agent workflow (#1186)

Agent Wait Block Step

* minor changes (#1213)

Co-authored-by: Jagtar Saggu <[email protected]>

* error handling

* error handling

* error handling

* error handling

* error handling

* fix

* fix

* fix

* error handling

* models changes (#1207)

Model related frontend changes.

* error handling

* models marketplace changes (#1219)

Co-authored-by: Abhijeet <[email protected]>

* minor changes

* error handling

* error handling

* removing single qoutes (#1224)

Co-authored-by: namansleeps <[email protected]>

* apm changes (#1222)

APM Bug Fixes

* list tool fix

* list tool fix

* PR CHANGES

* entity fix for dev (#1230)

Entity Fix for Dev

* frontend changes (#1231)

* read_tool_fix

* fix

* waiting block frontend (#1233)

Waiting Block Changes and Frontend Addition

* Dev Fixes (#1242)

* read tool fix

* Maintaining dev (#1244)

Dev Fix

* added logs (#1246)

* error_handling fix (#1247)

Error handling fix.

* Feature first login src (#1241)

Adding source in user database for analytics.

* apollo NoneType bug fix (#1238)

Bug Fix

* Mixpanel integration (#1256)

Mix Panel

* Models Marketplace bug fix for dev (#1266)

* Fix 1257 dev (#1269)

Bug Fix

* add cache layer (#1275)

Added package caching for github actions workflow

* Fix api dev (#1283)

* save other config to agent_execution config

* add config

* mixpanel changes (#1285)

* revert README.MD

* rename error_handling.py to error_handler.py (#1287)

---------

Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: TransformerOptimus <[email protected]>
Co-authored-by: Abhijeet <[email protected]>
Co-authored-by: Taran <[email protected]>
Co-authored-by: Maverick-F35 <[email protected]>
Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: namansleeps <[email protected]>
Co-authored-by: Aditya Sharma <[email protected]>
Co-authored-by: Sayan Samanta <[email protected]>
Co-authored-by: Kalki <[email protected]>
Co-authored-by: Tarraann <[email protected]>
Co-authored-by: Arkajit Datta <[email protected]>
Co-authored-by: jagtarcontlo <[email protected]>
Co-authored-by: Captain Levi <[email protected]>
Co-authored-by: namansleeps <[email protected]>
Co-authored-by: I’m <[email protected]>
Co-authored-by: Jagtar Saggu <[email protected]>
dungnmaster pushed a commit to dungnmaster/SuperAGI-EvaDB that referenced this pull request Sep 29, 2023
* fix

* fixing the toolkit config in iteration workflow

* List file s3 fix (TransformerOptimus#1076)

* List File S3

* Unit Test Added

---------

Co-authored-by: Taran <[email protected]>

* workflow changes

* minor seed file fix

* frontend fixes (TransformerOptimus#1079)

* fixed api_bug (TransformerOptimus#1080)

* add one condition (TransformerOptimus#1082)

* api fix (TransformerOptimus#1087)

* Tools error fix (TransformerOptimus#1093)

* webhooks frontend + api calls complete almost

* Tool-LTM(Updated) (TransformerOptimus#1039)

* Toolkit configuration fix (TransformerOptimus#1102)

* webhooks compplete frontend

* schedule agent fix (TransformerOptimus#1104)

Co-authored-by: Rounak Bhatia <[email protected]>

* Models superagi (TransformerOptimus#936)

Models Superagi

* Models superagi (TransformerOptimus#1108)

Bug Fixes

* Changes for no receiver address

* made changes to github helper

* Models superagi (TransformerOptimus#1112)

* Models superagi (TransformerOptimus#1117)

* Models fixes (TransformerOptimus#1118)

* Models Frontend Changes

* Models Frontend Changes

* Models Frontend Changes

* \n bug resolved (TransformerOptimus#1122)

* PDF and DOCX support in Write File - Feature Improvement, close TransformerOptimus#548 (TransformerOptimus#928)

* Added functions to write various file types and a file handler too

* FileManager updated to handle and save HTMLs.

* adding PDF + DOCX support to save images

* Added Wkhtmltopdf package installation run commands in docker

* Added get_all_responses feature for extractng the response for particular tools

* Added Image embedding feature, this will extract and embed the images generated by the agent during the run

* renaming functions and refactoring

* renaming functions and refactoring

* Update Dockerfile

* removing unsused classmethods

* Finding generated images and attached files in the write tool. Images are fetched inorder to be embedded in the respective file type.

* Adding the filename and paths to the Resource Manager S3 storage

* Code Cleanup

* added logger: Fix for the failing TEST

---------

Co-authored-by: Fluder-Paradyne <[email protected]>

* Revert "PDF and DOCX support in Write File - Feature Improvement, close TransformerOptimus#548 (TransformerOptimus#928)" (TransformerOptimus#1124)

This reverts commit 8b01357.

* expose port

* latest safetensors breaking in macs (TransformerOptimus#1134)

* Changes in save template  (TransformerOptimus#1120)

* fix

* changes in save template

* changes in save template

* bug fixes

* changes in save template

* changes in save template

---------

Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: namansleeps <[email protected]>

* Main to dev sync (TransformerOptimus#1139)

* Models fixes (TransformerOptimus#1126)

* Models Frontend Changes

* Models Frontend Changes

* Models Frontend Changes

* Backend Compatibility for New/Existing users on local

* DEV api key requirements

* removing print statements

* removing print statements

* removing print statements

* removing print statements

* backend compatibility

* backend compatibility

* backend compatibility

* added filters in the webhooks

* fix

* added filters in the webhooks

* Models fixes (TransformerOptimus#1145)

Fixes related to Models Feature

* Jira Bug Fix

* Jira Bug Fix 2.0

* Jira Bug Fix 3.0

* added filters in the webhooks

* Models fixes (TransformerOptimus#1147)

Model Feature Fixes

* Bug fix model redirection (TransformerOptimus#1148)

Bug Fix - Model URL Redirection

* added tool config for dalle

* removed model dependency on dalle tool

* Remove hardcoded creds

* fixed env error

* removed refactoring from main

* removed refactoring

* removed refactoring

* handled error

* stop agent from executing if model is not found (TransformerOptimus#1156)

* entity details (TransformerOptimus#1158)

* Metric frontend (TransformerOptimus#1152)

* added filters in webhooks

* added filters in webhooks

* minor changes

* webhooks complete

* minor changes for PR

* minor changes for PR

* Publish agent template to marketplace (TransformerOptimus#1106)


* publish agent to marketplace

---------

Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: namansleeps <[email protected]>

* added filters in webhooks

* added filters in webhooks

* resolving conflicts

* added filters in the webhooks

* lint issue fixed

* bug fix of prev PR

* fix for new run and edit agent

* error handling

* added filters in webhooks

* fix for knowledge search tool

* Docker digitalocean deployment

* changed branch name

* added filters in the webhooks

* changes

* removed region

* added button

* change in branch

* added filters in the webhooks

* Update conftest.py

* Added filters in the webhooks (TransformerOptimus#1140)

* webhooks frontend + web hooks with filters

---------

Co-authored-by: namansleeps <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>

* Models calls logs dev (TransformerOptimus#1174)

Call logs organisation level bug fix

* models scroll fix, format of log timestamp fix, adding of loader to models, toolkit metrics dropdown bug fixed, publish agent dropdown bug (TransformerOptimus#1171)

* Update app.yaml (TransformerOptimus#1179)

* fixes related to webhooks

* fixes for webhooks

* Fixes for webhooks (TransformerOptimus#1181)



* fixes for webhooks

---------

Co-authored-by: namansleeps <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>

* bugs by qa (TransformerOptimus#1178)

* Fix for schedule agent (TransformerOptimus#1184)

Co-authored-by: Tarraann <[email protected]>

* Entity fix (TransformerOptimus#1185)

* fixes for webhooks

* fixes for webhooks

* fix added for index state (TransformerOptimus#1188)

* fix added for index state

* Update KnowledgeTemplate.js

---------

Co-authored-by: Tarraann <[email protected]>

* API bug fixes for SDK (TransformerOptimus#1189)

* fix api's for sdk

* removed unused imports

---------

Co-authored-by: jagtarcontlo <[email protected]>

* Main to dev sync v12 (TransformerOptimus#1193)

sync back to dev

------
Co-authored-by: Taran <[email protected]>
Co-authored-by: TransformerOptimus <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>
Co-authored-by: Maverick-F35 <[email protected]>
Co-authored-by: BoundlessAsura <[email protected]>
Co-authored-by: Akshat Jain <[email protected]>
Co-authored-by: sayan1101 <[email protected]>
Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: Kalki <[email protected]>
Co-authored-by: Tarraann <[email protected]>
Co-authored-by: rakesh-krishna-a-s <[email protected]>
Co-authored-by: Captain Levi <[email protected]>
Co-authored-by: andrew-kelly-neutralaiz <[email protected]>
Co-authored-by: James Wakelim <[email protected]>

* added button

* GitHub pull request tools (TransformerOptimus#1190)

* adding github review tools

* cleanup and adding code review prompt

* fixing comments

* PDF and DOCX support in Write File - Feature Improvement, close TransformerOptimus#548 (TransformerOptimus#1125)

Co-authored-by: Fluder-Paradyne <[email protected]>
Co-authored-by: Abhijeet <[email protected]>

* minor documentation fix

* Design bugs (TransformerOptimus#1199)

* fetching token limit from db

* Revert "PDF and DOCX support in Write File - Feature Improvement, close TransformerOptimus#548 (TransformerOptimus#1125)" (TransformerOptimus#1202)

This reverts commit 26f6a1d.

* Unit Test Fix (TransformerOptimus#1203)

* adding of docs and and discord link correction (TransformerOptimus#1205)

* openai error handling

* error_handling

* api call only when agent is running

* Feature : Wait block for agent workflow (TransformerOptimus#1186)

Agent Wait Block Step

* minor changes (TransformerOptimus#1213)

Co-authored-by: Jagtar Saggu <[email protected]>

* error handling

* error handling

* error handling

* error handling

* error handling

* fix

* fix

* fix

* error handling

* models changes (TransformerOptimus#1207)

Model related frontend changes.

* error handling

* models marketplace changes (TransformerOptimus#1219)

Co-authored-by: Abhijeet <[email protected]>

* minor changes

* error handling

* error handling

* removing single qoutes (TransformerOptimus#1224)

Co-authored-by: namansleeps <[email protected]>

* apm changes (TransformerOptimus#1222)

APM Bug Fixes

* list tool fix

* list tool fix

* PR CHANGES

* entity fix for dev (TransformerOptimus#1230)

Entity Fix for Dev

* frontend changes (TransformerOptimus#1231)

* read_tool_fix

* fix

* waiting block frontend (TransformerOptimus#1233)

Waiting Block Changes and Frontend Addition

* Dev Fixes (TransformerOptimus#1242)

* read tool fix

* Maintaining dev (TransformerOptimus#1244)

Dev Fix

* added logs (TransformerOptimus#1246)

* error_handling fix (TransformerOptimus#1247)

Error handling fix.

* Feature first login src (TransformerOptimus#1241)

Adding source in user database for analytics.

* apollo NoneType bug fix (TransformerOptimus#1238)

Bug Fix

* Mixpanel integration (TransformerOptimus#1256)

Mix Panel

* Models Marketplace bug fix for dev (TransformerOptimus#1266)

* Fix 1257 dev (TransformerOptimus#1269)

Bug Fix

* add cache layer (TransformerOptimus#1275)

Added package caching for github actions workflow

* Fix api dev (TransformerOptimus#1283)

* save other config to agent_execution config

* add config

* mixpanel changes (TransformerOptimus#1285)

* revert README.MD

* rename error_handling.py to error_handler.py (TransformerOptimus#1287)

---------

Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: TransformerOptimus <[email protected]>
Co-authored-by: Abhijeet <[email protected]>
Co-authored-by: Taran <[email protected]>
Co-authored-by: Maverick-F35 <[email protected]>
Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: namansleeps <[email protected]>
Co-authored-by: Aditya Sharma <[email protected]>
Co-authored-by: Sayan Samanta <[email protected]>
Co-authored-by: Kalki <[email protected]>
Co-authored-by: Tarraann <[email protected]>
Co-authored-by: Arkajit Datta <[email protected]>
Co-authored-by: jagtarcontlo <[email protected]>
Co-authored-by: Captain Levi <[email protected]>
Co-authored-by: namansleeps <[email protected]>
Co-authored-by: I’m <[email protected]>
Co-authored-by: Jagtar Saggu <[email protected]>
Fluder-Paradyne added a commit that referenced this pull request Oct 25, 2023
* fix

* fixing the toolkit config in iteration workflow

* List file s3 fix (#1076)

* List File S3

* Unit Test Added

---------

Co-authored-by: Taran <[email protected]>

* workflow changes

* minor seed file fix

* frontend fixes (#1079)

* fixed api_bug (#1080)

* add one condition (#1082)

* api fix (#1087)

* Tools error fix (#1093)

* webhooks frontend + api calls complete almost

* Tool-LTM(Updated) (#1039)

* Toolkit configuration fix (#1102)

* webhooks compplete frontend

* schedule agent fix (#1104)

Co-authored-by: Rounak Bhatia <[email protected]>

* Models superagi (#936)

Models Superagi

* Models superagi (#1108)

Bug Fixes

* Changes for no receiver address

* made changes to github helper

* Models superagi (#1112)

* Models superagi (#1117)

* Models fixes (#1118)

* Models Frontend Changes

* Models Frontend Changes

* Models Frontend Changes

* \n bug resolved (#1122)

* PDF and DOCX support in Write File - Feature Improvement, close #548 (#928)

* Added functions to write various file types and a file handler too

* FileManager updated to handle and save HTMLs.

* adding PDF + DOCX support to save images

* Added Wkhtmltopdf package installation run commands in docker

* Added get_all_responses feature for extractng the response for particular tools

* Added Image embedding feature, this will extract and embed the images generated by the agent during the run

* renaming functions and refactoring

* renaming functions and refactoring

* Update Dockerfile

* removing unsused classmethods

* Finding generated images and attached files in the write tool. Images are fetched inorder to be embedded in the respective file type.

* Adding the filename and paths to the Resource Manager S3 storage

* Code Cleanup

* added logger: Fix for the failing TEST

---------

Co-authored-by: Fluder-Paradyne <[email protected]>

* Revert "PDF and DOCX support in Write File - Feature Improvement, close #548 (#928)" (#1124)

This reverts commit 8b01357.

* expose port

* latest safetensors breaking in macs (#1134)

* Changes in save template  (#1120)

* fix

* changes in save template

* changes in save template

* bug fixes

* changes in save template

* changes in save template

---------

Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: namansleeps <[email protected]>

* Main to dev sync (#1139)

* Models fixes (#1126)

* Models Frontend Changes

* Models Frontend Changes

* Models Frontend Changes

* Backend Compatibility for New/Existing users on local

* DEV api key requirements

* removing print statements

* removing print statements

* removing print statements

* removing print statements

* backend compatibility

* backend compatibility

* backend compatibility

* added filters in the webhooks

* fix

* added filters in the webhooks

* Models fixes (#1145)

Fixes related to Models Feature

* Jira Bug Fix

* Jira Bug Fix 2.0

* Jira Bug Fix 3.0

* added filters in the webhooks

* Models fixes (#1147)

Model Feature Fixes

* Bug fix model redirection (#1148)

Bug Fix - Model URL Redirection

* added tool config for dalle

* removed model dependency on dalle tool

* Remove hardcoded creds

* fixed env error

* removed refactoring from main

* removed refactoring

* removed refactoring

* handled error

* stop agent from executing if model is not found (#1156)

* entity details (#1158)

* Metric frontend (#1152)

* added filters in webhooks

* added filters in webhooks

* minor changes

* webhooks complete

* minor changes for PR

* minor changes for PR

* Publish agent template to marketplace (#1106)


* publish agent to marketplace

---------

Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: namansleeps <[email protected]>

* added filters in webhooks

* added filters in webhooks

* resolving conflicts

* added filters in the webhooks

* lint issue fixed

* bug fix of prev PR

* fix for new run and edit agent

* error handling

* added filters in webhooks

* fix for knowledge search tool

* Docker digitalocean deployment

* changed branch name

* added filters in the webhooks

* changes

* removed region

* added button

* change in branch

* added filters in the webhooks

* Update conftest.py

* Added filters in the webhooks (#1140)

* webhooks frontend + web hooks with filters

---------

Co-authored-by: namansleeps <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>

* Models calls logs dev (#1174)

Call logs organisation level bug fix

* models scroll fix, format of log timestamp fix, adding of loader to models, toolkit metrics dropdown bug fixed, publish agent dropdown bug (#1171)

* Update app.yaml (#1179)

* fixes related to webhooks

* fixes for webhooks

* Fixes for webhooks (#1181)



* fixes for webhooks

---------

Co-authored-by: namansleeps <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>

* bugs by qa (#1178)

* Fix for schedule agent (#1184)

Co-authored-by: Tarraann <[email protected]>

* Entity fix (#1185)

* fixes for webhooks

* fixes for webhooks

* fix added for index state (#1188)

* fix added for index state

* Update KnowledgeTemplate.js

---------

Co-authored-by: Tarraann <[email protected]>

* API bug fixes for SDK (#1189)

* fix api's for sdk

* removed unused imports

---------

Co-authored-by: jagtarcontlo <[email protected]>

* Main to dev sync v12 (#1193)

sync back to dev

------
Co-authored-by: Taran <[email protected]>
Co-authored-by: TransformerOptimus <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>
Co-authored-by: Maverick-F35 <[email protected]>
Co-authored-by: BoundlessAsura <[email protected]>
Co-authored-by: Akshat Jain <[email protected]>
Co-authored-by: sayan1101 <[email protected]>
Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: Rounak Bhatia <[email protected]>
Co-authored-by: Kalki <[email protected]>
Co-authored-by: Tarraann <[email protected]>
Co-authored-by: rakesh-krishna-a-s <[email protected]>
Co-authored-by: Captain Levi <[email protected]>
Co-authored-by: andrew-kelly-neutralaiz <[email protected]>
Co-authored-by: James Wakelim <[email protected]>

* added button

* GitHub pull request tools (#1190)

* adding github review tools

* cleanup and adding code review prompt

* fixing comments

* PDF and DOCX support in Write File - Feature Improvement, close #548 (#1125)

Co-authored-by: Fluder-Paradyne <[email protected]>
Co-authored-by: Abhijeet <[email protected]>

* minor documentation fix

* Design bugs (#1199)

* fetching token limit from db

* Revert "PDF and DOCX support in Write File - Feature Improvement, close #548 (#1125)" (#1202)

This reverts commit 26f6a1d.

* Unit Test Fix (#1203)

* adding of docs and and discord link correction (#1205)

* openai error handling

* error_handling

* api call only when agent is running

* Feature : Wait block for agent workflow (#1186)

Agent Wait Block Step

* minor changes (#1213)

Co-authored-by: Jagtar Saggu <[email protected]>

* error handling

* error handling

* error handling

* error handling

* error handling

* fix

* fix

* fix

* error handling

* models changes (#1207)

Model related frontend changes.

* error handling

* models marketplace changes (#1219)

Co-authored-by: Abhijeet <[email protected]>

* minor changes

* error handling

* error handling

* removing single qoutes (#1224)

Co-authored-by: namansleeps <[email protected]>

* apm changes (#1222)

APM Bug Fixes

* list tool fix

* list tool fix

* PR CHANGES

* entity fix for dev (#1230)

Entity Fix for Dev

* frontend changes (#1231)

* read_tool_fix

* fix

* waiting block frontend (#1233)

Waiting Block Changes and Frontend Addition

* Dev Fixes (#1242)

* read tool fix

* Maintaining dev (#1244)

Dev Fix

* added logs (#1246)

* error_handling fix (#1247)

Error handling fix.

* Feature first login src (#1241)

Adding source in user database for analytics.

* apollo NoneType bug fix (#1238)

Bug Fix

* Mixpanel integration (#1256)

Mix Panel

* Models Marketplace bug fix for dev (#1266)

* Fix 1257 dev (#1269)

Bug Fix

* add cache layer (#1275)

Added package caching for github actions workflow

* Fix api dev (#1283)

* save other config to agent_execution config

* add config

* mixpanel changes (#1285)

* rename error_handling.py to error_handler.py (#1287)

* Analytics login (#1258)

* calendar issues fixed

* append fle tool bug fixed (#1294)



Co-authored-by: Tarraann <[email protected]>

* adding cookie in access token (#1301)

* local_llms

* local_llms

* local_llms

* local_llms

* local_llms

* fixes

* models error fixed (#1308)

* local_llms

* local_llms

* local_llms

* local_llms

* local_llms

* frontend_changes

* local_llms

* local_llms

* local_llms

* local_llms

* local_llms_frontend

* fixes

* fixes

* fixes

* fixes

* merged main into local_llm_final

* merged main into local_llm_final

* local llms

---------

Co-authored-by: TransformerOptimus <[email protected]>
Co-authored-by: Abhijeet <[email protected]>
Co-authored-by: Taran <[email protected]>
Co-authored-by: Fluder-Paradyne <[email protected]>
Co-authored-by: Maverick-F35 <[email protected]>
Co-authored-by: namansleeps <[email protected]>
Co-authored-by: Aditya Sharma <[email protected]>
Co-authored-by: Sayan Samanta <[email protected]>
Co-authored-by: Kalki <[email protected]>
Co-authored-by: Tarraann <[email protected]>
Co-authored-by: Arkajit Datta <[email protected]>
Co-authored-by: rakesh-krishna-a-s <[email protected]>
Co-authored-by: jagtarcontlo <[email protected]>
Co-authored-by: Captain Levi <[email protected]>
Co-authored-by: namansleeps <[email protected]>
Co-authored-by: I’m <[email protected]>
Co-authored-by: Jagtar Saggu <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants