Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding Deepseek coder + Deepseek chat with the Deepseek API. #51

Merged
merged 3 commits into from
Oct 24, 2024
Merged

Adding Deepseek coder + Deepseek chat with the Deepseek API. #51

merged 3 commits into from
Oct 24, 2024

Conversation

zenith110
Copy link

Hi there!
I have a PR that accomplishes the following:

  • Add support for Deepseek chat + Deepseek coder(Both are deepseekv2.5, but Deepseek left these as the model name for backwards compatibility).
  • Uses the beta api of deepseek as 8k max tokens is only available when using the api and the api will return with this response if not set for the url, would it make sense to make the url configurable?

Was pretty simple to get everything added in, this is a nice open source project. Looking forward to see it grow! :)

@alumbs
Copy link

alumbs commented Oct 23, 2024 •
edited
Loading

I used this PR to update my local version. I will try using the LM Studio with DeepSeek Coder V2 Lite locally. LM Studio has a guide to use any llm locally: https://lmstudio.ai/docs/basics/server

@coleam00 coleam00 merged commit ca99ed5 into coleam00:main Oct 24, 2024
0 of 2 checks passed
@coleam00
Copy link
Owner

Awesome - thank you @zenith110! This is great.

arsenikstiger pushed a commit to arsenikstiger/bolt.new-any-llm that referenced this pull request Nov 2, 2024
@aurelien-sudre
Squashed commit of the following:
a5ab7d2 
commit 64e95a0
Author: Cole Medin <[email protected]>
Date:   Fri Nov 1 14:00:06 2024 -0500

    Small mention of hot reloading even when running in container

commit 7fe66ae
Author: Cole Medin <[email protected]>
Date:   Fri Nov 1 13:34:50 2024 -0500

    Fixing up setup + installation instructions in README

commit a265d72
Merge: 22ae9d8 92a19bf
Author: Cole Medin <[email protected]>
Date:   Fri Nov 1 13:14:45 2024 -0500

    Merge pull request coleam00#77 from ajshovon/main

    chore: create .dockerignore file

commit 22ae9d8
Author: Cole Medin <[email protected]>
Date:   Fri Nov 1 07:09:19 2024 -0500

    Fixing up Docker Compose to work with hot reloads in development and environment variables

commit 349c5d5
Merge: 3cbe207 c116338
Author: Cole Medin <[email protected]>
Date:   Thu Oct 31 14:35:25 2024 -0500

    Merge pull request coleam00#71 from hillct/add-docker-support

    fix: further enhance Docker and docker-comose support with staged, --target and --profile support, plus Coolify Deployment Support

commit 3cbe207
Merge: 2feeb18 0089d5c
Author: Cole Medin <[email protected]>
Date:   Thu Oct 31 14:33:09 2024 -0500

    Merge pull request coleam00#55 from mayurjobanputra/main

    Added more detailed instructions

commit 2feeb18
Author: Cole Medin <[email protected]>
Date:   Thu Oct 31 14:22:08 2024 -0500

    More feature requests! Will look at pull requests soon

commit 065be0f
Author: Cole Medin <[email protected]>
Date:   Mon Oct 28 13:13:44 2024 -0500

    Added DEEPSEEK_API_KEY to .env.example

commit c116338
Author: hillct <[email protected]>
Date:   Sat Oct 26 10:27:44 2024 -0400

    Added Docker Deployment documentation to CONTRIBUTING.md

commit 92a19bf
Author: shovon <[email protected]>
Date:   Fri Oct 25 12:36:38 2024 +0600

    create .dockerignore file

commit a69ce87
Author: Colin Hill <[email protected]>
Date:   Thu Oct 24 17:48:54 2024 -0400

    Corrected oudated docker build convenience script target

commit 8d48cf9
Merge: 5ec2b12 8e7220e
Author: Colin Hill <[email protected]>
Date:   Thu Oct 24 17:15:22 2024 -0400

    Merge branch 'main' into add-docker-support

commit 5ec2b12
Author: Colin Hill <[email protected]>
Date:   Thu Oct 24 16:40:48 2024 -0400

    Adding full suffix o cocker-compose.yaml for ompatibiliy

commit 87ef835
Author: Colin Hill <[email protected]>
Date:   Thu Oct 24 16:36:57 2024 -0400

    Adding hints for Coolify config into docker-compose.yaml

commit 36cc601
Merge: 25ac7f8 2620b3d
Author: Colin Hill <[email protected]>
Date:   Thu Oct 24 15:49:26 2024 -0400

    Merge branch 'add-docker-support' of github.com:hillct/bolt.new-any-llm into add-docker-support
     Just a little cleanup... nixpax.toml is no more. Embedding Coolify config in Dockerfile and docker-compose.yaml

commit 25ac7f8
Author: Colin Hill <[email protected]>
Date:   Thu Oct 24 14:50:45 2024 -0400

    Corrected nixpacks.toml filename

commit 8e7220e
Merge: 7b28a75 4c25af9
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 13:56:52 2024 -0500

    Merge pull request coleam00#70 from ArulGandhi/main

    Update constants.ts

commit 2620b3d
Author: Colin Hill <[email protected]>
Date:   Thu Oct 24 14:50:45 2024 -0400

    Corrected nixpacks.toml filename

commit 2773a7e
Merge: fdc2f6c b21b145
Author: Colin Hill <[email protected]>
Date:   Thu Oct 24 14:48:05 2024 -0400

    Enhancing Dockerfile to use a staged build, and docker-compose-yaml to use profiles, either 'development' or 'producion'. Adding nixpacks.toml to enable robust coolify support

commit 4c25af9
Author: ArulGandhi <[email protected]>
Date:   Thu Oct 24 23:18:22 2024 +0530

    Update constants.ts

    Fix a bug in model names causing 2 models to fail

commit 7b28a75
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:58:43 2024 -0500

    Updating README with finished implementations and reorder the list of priorities

commit 8ab8e67
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:46:34 2024 -0500

    Cleanup and fixing Ollama models not showing up after merging changes

commit b21b145
Merge: 5f6a595 f1b8c02
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:25:23 2024 -0500

    Merge pull request coleam00#64 from noobydp/main

    Further changes to support OLLAMA_API_BASE_URL with ollama models

commit f1b8c02
Merge: 8ce82b5 5f6a595
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:25:07 2024 -0500

    Merge branch 'main' into main

commit 5f6a595
Merge: ca99ed5 4660e5b
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:20:49 2024 -0500

    Merge pull request coleam00#60 from ZerxZ/main

    chore: Add environment variables for OpenAI Like integration

commit 4660e5b
Merge: 05c0137 ca99ed5
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:19:59 2024 -0500

    Merge branch 'main' into main

commit ca99ed5
Merge: 65cf12d d999e9e
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:13:43 2024 -0500

    Merge pull request coleam00#51 from zenith110/main

    Adding Deepseek coder + Deepseek chat with the Deepseek API.

commit d999e9e
Merge: a6e6619 65cf12d
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:13:26 2024 -0500

    Merge branch 'main' into main

commit 65cf12d
Merge: 5d70255 f706523
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:07:34 2024 -0500

    Merge pull request coleam00#44 from TarekS93/main

    Enhance Ollama Model Integration and Type Definitions

commit 5d70255
Merge: d40be24 285a955
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 08:06:00 2024 -0500

    Merge pull request coleam00#36 from ArulGandhi/main

    Add mistral models.

commit d40be24
Merge: 5a10894 368022d
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 07:57:00 2024 -0500

    Merge pull request coleam00#30 from muzafferkadir/main

    feat: added sync files to selected local folder function is created.Yarn package manager fixes, styling fixes. Sass module fix. Added Claude model for open router.

commit 368022d
Merge: 49217f2 5a10894
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 07:56:48 2024 -0500

    Merge branch 'main' into main

commit 5a10894
Merge: 47a7932 059933a
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 07:38:48 2024 -0500

    Merge pull request coleam00#24 from goncaloalves/main

    Added GitHub push functionality

commit 47a7932
Merge: 69aceea 9ca017c
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 07:30:21 2024 -0500

    Merge pull request coleam00#23 from aaronbolton/main

    Docker Additions

commit 69aceea
Merge: 62e5091 f761509
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 07:19:25 2024 -0500

    Merge pull request coleam00#12 from fernsdavid25/patch-1

    Fix for llama 3.1 models

commit 62e5091
Merge: 8ac7931 9b38dbd
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 07:17:05 2024 -0500

    Merge pull request coleam00#11 from kofi-bhr/main

    [Prompt] Add structured planning step to improve response quality

commit 9b38dbd
Merge: 5b35213 8ac7931
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 07:15:25 2024 -0500

    Merge branch 'main' into main

commit 8ac7931
Author: Cole Medin <[email protected]>
Date:   Thu Oct 24 07:06:57 2024 -0500

    Adding CONTRIBUTING.md specifically for this fork.

commit 8ce82b5
Author: noobydp <[email protected]>
Date:   Thu Oct 24 16:49:11 2024 +0800

    updated ollama to use defined base URL for model calls

commit fdc2f6c
Author: Colin Hill <[email protected]>
Date:   Thu Oct 24 03:54:45 2024 -0400

    Enabled boh dev and production docker images. Added convenience scripts and deconflicted start and dockerstart scripts

commit 94fa108
Merge: dd4dd2c 05c0137
Author: noobydp <[email protected]>
Date:   Thu Oct 24 13:10:56 2024 +0800

    Merge pull request #1 from ZerxZ/main

    chore: Add environment variables for OpenAI Like integration

commit 7448666
Merge: 8fb0248 dd4dd2c
Author: Colin Hill <[email protected]>
Date:   Wed Oct 23 23:34:14 2024 -0400

    Merge branch 'main' from coleam00 into add-docker-support

commit 05c0137
Author: Gaoyao Massimo Hu <[email protected]>
Date:   Wed Oct 23 16:45:16 2024 +0100

    chore: Update environment variable names for OpenAI Like integration

commit 9f2db7b
Author: Gaoyao Massimo Hu <[email protected]>
Date:   Wed Oct 23 16:43:27 2024 +0100

    chore: Update environment variable names for OpenAI Like integration

commit 30dfa4f
Author: Gaoyao Massimo Hu <[email protected]>
Date:   Wed Oct 23 16:36:12 2024 +0100

    chore: Add environment variables for OpenAI API Like integration

commit 9ca017c
Author: Aaron Bolton <[email protected]>
Date:   Wed Oct 23 14:57:53 2024 +0100

    Update docker-compose.yml

commit 0089d5c
Merge: dd4dd2c e13790c
Author: Mayur <[email protected]>
Date:   Tue Oct 22 23:09:48 2024 -0700

    Merge pull request #1 from mayurjobanputra/mayurjobanputra-patch-1

    Added more instructions for newbs

commit e13790c
Author: Mayur <[email protected]>
Date:   Tue Oct 22 23:08:30 2024 -0700

    Added more instructions for newbs

commit a6e6619
Merge: 3b90afb dd4dd2c
Author: zenith110 <[email protected]>
Date:   Tue Oct 22 18:19:34 2024 -0400

    Merge branch 'main' of https://github.com/zenith110/bolt.new-any-llm

commit 3b90afb
Author: zenith110 <[email protected]>
Date:   Tue Oct 22 18:19:27 2024 -0400

    Added deepseek models

commit 8fb0248
Merge: a4a722b cecbc55
Author: Rahul Bhardwaj <[email protected]>
Date:   Tue Oct 22 21:17:16 2024 +0530

    Merge branch 'main' into add-docker-support

commit f706523
Author: TarekS93 <[email protected]>
Date:   Tue Oct 22 11:19:08 2024 +0200

    Update constants.ts

commit 34ead80
Author: TarekS93 <[email protected]>
Date:   Tue Oct 22 11:18:34 2024 +0200

    Update types.ts

commit da29a79
Merge: 29f8797 dd4dd2c
Author: Aaron Bolton <[email protected]>
Date:   Tue Oct 22 09:18:59 2024 +0100

    Merge branch 'coleam00:main' into main

commit 285a955
Author: ArulGandhi <[email protected]>
Date:   Tue Oct 22 09:49:21 2024 +0530

    removed pixtral

commit 1b1cd18
Author: ArulGandhi <[email protected]>
Date:   Tue Oct 22 09:47:30 2024 +0530

    mistral models added

    more mistral models added. some tested, rest assumed to be working

commit 5e8a0b0
Author: ArulGandhi <[email protected]>
Date:   Tue Oct 22 09:22:36 2024 +0530

    add mistral models

commit dd4dd2c
Merge: cf76e4d 6eea1a9
Author: Cole Medin <[email protected]>
Date:   Mon Oct 21 18:02:25 2024 -0500

    Merge pull request #8 from yunatamos/patch-1

    Update README.md

commit cf76e4d
Merge: 50a501e 6c8616b
Author: Cole Medin <[email protected]>
Date:   Mon Oct 21 18:01:42 2024 -0500

    Merge pull request coleam00#28 from kofi-bhr/patch-1

    Update README.md

commit 49217f2
Author: muzafferkadir <[email protected]>
Date:   Tue Oct 22 01:27:29 2024 +0300

    feat: added sync files to selected local folder function is created. Yarn package manager fixes, styling fixes. Sass module fix. Added Claude model for open router.

commit 6c8616b
Author: Kofi <[email protected]>
Date:   Mon Oct 21 16:33:52 2024 -0500

    Update README.md

    docs: fix grammar in readme

    just cleaned up some awkward phrasing + fixed a few typos :)

    - kofi

commit 29f8797
Author: Aaron Bolton <[email protected]>
Date:   Mon Oct 21 20:29:01 2024 +0100

    Update github-build-push.yml

commit 1799636
Author: Aaron Bolton <[email protected]>
Date:   Mon Oct 21 20:25:56 2024 +0100

    Update github-build-push.yml

commit 8150f6f
Author: Aaron Bolton <[email protected]>
Date:   Mon Oct 21 20:20:04 2024 +0100

    Update github-build-push.yml

commit 21a0a07
Author: Aaron Bolton <[email protected]>
Date:   Mon Oct 21 20:19:16 2024 +0100

    Update github-build-push.yml

commit fc688ec
Author: Aaron Bolton <[email protected]>
Date:   Mon Oct 21 20:17:59 2024 +0100

    moved action

commit 7424bff
Author: Aaron Bolton <[email protected]>
Date:   Mon Oct 21 20:16:16 2024 +0100

    Create github-build-push.yml

commit 059933a
Author: goncaloalves <[email protected]>
Date:   Mon Oct 21 20:14:35 2024 +0100

    Added GitHub push functionality

commit 0ef3096
Author: Aaron Bolton <[email protected]>
Date:   Mon Oct 21 20:10:08 2024 +0100

    Docker Additions

    Added Dockerfile and docker-compose.yml, also adjusted start command to listen for all IP's and on Port 3000

commit f761509
Author: fernsdavid25 <[email protected]>
Date:   Mon Oct 21 19:32:57 2024 +0530

    Update max_tokens in constants.ts

    max_tokens for llama 3.1 models must be less than or equal to 8000 but it is set to 8192. just change it to 8000 and the error is fixed.

commit 5b35213
Author: Kofi <[email protected]>
Date:   Mon Oct 21 07:46:42 2024 -0500

    Update prompts.ts

commit f9021d3
Author: Kofi <[email protected]>
Date:   Mon Oct 21 12:34:06 2024 +0000

    feat(prompt): add planning step + organize shell commands

    Adds structured planning phase before responses and reorganizes
    available shell commands by category. Planning helps catch edge
    cases early and shell categorization makes capabilities clearer.

    Main changes:
    - New chain-of-thought system for pre-response thinking
    - Grouped shell commands by function (files, sys, dev tools, misc)
    - Added brief cmd descriptions

    No breaking changes, just better organization + process. Should
    help reduce back-and-forth on PRs.

    Tested w/o cmd env :)

    - kofi

commit 1766dd5
Author: Kofi <[email protected]>
Date:   Mon Oct 21 07:06:23 2024 -0500

    Update README.md

    Fixed Readme to be up to date with prompting fixees

commit 6eea1a9
Author: Yunat Amos <[email protected]>
Date:   Mon Oct 21 07:52:19 2024 +0300

    Update README.md

    I have two accounts and one that commited is yunatamos

commit cecbc55
Author: ♚ PH⑦ de Soria™♛ <[email protected]>
Date:   Fri Oct 18 01:40:09 2024 +1100

    fix(readme): use correct issues url (stackblitz#514)

    Co-authored-by: Sam Denty <[email protected]>

commit 582b42e
Author: Brutal Strike <[email protected]>
Date:   Wed Oct 16 18:05:22 2024 +0300

    fix: don't always show scrollbars (stackblitz#548)

commit a4a722b
Author: Rahul Bhardwaj <[email protected]>
Date:   Thu Oct 10 08:21:11 2024 +0530

    Add corepack to setup pnpm

commit 65629d0
Author: Rahul Bhardwaj <[email protected]>
Date:   Thu Oct 10 07:26:25 2024 +0530

    Update Dockerfile

    Co-authored-by: Sleeyax <[email protected]>

commit 5f62d1f
Merge: 71c4398 ffa9f11
Author: Rahul Bhardwaj <[email protected]>
Date:   Tue Oct 8 08:39:40 2024 +0530

    Merge branch 'main' into add-docker-support

commit 71c4398
Merge: f90f60b cf31b59
Author: Dominic Elm <[email protected]>
Date:   Mon Oct 7 10:58:22 2024 +0200

    Merge branch 'main' into add-docker-support

commit f90f60b
Author: Rahul Bhardwaj <[email protected]>
Date:   Sun Oct 6 22:14:54 2024 +0530

    Update node version and enable host network

commit 816d6d5
Author: Rahul Bhardwaj <[email protected]>
Date:   Sun Oct 6 19:42:49 2024 +0530

    Add support for docker dev in bolt

commit 6a9cb78
Author: Sam Denty <[email protected]>
Date:   Fri Oct 4 09:31:25 2024 +0200

    fix(browser-extensions): don't render directly in body

commit f6d79c5
Author: Sam Denty <[email protected]>
Date:   Thu Oct 3 22:15:02 2024 +0100

    fix: add screen recordings section to bug_report.yml

commit 6694e14
Author: Buntu Redempter <[email protected]>
Date:   Thu Oct 3 11:32:37 2024 -0700

    Update README.md (#7)

commit 537389e
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 10:31:08 2024 -0500

    Update README.md

commit aa6148f
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 10:13:11 2024 -0500

    Update CONTRIBUTING.md

commit 506ed1d
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 10:09:53 2024 -0500

    Update CONTRIBUTING.md

commit c85fd80
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 09:55:04 2024 -0500

    Update README.md

commit 292e923
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 09:53:31 2024 -0500

    Rename MAIN-FOLDER-README.md to README.md

commit fc82dda
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 09:53:07 2024 -0500

    Rename README.md to CONTRIBUTING.md

commit 8840d00
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 09:00:31 2024 -0500

    Update MAIN-FOLDER-README.md

commit 9a1ab23
Author: Sam Denty <[email protected]>
Date:   Thu Oct 3 13:17:24 2024 +0100

    fix: update links

commit 14da2f0
Author: Sam Denty <[email protected]>
Date:   Thu Oct 3 13:15:56 2024 +0100

    fix: remove duplicated bug_report template

commit 5580ab9
Author: Sam Denty <[email protected]>
Date:   Thu Oct 3 13:13:43 2024 +0100

    fix: typo

commit 85d2b6f
Author: Sam Denty <[email protected]>
Date:   Thu Oct 3 13:12:13 2024 +0100

    feat: add readme image (#4)

commit bf65a7e
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 00:33:28 2024 -0500

    Update MAIN-FOLDER-README.md

commit efac3a7
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 00:07:55 2024 -0500

    Update MAIN-FOLDER-README.md

commit dbef8c1
Author: Alexander Berger <[email protected]>
Date:   Thu Oct 3 00:07:23 2024 -0500

    Create MAIN-FOLDER-README.md

commit 84c5da8
Author: Alexander Berger <[email protected]>
Date:   Wed Oct 2 23:34:33 2024 -0500

    Update README.md

commit 36f219f
Author: Alexander Berger <[email protected]>
Date:   Wed Oct 2 23:31:56 2024 -0500

    Update README.md

commit 72df4b8
Author: Alexander Berger <[email protected]>
Date:   Wed Oct 2 23:26:22 2024 -0500

    Update README.md

commit 3181d50
Author: Alexander Berger <[email protected]>
Date:   Wed Oct 2 23:25:57 2024 -0500

    Update README.md

commit dfebd40
Author: Alexander Berger <[email protected]>
Date:   Wed Oct 2 23:24:22 2024 -0500

    Update README.md

commit 4cf007b
Author: Sam Denty <[email protected]>
Date:   Thu Oct 3 05:22:16 2024 +0100

    fix: update README.md (#3)

    Co-authored-by: apai4 <[email protected]>

commit 2806a65
Author: Albert Pai <[email protected]>
Date:   Wed Oct 2 17:37:10 2024 -0700

    Create bug_report.yml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@zenith110 @alumbs @coleam00