devai-api

Devai API

Devai API is a python based application that is built with FastAPI framework.

This application defines the routes for the DevAI API.

The API provides two main endpoints:

/generate: This endpoint takes a user prompt as input and uses the Gemini 1.5 Pro model to generate code and documentation based on the prompt.

/create-jira-issue: This endpoint takes a user prompt as input and uses the Gemini 1.5 Pro model to generate a detailed technical prompt for a JIRA user story based on the input requirements.

The API includes a /test endpoint for testing purposes.

The code uses the following libraries:

• FastAPI: A web framework for building APIs in Python.
• Google Cloud AI Platform: A cloud service for building and deploying machine learning models.
• LangChain: A library for building and deploying language models.
• Vertex AI: A cloud service for building and deploying machine learning models.
• Jira: A project management tool.
• GitLab: A code hosting platform.

The code uses the following environment variables:

• PROJECT_ID: The Google Cloud project ID.
• LOCATION: The Google Cloud region.

For integration with JIRA:

• JIRA_API_TOKEN: The JIRA API token.
• JIRA_USERNAME: The JIRA username.
• JIRA_INSTANCE_URL: The JIRA instance URL.
• JIRA_PROJECT_KEY: The JIRA project key.
• JIRA_CLOUD: Required for LangChain JiraAPIWrapper

For integration with GitLab:

• GITLAB_URL: The GitLab URL.
• GITLAB_REPOSITORY: The GitLab repository.
• GITLAB_BRANCH: The GitLab branch.
• GITLAB_BASE_BRANCH: The GitLab base branch.

For integration with LAngSmith:

• LANGCHAIN_TRACING_V2: The LangChain tracing flag.
• LANGCHAIN_ENDPOINT: The LangChain endpoint.

The code uses the following secrets:

• LANGCHAIN_API_KEY: The LangChain API key.
• GITLAB_PERSONAL_ACCESS_TOKEN: The GitLab personal access token.
• JIRA_API_TOKEN: The JIRA API token.

JIRA User story implementation

Backend/API for GenAI Agent

Service deployment steps

Set your GCP project and location:

export PROJECT_ID=YOUR_GCP_PROJECT_ID
export LOCATION=us-central1

Authenticate with GCP and set project:

gcloud auth login
gcloud config set project $PROJECT_ID

Set JIRA_API_TOKEN and create a secret:

read -s JIRA_API_TOKEN
export JIRA_API_TOKEN

echo -n $JIRA_API_TOKEN | \
 gcloud secrets create JIRA_API_TOKEN \
 --data-file=-

Set GITLAB_PERSONAL_ACCESS_TOKEN and create a secret:

read -s GITLAB_PERSONAL_ACCESS_TOKEN
export GITLAB_PERSONAL_ACCESS_TOKEN

echo -n $GITLAB_PERSONAL_ACCESS_TOKEN | \
 gcloud secrets create GITLAB_PERSONAL_ACCESS_TOKEN \
 --data-file=-

Set LANGCHAIN_API_KEY and create a secret:

read -s LANGCHAIN_API_KEY
export LANGCHAIN_API_KEY

echo -n $LANGCHAIN_API_KEY | \
 gcloud secrets create LANGCHAIN_API_KEY \
 --data-file=-

Set environment variables:

export JIRA_USERNAME="YOUR-EMAIL"
export JIRA_INSTANCE_URL="https://YOUR-JIRA-PROJECT.atlassian.net"
export JIRA_PROJECT_KEY="YOUR-JIRA-PROJECT-KEY"
export JIRA_CLOUD=true

export GITLAB_URL="https://gitlab.com"
export GITLAB_BRANCH="devai"
export GITLAB_BASE_BRANCH="main"
export GITLAB_REPOSITORY="GITLAB-USERID/GITLAB-REPO"

export LANGCHAIN_TRACING_V2=true
export LANGCHAIN_ENDPOINT="https://api.smith.langchain.com"

Deploy service to Cloud Run:

Change location:

cd ~/genai-for-developers/devai-api

Deploy application:

gcloud run deploy devai-api \
  --source=. \
  --region="$LOCATION" \
  --allow-unauthenticated \
  --service-account vertex-client \
  --set-env-vars PROJECT_ID="$PROJECT_ID" \
  --set-env-vars LOCATION="$LOCATION" \
  --set-env-vars GITLAB_URL="$GITLAB_URL" \
  --set-env-vars GITLAB_REPOSITORY="$GITLAB_REPOSITORY" \
  --set-env-vars GITLAB_BRANCH="$GITLAB_BRANCH" \
  --set-env-vars GITLAB_BASE_BRANCH="$GITLAB_BASE_BRANCH" \
  --set-env-vars JIRA_USERNAME="$JIRA_USERNAME" \
  --set-env-vars JIRA_INSTANCE_URL="$JIRA_INSTANCE_URL" \
  --set-env-vars JIRA_PROJECT_KEY="$JIRA_PROJECT_KEY" \
  --set-env-vars LANGCHAIN_TRACING_V2="$LANGCHAIN_TRACING_V2" \
  --set-env-vars JIRA_CLOUD="$JIRA_CLOUD" \
  --update-secrets="LANGCHAIN_API_KEY=LANGCHAIN_API_KEY:latest" \
  --update-secrets="GITLAB_PERSONAL_ACCESS_TOKEN=GITLAB_PERSONAL_ACCESS_TOKEN:latest" \
  --update-secrets="JIRA_API_TOKEN=JIRA_API_TOKEN:latest" \
  --min-instances=1 \
  --max-instances=3