Skip to main content

Log 3 🛫

· One min read

Objectives​

  • Deploy watsonx.ai on self-managed AWS infrastructure.

Accomplishments​

AWS

  • Discovery of AWS DevOps role to be used and augmented with permissions.
  • Adjusted check-permissions.sh script to account for profile to be passed.
  • Creation of Cloudformation templates for roles with permissions needed for install.
    • Added --profile and $PROFILE_NAME
  • Adjusted Cloudformation templates to account for roles instead of a user.

RAG

  • App deployed on Fyre VM
  • Support for granitev2/llama2 70 b chat models added.
  • Watsonx Assistant Configured to interact with app via API for easier testing.

In Progress​

  • End-to-end deployment of OCP, CP4D, and watsonx.ai (with GPU node)
  • Tagging cp-deployer.sh generated resources.
  • Test out RAG new chunking method.

Next Steps​

  • Continue over the shoulder working sessions
  • Compilation of required endpoints
  • Fill out required network values required for OCP deployment.
  • Add Mixtral model to RAG.
  • Deploy latest RAG version on AWS
  • Build out actions & flow in Watsonx Assistant after properly defining personas & objectives.

Tracking (Issues)​

  • Require sign-off on final CloudFormation template.