AIProviders
AWS Bedrock
Using Amazon Bedrock for AI generation.
AWS Bedrock is a fully managed service that offers a choice of high-performing foundation models from leading AI companies via a single API.
How to get access
- Log into your AWS Management Console.
- Navigate to Amazon Bedrock.
- Go to Model access and request access to the specific models you want to use (e.g., Claude 3, Llama 3).
- Set up your standard AWS credentials (
AWS_ACCESS_KEY_ID,AWS_SECRET_ACCESS_KEY,AWS_REGION) in your.envfile.
Available Models
Bedrock supports many models, but the most common for our use cases:
- Anthropic Claude 3.5 Sonnet: Best all-rounder for reasoning and coding.
- Meta Llama 3: Great open-source alternative for general text generation and analysis.
- Amazon Titan: Useful for specific enterprise embeddings and text generation tasks.