TextGPT bridges the gap between telephony and Conversational AI by integrating the Twilio telephony system with OpenAI's GPT model. It enables SMS messages to be processed and responded to by GPT ChatCompletion, providing an AI-driven conversational experience all built on a scaleable and easily deployable platform.

Using prompt engineering, TextGPT now provides the option for the AI personality to create a contextual response as well as occasionally create an image prompt relating to the subject matter. This image prompt is then sent to Dall-E 2 for generation. This image, along with the GPT response, is sent to the user as a MMS message.

• Send and Receive SMS and MMS messages via Twilio API
• Process and respond to messages using OpenAI's API featuring a wealth of models (including GPT 3.5 turbo and GPT 4).
• Process and respond to GPT personality generated image prompts using Dall-E 2 to generate images. There is currently a 3 image cooldown before another is sent, if many are sent in a row by the AI.
• Image storing using AWS S3.
• Scalable and serverless architecture using AWS Lambda functions.
• Reliable message processing using AWS SQS queues.
• Secure storage of sensitive data with AWS Secrets Manager.
• Detailed logging for monitoring and troubleshooting.
• Conversation context stored using AWS DynamoDB (Can reply to "Tell me more about 'that'")
• Infrastructure as Code
• 100% Code Coverage with Jest testcases

Version 1.0

Version 2.0

TextGPT is built using the AWS Cloud Development Kit (CDK) and consists of several AWS Lambda functions, each serving a specific function:

1. receiveSms: Triggered when an SMS message is received. It determines the Telephony origination, parses the message, and enqueues it into an SQS queue for further processing.

2. queryGpt: Retrieves messages from the SQS queue, constructs a prompt based on the message content and conversation history (stored in DynamoDB), and generates a prompt to send to the openAI API for GPT 3.5 turbo. The AI-generated response is then run through a delimiter check to see if an image prompt has been included. If so, it is processed and enqueued into a separate image SQS queue for processing by the Image Processor, and the new response is added to the Conversations DynamoDB table. If there is no delimited prompt, the response is enqueued on the sms SQS queue.

3. sendSms: Retrieves the either the bundled message for the sender, or a system error message from one of three SQS queues, and either sends it as an SMS reply or, in the case of a delimited image prompt being returned, sends as a MMS reply using the Twilio API.

4. imageProcessor: Retrieves a delimited prompt, generated by the AI assistant, to be sent to Dall-E 2 to generate an image. Upon successful generation, adds the iamge to the original message body and send as a MMS to the user. The generated image is then stored in S3.

All logging is done through AWS CloudWatch and follows the format:

Logging Level ConversationId -- Lambda -- Log Content -- Logged Parameters

Example:

INFO SMb1f9a545ebbc89d7669b438753a82a6c -- SendSMS -- Sending message to Twilio

The ConversationId is consistent across logs for the same message, making it easier to trace its progression through the system.

Featuring over 45 comprehensive testcases, 100% of the testGpt codebase is covered by Jest test cases and ready for CI/CD checks.

By default, TextGPT uses the gpt-3.5-turbo model from OpenAI. To use a different model, visit the OpenAI Models Documentation to select a model, and then update the model name in the model element of the config.ts at the stack level.

• AWS Account
• Twilio Account
• OpenAI Account
• Node.js and npm
• AWS CDK CLI

1. Sign up for a Twilio account and go to the console.
2. Obtain a phone number and take note of it.
3. Configure the Lambda webhook: In the Twilio console, navigate to Phone Numbers -> Manage -> Active Numbers. Under Messaging Configuration, find the "A message comes in" field and ensure it's set to "Webhook". Add your receiveSms Lambda URL to this field.

1. Create a secret in AWS Secrets Manager named ChatGPTSecrets.
2. Add the following key-value pairs to the secret: twilioAccountSid, twilioAuthToken, and openAiApiKey. Use the configuration values from the Twilio console forthe Twilio keys, and for OpenAI, generate a new secret API key in the account settings panel.
3. Ensure that the IAM policy for your Lambda functions includes permissions to access the secret. Make sure the resource ARN in the IAM policy matches the full ARN of the secret.

1. You can toggle the timeout settings for the Lambda functions as needed in the ./lib/config.ts file.
2. All the necessary IAM policies and roles are set up in the stack defined in ./lib/text_gpt-stack.ts.

1. Clone the TextGPT repository to your local machine.
2. Navigate to the project directory and run npm install to install dependencies.
3. Bootstrap the environment with cdk bootstrap.
4. Build the CDK stack by running cdk build.
5. Deploy the stack to your AWS account by running cdk deploy. This command also creates the necessary resources in your AWS account.

1. Monitor the logs in AWS CloudWatch for any issues or to trace the flow of messages using the ConversationId
2. If the Lambda functions are not able to access the secrets, verify that the IAM policy associated with the Lambda functions has the correct permissions and resource ARN.
3. Ensure that your Twilio webhook is correctly configured to point to the receiveSms Lambda function URL.
4. If no image is being generated, ensure the imageCooldown configuration is set, and an appropriate value (3 works nicely)

1. Implement a cache system to avoid unecessary calls to the DB for conversation history (redis or elasticache)
2. Create an abstraction and mapping processor for the receiveSms lambda to become telephony provider agnostic
3. Allow for variations and edits for previously generated images from Dall-E
4. Replace GPT with a local, trained, LLaMA.cpp instance
5. Replace Dall-E with a local, trained, Stable Diffusion instance
6. Implement logging framework

• OpenAI for the ChatGPT model.
• AWS for the Cloud Development Kit (CDK) and Lambda services.
• Twilio for the telephony services.