aeksco / aws-pdf-textract-pipeline Goto Github PK

Resolves this error message:

Resource handler returned message: "The runtime parameter of nodejs10.x is no longer supported for creating or updating AWS > Lambda functions. We recommend you use the new runtime (nodejs14.x) while creating or updating functions

There's a warning note in README.md detailing:

Warning - the AnalyzeDocument process from AWS Textract costs $50 per 1,000 PDF pages. Be careful when deploying this CDK stack as you could unintentionally rack up an expensive AWS bill quickly if you're not paying attention.

This might not be enough - if a user finds this project and doesn't read the documentation, they could inadvertently rack up a very expensive AWS bill.

We should introduce a hard-coded limit that prevents the PDF Download stage from downloading more than, let's say, 5 documents at a time. This addition ensures that users who really want to use this stack have read the documentation, and casual users who are testing things out don't run the risk of accidentally racking up a lot of charges.

Guide here:
https://dev.to/aws-builders/how-to-migrate-cdk-v1-to-cdk-v2-in-10-minuets-6i6

Seeing this issue: addToQueueLambdaFunction is not authorized to perform: textract:StartDocumentAnalysis

Should also take a moment to rename the addToQueueLambdaFunction to match the filename in src.

This project should implement the cdk/assert package so we can test the output of the CDK stack in a CI/CD environment.

The following packages must be updated in package.json:

• @aws-cdk/aws-dynamodb
• @aws-cdk/aws-events
• @aws-cdk/aws-events-targets
• @aws-cdk/aws-iam
• @aws-cdk/aws-lambda
• @aws-cdk/aws-lambda-event-sources
• @aws-cdk/core

The latest published version on NPM is 1.109.0 - all of these packages should be updated to at least 1.100.0 if possible.

Currently all the lambda functions are bundled together - we really only need to bundle that lambda that includes puppeteer. This should speed up the time it takes to deploy the app.

This repository should include some basic documentation and a stack diagram built with cloudcraft.co to illustrate the architecture.