hsiehshujeng / cdk-databrew-cicd Goto Github PK

A demonstration of CICD with AWS Databrew

License: Apache License 2.0

JavaScript 7.35% TypeScript 59.84% Python 15.60% Batchfile 0.62% C# 4.83% Java 6.13% Go 5.62%

python java npm typescript csharp aws-databrew aws-codepipeline aws-codecommit aws-lambda aws-cloudwatch

cdk-databrew-cicd's Introduction

Shu-Jeng Hsieh (Scott Hsieh) 👋

I'm Scott, a Data Architect at the 104 Corporation.
Focus on data engineering and data science.
At the same time, pay attention to containers and DevOps.

An AWS Community Builder since 2020 Fall.
An AWS Community Data Hero since 2022 August.
10 AWS certifications at the moment

Side Projects

Projects	Tags
cloud-front-plus CDK constructs library that allows you to build AWS CloudFront Extensions in JavaScript, TypeScript or Python.	CDK aws-cloudfront lambda@edge TypeScript Python
projen-simple An initial project for projen which makes a customized construct to be published to 4 languages repositories.	CDK projen aws-step-functions aws-api-gateway Typescript Python Java Csharp
cdk-lambda-subminute A mechanism that make a Lambda to be invoked per time unit less than one minute	CDK aws-step-functions aws-lambda projen Typescript Python Java Csharp
cdk-databrew-cicd A CodePipeline pipeline with DataBrew for CICD	CDK aws-codepipeline aws-codecommit aws-lambda aws-cloudwatch projen cdk jsii Typescript Python Java Csharp
cdk-comprehend-s3olap Amazon Comprehend with Amazon S3 Object Lambda for PII scenarios	CDK machine-learning amazon-comprehend aws-s3objectlambda aws-lambda projen cdk jsii Typescript Python Java Csharp
cdk-emrserverless-with-delta-lake Interaction with EMR Serverless applications for Delta Lake and EMR Notebooks	CDK aws-service-catalog emr-serverless emr-studio projen cdk jsii Typescript Python Java Csharp

Sharing in the Communities

Forms or Names	Where
2021 AWS DAS 證照心得 A guidance on how to slash the DAS certificate	Medium AWS User Group Taiwan
如何在 PySpark 中管理 Python 相依性套件 the translation of How to Manage Python Dependencies in PySpark	Medium Taiwa Spark User Group Python Taiwan
How to Become A Programming Polyglot by One-language Effort Details about how to publish custom constructs to popular language repos	dev.to
艾位元俱樂部：LinkedIn 在擴展 Hadoop 分散式檔案系統上的旅程 the translation of The exabyte club: LinkedIn’s journey of scaling the Hadoop Distributed File System	Medium
Serverless Data Platform (a 50-min session) - live video: AWS User Group Taiwan Meetup 2021-07 線上小聚 - presentation: Serverless Data Platform - shared by the founder of the Taiwan Data Engineering Association	The AWS User Group Taiwan (Oneline Meetup)
2021 AWS DOP 證照心得 A guidance on how to slash the DOP certificate	Medium AWS User Group Taiwan
Turn data into insights Guest speaker in Track 2: Data Analytics	AWS SUMMIT ONLINE TAIWAN 2021
How to migrate CDK v1 to CDK v2 in 10 minuets Guidance on migrating CDK v1 to CDK v2	dev.to
現代化無伺服器資料湖倉儲 Guest speaker in Track 3: Mondernized Application	AWS 雲端科技發表會

cdk-databrew-cicd's People

Contributors

Stargazers

Watchers

cdk-databrew-cicd's Issues

error TS2709: Cannot use namespace 'ResponseLike' as a type.

Describe the bug

Since Sep. 3rd, 2022 at 9:24 AM GTM+8, the automatic upgrading procedure would incur the following error message and thereafter the progress stops working as usual.

ode_modules/@types/cacheable-request/index.d.ts:26:42 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

26         cb?: (response: ServerResponse | ResponseLike) => void
                                            ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:77:51 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

77             listener: (response: ServerResponse | ResponseLike) => void
                                                     ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:81:69 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

81         on(event: 'response', listener: (response: ServerResponse | ResponseLike) => void): this;
                                                                       ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:84:71 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

84         once(event: 'response', listener: (response: ServerResponse | ResponseLike) => void): this;
                                                                         ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:89:51 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

89             listener: (response: ServerResponse | ResponseLike) => void
                                                     ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:95:51 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

95             listener: (response: ServerResponse | ResponseLike) => void
                                                     ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:104:51 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

104             listener: (response: ServerResponse | ResponseLike) => void
                                                      ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:108:70 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

108         off(event: 'response', listener: (response: ServerResponse | ResponseLike) => void): this;
                                                                         ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:112:73 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

112         listeners(event: 'response'): Array<(response: ServerResponse | ResponseLike) => void>;
                                                                            ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:115:76 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

115         rawListeners(event: 'response'): Array<(response: ServerResponse | ResponseLike) => void>;
                                                                               ~~~~~~~~~~~~
node_modules/@types/cacheable-request/index.d.ts:118:60 - error TS2709: Cannot use namespace 'ResponseLike' as a type.

118         emit(event: 'response', response: ServerResponse | ResponseLike): boolean;

Expected behavior

Running without failure in the automatic procedure and updating this construct package on daily basis.

Current behavior

Being executed in the automatic procedure and being executed in local machine would incur the above exception message.

Reproduction steps

Just execute projen upgrade and project build with order , baby.

Solution

Add project.package.addPackageResolutions('[email protected]'); into your .projenrc.js. For detailed explanation, see the following comment.

Additional information/context

projen version

0.61.41

CDK CLI Version

2.40.0

Node.js Version

18.2.0

OS

Local machine
ProductName: macOS
ProductVersion: 12.4
BuildVersion: 21F79
Github Actions
ubuntu-latest

Language

Typescript

Language Version

4.7.2