Before running the python project, make sure you have the following pre-requisites installed:
brew install gimme-aws-creds
Follow the guide - Install Python
Open a terminal and navigate to your project directory. Run the following commands to download and install the pre-requisites:
# Install virtualEnv for Python
pip install virtualenv
# Create a virtualEnv for Python
virtualenv <project-name>
for ex: virtualenv s3-kafka-messages
# Activate the virtualEnv
source <project-name>/bin/activate
for ex: source s3-kafka-messages/bin/activate
# Install required components
pip install -r requirements.txt
Choose the Product account and save the credentials:
export AWS_PROFILE=Product
Adjust your inputs in the config.ini
file based on your goals:
search_critirea = entry1, entry2
search_date = yyyy/mm/dd
search_hour = 0-23
topics = topic1, topic2
enable_matched_content = True/False
-
Navigate to the shell where you have configured the virtualEnv.
-
Activate the virtualEnv if it's not already activated by running the following command:
source <project-name>/bin/activate for ex: source s3-kafka-messages/bin/activate
-
Execute the Python program:
python search-s3-kafka-messages.py
Now, your Python script will be executed.