Git Product home page Git Product logo

taglesscrm's Introduction

TaglessCRM

Copyright 2022 Google LLC. This solution, including any related sample code or data, is made available on an “as is,” “as available,” and “with all faults” basis, solely for illustrative purposes, and without warranty or representation of any kind. This solution is experimental, unsupported and provided solely for your convenience. Your use of it is subject to your agreements with Google, as applicable, and may constitute a beta feature as defined under those agreements. To the extent that you make any data available to Google in connection with your use of the solution, you represent and warrant that you have all necessary and appropriate rights, consents and permissions to permit Google to use and process that data. By using any portion of this solution, you acknowledge, assume and accept all risks, known and unknown, associated with its usage, including with respect to your deployment of any portion of this solution in your systems, or usage in connection with your business, if at all.

Overview

TaglessCRM is a lightweight, automated data transfer library for clients who want to upload their marketing data to Google Platforms. By design, it sends the data once and only once, and removes the hustle of dealing directly with the Google APIs.

Please refer to the following documentation for how to use this solution.

  1. Installation Guide

Glossary of Terms

Term Definition
TCRM TaglessCRM.
Cloud Composer A fully managed workflow orchestration service built on Apache Airflow.
Airflow Apache Airflow is an open-source workflow management platform.
Airflow DAG In Airflow, a DAG -- or a Directed Acyclic Graph -- is a collection of all the tasks you want to run, organized in a way that reflects their relationships and dependencies. A DAG is defined in a Python script, which represents the DAGs structure (tasks and their dependencies) as code.
Airflow Operator An operator describes a single task in a workflow.
Airflow Hook Hooks are interfaces to external platforms and databases like Hive, S3, MySQL, Postgres, HDFS, and Pig. Hooks implement a common interface when possible, and act as a building block for operators.
Google Ads Google Ads is an online advertising platform developed by Google, where advertisers bid to display brief advertisements, service offerings, product listings, or videos to web users. It can place ads both in the results of search engines like Google Search and on non-search websites, mobile apps, and videos
Google Analytics Google Analytics is a web analytics service offered by Google that tracks and reports website traffic, currently as a platform inside the Google Marketing Platform brand.
Campaign Manager Campaign Manager 360 is a web-based ad management system for advertisers and agencies. It helps you manage your digital campaigns across websites and mobile. This includes a robust set of features for ad serving, targeting, verification, and reporting.
BigQuery BigQuery is a fully-managed, serverless data warehouse that enables scalable analysis over petabytes of data.
Cloud Storage Cloud Storage has an ever-growing list of storage bucket locations where you can store your data with multiple automatic redundancy options.

DAGs

DAG Definition
bq_to_ads_cm_v2 BigQuery To Google Ads Customer Match
bq_to_ads_oc_v2 BigQuery To Google Ads Offline Conversion
bq_to_ads_uac BigQuery To Google Ads Universal App Campaign
bq_to_cm BigQuery To Campaign Manager Offline Conversions
bq_to_ga BigQuery To Google Analytics
bq_to_ga4 BigQuery To Google Analytics 4
gcs_to_ads_cm_v2 Google Cloud Storage To Google Ads Customer Match
gcs_to_ads_oc_v2 Google Cloud Storage To Google Ads Offline Conversion
gcs_to_ads_uac Google Cloud Storage To Google Ads Universal App Campaign
gcs_to_cm Google Cloud Storage To Campaign Manager Offline Conversions
gcs_to_ga Google Cloud Storage To Google Analytics
gcs_to_ga_4 Google Cloud Storage To Google Analytics 4

taglesscrm's People

Contributors

rchen152 avatar yalezhang42 avatar yilei avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar

Forkers

hayato1934 phbaudin isabella232 8042duffy python-repository-hub beijingtl marouane-tradelab ghas-results

taglesscrm's Issues

KeyError: 'resp'.

Hello,
i run the command: cd tcrm && sh setup.sh --project_id=$GOOGLE_CLOUD_PROJECT
but this error returns: KeyError: 'resp'

Traceback (most recent call last):
  File "cloud_env_setup.py", line 139, in <module>
    main()
  File "cloud_env_setup.py", line 114, in main
    cloud_api_utils.enable_apis(apis=_APIS_TO_BE_ENABLED)
  File "/home/g/TaglessCRM/gps_building_blocks/py/gps_building_blocks/cloud/utils/cloud_api.py", line 92, in enable_apis
    operation = utils.execute_request(request)
  File "/home/g/tcrm-venv/lib/python3.7/site-packages/google/api_core/retry.py", line 286, in retry_wrapped_func
    on_error=on_error,
  File "/home/g/tcrm-venv/lib/python3.7/site-packages/google/api_core/retry.py", line 189, in retry_target
    if not predicate(exc):
  File "/home/g/TaglessCRM/gps_building_blocks/py/gps_building_blocks/cloud/utils/utils.py", line 57, in _is_retriable_http_error
    if error.__dict__['resp'].status in _RETRIABLE_STATUS_CODES:
KeyError: 'resp'

What did i do wrong?
Thank you!

Problem while installing TaglessCRM

Hi There,

Thank you again for creating this, I was really looking forward to trying it out.

However, i've ran into an issue with installing the programme as well. Please find my SS here. Would be great if you could advice/troubleshoot. Thanks!

image

Problem while installing TCRM

Hello,

Thanks for all your work in putting together the tool. I've been following your installation guide for TCRM, but I have the following error while running this command:

cd tcrm && sh setup.sh --project_id=$GOOGLE_CLOUD_PROJECT

The error is as in the screenshot:

error

Do you have any idea how this could be fixed?
Thanks in advance.

Events not getting forwarded from BQ to GA4

Hi,
I've been trying to send events from BQ table to GA4 using tcrm_bq_to_ga4 dag. I've encountered 2 different issues so far:

  1. I created a new BQ table according to the schema mentioned in the below link and then triggered the TCRM dag. The entries seem to be created in tcrm_monitoring_table and the DAG ran successfully but the events are not visible on GA.
  2. I tried to trigger the dag again with different data in the table but now even the entries in monitoring table don't get created but the DAG finishes successfully.

Screenshot 2021-10-18 at 9 08 43 AM

Screenshot 2021-10-18 at 9 08 56 AM

Let me know what can I be doing wrong.
I've created a new event on Google Analytics dashboard and using gtag and measurement_id as configuration to send events.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.