Comments (2)
I can't understand clearly. Does that mean comparing today's row count with yesterday's and today's row count with the day before yesterday and so on up to 7 days latest days?
For example - if today is 28 April 2023
then the comparison will be
Today | previous | is_equal |
---|---|---|
28-April-2023 | 27-April-2023 | true |
28-April-2023 | 26-April-2023 | true |
28-April-2023 | 25-April-2023 | true |
28-April-2023 | 24-April-2023 | false |
28-April-2023 | 23-April-2023 | true |
28-April-2023 | 22-April-2023 | true |
28-April-2023 | 21-April-2023 | true |
Is this need to be done or just have to compare it with 7 days old table? and output as true
or false
.
from bigfunctions.
I was thinking on:
- getting table row count for today using INFORMATION_SCHEMA
- getting table row count for latest 7 days using INFORMATION_SCHEMA and time travel
- calling prophet bigfunction to forecast the row count of today given the row counts of the latest 7 days
- return an anomaly score given the distance from the prediction and the real value. The score computation must be clever.
We can also avoid prophet and use a business rule.
from bigfunctions.
Related Issues (20)
- [bug]: `get`: The database (default) does not exist for project HOT 16
- [new]: `export_to_pubsub(project, topic, data, attributes)` HOT 1
- [new]: `export_to_datastore(project, namespace, kind, key, value)` HOT 1
- [new]: `export_to_bigtable(project, table, key, value)`
- [new]: `get_datastore_data(project, namespace, kind, key)`
- [bug]: `upload_table_to_gsheet `: does not keep column ordered HOT 1
- [new]: `copy_table(table_src, table_dest)` HOT 3
- [bug]: `exchange_rate`: it does not work HOT 3
- [bug]: `explore_column `: can't make visualization work HOT 6
- [bug]: ask_ai deployment has problems and few debug hints HOT 2
- pandas_corr(FULL_TABLE_ID STRING)
- [bug]: `bigfunctions.eu.translate`: it does not work HOT 3
- [new]: `refresh_tableau(obj_title_to_refresh)`
- [feature]: improve quota management and other config
- [new]: `array_intersect(arr1, arr2)`
- [bug]: `get_latest_partition_timestamp`: has a undeclared variable HOT 5
- [bug]: a statement isn't working with new procedure HOT 1
- [new]: `send_teams_message(message, webhook_url)` HOT 2
- [new]: `timestamp_to_unix_date_time(timestamp_expression TIMESTAMP, date_time_part STRING)` HOT 1
- [new]: `timestamp_from_unix_date_time(unix_date_time INT64, date_time_part STRING)` HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bigfunctions.