Comments (9)
TODOs:
- Detect seasonal effects
- find out harvest time of selected commodities and include weather data at the time of last respective harvest in prediction?
from humanitas.
@mstefanro @ChingChia @Fabbrix for this issue it might be wise to perform a meta-analysis of all our results to conclude seasonal effects. What do you guys think?
from humanitas.
@albu89 Sure, could you explain the results of the association rule analysis in more detail first though?
from humanitas.
@Fabrix are you interested in what the ouput says?
0.761 0.981 BajraFAQ=big MeatMutton=small -> MaizeFAQ=big tells us that this implication has a 0.761 support meaning that Bajara and Maize have a big price difference with respect to the previous week where Mutton a small price difference. This can be observed over all years every week with a probability of 76.1 percent. A confidence of 98.1 tells us that if Bajra shows a big price difference and Mutton a small one then with a 98.1 probability this implies that Maize will endure a big price difference.
from humanitas.
sounds interesting, but how do we filter out useful rules? Just by skimming through the rules they looked to me more like correlations lacking explanatory power than rules that actually encode a causal relationship
from humanitas.
The causal relationship is expressed with the confidence -> Confidence = P(consequence | antecedent) where a rule has the following syntax: Antecedent -> Consequence. I defined the usefullness (filtering) of the rules according to the two metrics confidence and support. I think if we put the rules in context it has a huge expressive power. In particular with regards to the humanitarian aspect of our project. The rules could be used in form of a recommendation system. I.e. a user can filter for date and region and get purchasing recommendation. -> {Delhi will experience a medium price increase of rice as suppose to wheat that ist very likely to see a big price decrease during Febuary.} Did this answer your question?
from humanitas.
Yeah, but you computed the associations over all the data right? So all you can say is from the data checked we can say with confidence X any given time that the price of commodity Y will (increase/decrease) by a (small/large) amount if the following rule .. applies to commodity Z
from humanitas.
no the associations are performed from the data of a specific city so we can make regional conclusions. i could also try to include a further filter if you want to narrow it down to a specific season (summer, winter..) what the rules tell us is that if a commodity X is in state x2 then commodity Y will be in state y1. Furthermore we know from the support that out of all the posible states this specific combination (X =x2 -> Y=y1) will occure in Z% of the times. We therefor can not only conclude the relationships but also say in what state commodity X will most likely be.
from humanitas.
Use
- Temperature (offset by 'time to market'/delivery time for commodity)
- Rainfall (significance for different commodities? wheat vs rice)
- Inflation as a price driver (computed from CPI)
from humanitas.
Related Issues (20)
- Select appropriate Time Series Analysis method
- FNNs + RNNs (Echo State Networks) - implementation HOT 7
- Convert all tabular data into CSV files HOT 13
- Attempt to group food types based on the correlation coefficient of their prices HOT 2
- Compile list sources on topics of commodity pricing and food security HOT 5
- Layout CSV Data Indonesia HOT 1
- Twitterstream filter HOT 1
- Read price csv into multi-index Pandas dataframe HOT 19
- Data Mining: Regional Scope of Analysis HOT 7
- Visualiation of Results - Output format of analysis HOT 3
- India product selection HOT 4
- Filtering & NLP of tweets HOT 1
- Some issues of the daily datasets HOT 4
- Tabs and spaces in Python scripts
- Situation of the wholesale daily dataset HOT 1
- Situation of retail daily dataset HOT 1
- Reservoir Computing (ESN) - Training
- Proc. tweets - matching to predefined categories
- Potential of daily wholesale data (2005-2014) for prediction vs. daily retail (2009-2013) HOT 10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from humanitas.