Budget Optimization - Predicted target value about lightweight_mmm HOT 6 OPEN

@rajat-barve For the sanity check, you can just search for MCMC output analysis/interpretation and use the articles/videos to understand the summary output. Other steps, I did was to compare prior/posterior distribution and check if they are same or model has learnt anything from the data... And for business validation, look at the attribution, lag weight parameter distribution and check if those makes sense.

from lightweight_mmm.

Following up on the issue,

I am looking into the _objective_function method in the optimize_media.py file. My setup is 51 geos, 8 channels. My understanding is that the following code should divide the given budget for the channels based on the historical data share. Then, it repeats it for the n_time_period. When I try to run the following code individually, I am not getting a repeated array

media_values = geo_ratio * jnp.expand_dims(media_values, axis=-1)
 media_values = jnp.tile(media_values / media_input_shape[0], reps=media_input_shape[0])
 # Distribute budget of each channels across time.
 media_values = jnp.reshape(a=media_values, newshape=media_input_shape)

When I change the above code to the following code, I am getting spend divided across the channels and repeated across n_time_periods.

  media_values = geo_ratio * jnp.expand_dims(media_values, axis=-1)
  media_values = jnp.tile(media_values / media_input_shape[0], reps=(media_input_shape[0],1,1))

Now I am getting prediction from optimization in the range of actual values. I am not sure if this is version issue or I am doing something incorrectly.

Any help would be appreciated. Thanks!

from lightweight_mmm.

@ar-asur Can you share the code used for the optimization? I haven't been able to make it work.

from lightweight_mmm.

@ar-asur , sorry, I am not able to help you with your question since I am super new to MMM myself. But can you please let me know how you did your sanity checks and how did you learn about them? Any source?

from lightweight_mmm.

@jorgemadridm19 The code in the example notebooks worked for me for both national and geo-level model. I used them as the starting point. When you say it doesn't work, do you get issues with the code or the results?

from lightweight_mmm.

I did the same thing. I believe it is a bug in this version of lightweightMMM. According to the jnp documentation, reps=media_input_shape[0] will automatically append 1's in front of media_input_shape[0], not after.

from lightweight_mmm.