asuozzo / airbnb-analysis Goto Github PK

Hey - saw this repo at NICAR and figured I'd try it out with Airbnbs near me in Montana. It's super helpful! I don't have a great handle on how to contribute to things like this on Github but ran into couple minor issues I thought I'd flag in case anyone else is trying to use this code.

First, I'm seeing Airbnb limit its number of response listings to 50 at a time, not 300, which means I had to change the comparison value in the is_max flag in 1-scrapedata.py accordingly.

Second, I kept getting a list index error when running 1-scrapedata.py, I think because the recursive search choked when get_subdivisions() returned a bounding box with no listings inside it. I addressed that with two extra lines inside 1-scrapedata.py's get_listings() function:

   ...
   response = r.json()

   # NEW catches condition with no response listings
   if len(response["explore_tabs"][0]['sections']) == 0:
      return []

   #ADJUSTED
   is_max = response["explore_tabs"][0]['home_tab_metadata']['pagination']['result_count'] == 50
   ...