Chunking support for ScriptCreatorGraph about scrapegraph-ai HOT 4 CLOSED

# Create an instance of SmartScraperGraph with specific instructions
smart_scraper_graph = ScriptCreatorGraph(
    prompt="List the name, price and description for each product. Make sure that you include every product.",  # The AI prompt specifies what to extract
    source="https://www.miele.co.uk/category/1022125/ovens-and-built-in-cookers",  # URL of the website from which to scrape data
    config=graph_config,  # Uses predefined configuration settings
)

# Execute the scraping process
result = smart_scraper_graph.run()

openai.RateLimitError: Error code: 429 - {'error': {'message': 'Request too large for gpt-4o in organization org-owSMgmqDOmy9zGOv1Lzt4Ypi on tokens per min (TPM): Limit 10000, Requested 222359. The input or output tokens must be reduced in order to run successfully. Visit https://platform.openai.com/account/rate-limits to learn more. You can increase your rate limit by adding a payment method to your account at https://platform.openai.com/account/billing.', 'type': 'tokens', 'param': None, 'code': 'rate_limit_exceeded'}}