[BUG] Cloud TikTok scraper fails with ERR_PROXY_AUTH_UNSUPPORTED
Bug Description
I am using the paid SurfSense Cloud version with active credits.
The TikTok scraper repeatedly fails when scraping a common hashtag such as "Zara".
Error:
Page.goto: net::ERR_PROXY_AUTH_UNSUPPORTED at https://www.tiktok.com/robots.txt Call log:
- navigating to "https://www.tiktok.com/robots.txt", waiting until "load"
I also noticed:
- Reddit scraper returns Success but 0 items for "Zara"
- Google Search scraper returns Success but 0 SERP pages for "Zara"
These results also happen directly from the SurfSense API Playground.
Deployment Type
- SurfSense Cloud (hosted version)
- Self-hosted version
Steps to Reproduce
- Open API Playground.
- Select TikTok scraper.
- Use hashtag "Zara".
- Run the scraper.
- The request fails with ERR_PROXY_AUTH_UNSUPPORTED.
TikTok input:
{ "hashtags": ["Zara"], "max_items": 10, "results_per_page": 10 }
Reddit input:
{ "search_queries": ["Zara"] }
Google Search input:
{ "queries": ["Zara"] }
Expected Behavior
TikTok should return scraping results instead of a proxy authentication error.
Reddit and Google Search should return results for a common query such as "Zara".
Additional Information
This happens directly in the SurfSense API Playground, not only through my application.
Source: MODSetter/SurfSense