trendFinder

Trend Finder

Stay on top of trending topics on social media — all in one place.

Trend Finder collects and analyzes posts from key influencers, then sends a Slack or Discord notification when it detects new trends or product launches. This has been a complete game-changer for the Firecrawl marketing team by:

• Saving time normally spent manually searching social channels
• Keeping you informed of relevant, real-time conversations
• Enabling rapid response to new opportunities or emerging industry shifts

Spend less time hunting for trends and more time creating impactful campaigns.

Watch the Demo & Tutorial video

Learn how to set up Trend Finder and start monitoring trends in this video!

How it Works

1. Data Collection

   • Monitors selected influencers' posts on Twitter/X using the X API (Warning: the X API free plan is rate limited to only monitor 1 X account every 15 min)
   • Monitors websites for new releases and news with Firecrawl's /extract
   • Runs on a scheduled basis using cron jobs

2. AI Analysis

   • Processes collected content through Together AI
   • Identifies emerging trends, releases, and news.
   • Analyzes sentiment and relevance

3. Notification System

   • When significant trends are detected, sends Slack or Discord notifications based on cron job setup
   • Provides context about the trend and its sources
   • Enables quick response to emerging opportunities

Features

• AI-powered trend analysis using Together AI
• Social media monitoring (Twitter/X integration)
• Website monitoring with Firecrawl
• Instant Slack or Discord notifications
• ⏱️ Scheduled monitoring using cron jobs

Prerequisites

• Node.js (v14 or higher)
• npm or yarn
• Docker
• Docker Compose
• Slack workspace with webhook permissions
• API keys for required services

Environment Variables

Copy .env.example to .env and configure the following variables:

…

Getting Started

1. Clone the repository:

   git clone [repository-url]
   cd trend-finder
   

2. Install dependencies:

   npm install
   

3. Configure environment variables:

   cp .env.example .env
   # Edit .env with your configuration
   

4. Run the application:

   # Development mode with hot reloading
   npm run start
   
   # Build for production
   npm run build
   

Using Docker

1. Build the Docker image:

   docker build -t trend-finder .
   

2. Run the Docker container:

   docker run -d -p 3000:3000 --env-file .env trend-finder
   

Using Docker Compose

1. Start the application with Docker Compose:

   docker-compose up --build -d
   

2. Stop the application with Docker Compose:

   docker-compose down
   

Project Structure

trend-finder/
├── src/
│   ├── controllers/    # Request handlers
│   ├── services/       # Business logic
│   └── index.ts        # Application entry point
├── .env.example        # Environment variables template
├── package.json        # Dependencies and scripts
└── tsconfig.json       # TypeScript configuration

Contributing

1. Fork the repository
2. Create your feature branch (git checkout -b feature/amazing-feature)
3. Commit your changes (git commit -m 'Add some amazing feature')
4. Push to the branch (git push origin feature/amazing-feature)
5. Open a Pull Request