Description
AI Goofish Monitor is an advanced, open-source monitoring and analysis system specifically developed for the Xianyu (闲鱼) online marketplace. Utilizing Playwright for robust web automation and AI for intelligent data processing, this system enables users to conduct real-time and scheduled surveillance of product listings. Its primary goal is to simplify the process of finding desired items amidst the massive volume of goods available on Xianyu.
Read More
The system is equipped with a fully functional backend management UI, providing users with a centralized interface to configure and oversee multiple monitoring tasks. This UI allows for detailed customization of search criteria, scheduling of monitoring activities, and review of analytical insights generated by the AI component. The integration of AI facilitates smart analysis of product data, potentially identifying trends, value, or specific attributes that align with user preferences.
Key functionalities include the ability to set up various monitoring tasks, ensuring that users are alerted to new listings or changes in existing ones that match their predefined criteria. The Playwright framework ensures reliable interaction with the Xianyu platform, handling dynamic content and login states effectively. The AI capabilities extend beyond simple filtering, offering deeper insights into product characteristics and market dynamics on Xianyu.
This project is particularly beneficial for individuals or small businesses looking to efficiently source specific products, track competitive pricing, or identify unique opportunities on the Xianyu platform without manual, time-consuming searches. Its open-source nature encourages community contributions and allows for flexible deployment and customization to suit diverse user needs.
- CategoryWeb Scraping & Data Extraction
- Pricing ModelOpen source
- DeploymentDocker
- PlatformsWeb
AI Goofish Monitor's Core Features
Real-time Xianyu marketplace monitoring
Scheduled multi-task monitoring
AI-powered intelligent product analysis
Comprehensive backend management UI
Playwright-based web automation
Advanced filtering for product searches (shipping, new listings, region)
Data storage migration to SQLite
Dockerized deployment support
Support for WeChat robot notifications
Chrome extension for Xianyu login state extraction
Internationalization (i18n) support
Desktop application build workflow
Optimized containerized deployment and process management
Support for multiple container image repositories
Getting Started with AI Goofish Monitor
Clone the repository: Use `git clone [repository URL]` to get the project files.
Install dependencies: Navigate to the project directory and install required Python packages using `pip install -r requirements.txt`.
Configure settings: Copy `.env.example` to `.env` and `config.json.example` to `config.json`, then edit the configuration files with your specific monitoring tasks and settings.
Build Docker images: Use the provided Dockerfiles and `docker-compose.yaml` to build the necessary container images for deployment.
Deploy the system: Run `docker-compose up -d` to start the monitoring system and its backend UI in detached mode.
Access the UI: Open your web browser and navigate to the address where the backend management UI is hosted to configure and manage tasks.
Set up monitoring tasks: Within the UI, define your search criteria, scheduling preferences, and notification methods for Xianyu listings.
Monitor and analyze: Allow the system to run, collecting and analyzing data from Xianyu, and review the insights through the management UI.
AI Goofish Monitor's Use Cases
- Product Sourcing on Xianyu
- Market Trend Analysis
- Competitive Monitoring
- Automated Deal Finding
- Personal Shopping Assistant
- Inventory Management for Resellers
