Maxun

Open-Source No-Code Web Data Extraction Platform

Maxun lets you train a robot in 2 minutes and scrape the web on auto-pilot. Web data extraction doesn't get easier than this!

Website | Discord | Twitter | Join Maxun Cloud | Watch Tutorials

Local Setup

Docker Compose

git clone https://github.com/getmaxun/maxun
docker-compose up -d --build

Without Docker

1. Ensure you have Node.js, PostgreSQL, MinIO and Redis installed on your system.
2. Run the commands below

git clone https://github.com/getmaxun/maxun

# change directory to the project root
cd maxun

# install dependencies
npm install

# change directory to maxun-core to install dependencies
cd maxun-core 
npm install

# start frontend and backend together
npm run start

You can access the frontend at http://localhost:5173/ and backend at http://localhost:8080/

Environment Variables

1. Create a file named .env in the root folder of the project
2. Example env file can be viewed here.

How Does It Work?

Maxun lets you create custom robots which emulate user actions and extract data. A robot can perform any of the actions: Capture List, Capture Text or Capture Screenshot. Once a robot is created, it will keep extracting data for you without manual intervention

1. Robot Actions

1. Capture List: Useful to extract structured and bulk items from the website. Example: Scrape products from Amazon etc.
2. Capture Text: Useful to extract individual text content from the website.
3. Capture Screenshot: Get fullpage or visible section screenshots of the website.

2. BYOP

BYOP (Bring Your Own Proxy) lets you connect external proxies to bypass anti-bot protection. Currently, the proxies are per user. Soon you'll be able to configure proxy per robot.

Features

• ✨ Extract Data With No-Code
• ✨ Handle Pagination & Scrolling
• ✨ Run Robots On A Specific Schedule
• ✨ Turn Websites to APIs
• ✨ Turn Websites to Spreadsheets
• ✨ Adapt To Website Layout Changes (coming soon)
• ✨ Extract Behind Login, With Two-Factor Authentication Support (coming soon)
• ✨ Integrations (currently Google Sheet)
• +++ A lot of amazing things soon!

Cloud

We offer a managed cloud version to run Maxun without having to manage the infrastructure and extract data at scale. Maxun cloud also deals with anti-bot detection, huge proxy network with automatic proxy rotation, and CAPTCHA solving. If this interests you, join the cloud waitlist as we launch soon.

Screenshots

Note

This project is in early stages of development. Your feedback is very important for us - we're actively working to improve the product. Drop anonymous feedback here.

License

This project is licensed under AGPLv3.

Contributors

Thank you to the combined efforts of everyone who contributes!