Implemented Harvesters

This page lists all harvesters that have been implemented in the unified harvester system. Harvesters are organized by region and include their current status.

Summary

Total Implemented: 30 harvesters
Healthy: 18 harvesters
Unhealthy: 12 harvesters

Oceania

New Zealand

Harvester	Source	Status	Notes
`harcourts`	harcourts.com	✅ Healthy	New Zealand properties
`harcourts-nz`	harcourts.co.nz	✅ Healthy	New Zealand-specific
`homes-co-nz`	homes.co.nz	✅ Healthy	Working
`homes-nz`	homes.co.nz	✅ Healthy	Alternative implementation
`realestate-nz`	realestate.co.nz	✅ Healthy	New Zealand real estate

Australia

Harvester	Source	Status	Notes
`harcourts-au`	harcourts.com.au	✅ Healthy	Australia properties
`realestate-au`	realestate.com.au	❌ Unhealthy	Too Many Requests

Fiji

Harvester	Source	Status	Notes
`property-com-fj`	property.com.fj	✅ Healthy	Fiji properties
`housingsamoa-com`	housingsamoa.com	❌ Unhealthy	DNS lookup failed

Papua New Guinea

Harvester	Source	Status	Notes
`hausples-pg`	hausples.com.pg	✅ Healthy	PNG properties (batch submissions ok)
`marketmeri-pg`	marketmeri.com	✅ Healthy	PNG properties (batch submissions ok)
`property-com-pg`	property.com.pg	❌ Unhealthy	Site inaccessible
`property-pg`	property.com.pg	❌ Unhealthy	Site inaccessible

North America

United States

Harvester	Source	Status	Notes
`zillow`	zillow.com	✅ Healthy	US properties
`realtor`	realtor.com	✅ Healthy	US properties
`redfin`	redfin.com	✅ Healthy	US properties
`openstreetmap`	openstreetmap.org	✅ Healthy	Open data source

Canada

Harvester	Source	Status	Notes
`realtor-ca`	realtor.ca	✅ Healthy	Canada properties
`zolo-ca`	zolo.ca	❌ Unhealthy	Forbidden
`point2homes-ca`	point2homes.com/CA	✅ Healthy	Canada properties

Mexico

Harvester	Source	Status	Notes
`inmuebles24`	inmuebles24.com	✅ Healthy	Mexico properties
`lamudi-mx`	lamudi.com.mx	✅ Healthy	Mexico properties
`vivanuncios-mx`	vivanuncios.com.mx	❌ Unhealthy	Forbidden

South America

Brazil

Harvester	Source	Status	Notes
`vivareal-br`	vivareal.com.br	❌ Unhealthy	403 anti-bot
`zapimoveis-br`	zapimoveis.com.br	❌ Unhealthy	403 anti-bot
`olx-br`	olx.com.br/imoveis	❌ Unhealthy	403 anti-bot

Argentina

Harvester	Source	Status	Notes
`zonaprop-ar`	zonaprop.com.ar	❌ Unhealthy	Forbidden
`argenprop-ar`	argenprop.com	✅ Healthy	Argentina properties
`mercadolibre-ar`	mercadolibre.com.ar/inmuebles	✅ Healthy	Argentina properties

Global / Other

Harvester	Source	Status	Notes
`homedy`	homedy.com	❌ Unhealthy	Forbidden

Usage Examples

List All Harvesters

./bin/harvester -list

Run a Healthy Harvester

# New Zealand properties
./bin/harvester -harvester homes-co-nz -location auckland -pages 2 -max 10

# US properties
./bin/harvester -harvester zillow -location seattle-wa -pages 1 -max 5

# Canada properties
./bin/harvester -harvester realtor-ca -location toronto-on -pages 2

Health Check

# Check specific harvester
./bin/harvester -harvester homes-co-nz -health-check

# Check all harvesters (using script)
cd harvesters
./scripts/check_harvester_health.sh

Status Legend

✅ Healthy: Harvester can successfully access the target website
❌ Unhealthy: Harvester cannot access the target website (see notes for reason)

Contributing

If you’d like to help fix unhealthy harvesters or add new ones, see:

Notes

Health status is checked periodically and may change
Some harvesters may require specific configurations or credentials
Anti-bot measures may require additional handling (proxies, delays, etc.)
Website structure changes may require harvester updates