Linkedin Job Scraper

LinkedIn Scraper

Overview

This skill finds LinkedIn job postings by running tools/jobspy_scraper.py, a thin wrapper

around the JobSpy library. It handles installation,

parameter construction, execution, and result interpretation.

Quick Start

Install the dependency once (requires Python 3.10+):

python3.12 -m pip install -U python-jobspy --break-system-packages

Run the scraper:

python3.12 tools/jobspy_scraper.py \
  --search "software engineer" \
  --location "San Francisco, CA" \
  --results 25 \
  --output .tmp/jobs.csv

Results are saved as CSV and printed as a summary table.

Workflow

Step 1 — Understand the request

Identify from the user's message:

• Search term — job title, role, or keyword (required)
• Location — city, state, or "Remote" (optional but recommended)
• Results wanted — default to 25 if not specified
• Recency — hours_old filter if user wants recent posts (e.g. "last 48 hours")
• Company filter — linkedin_company_ids if targeting a specific company
• Full descriptions — set --fetch-descriptions if user needs job description text

If anything is ambiguous (e.g. "find AI jobs"), pick reasonable defaults and tell the user what you used.

Step 2 — Construct the command

Build the tools/jobspy_scraper.py command using the parameters below.

Always save output to .tmp/ so it's disposable and easy to find.

python tools/jobspy_scraper.py \
  --search "<term>" \
  --location "<location>" \
  --results <N> \
  [--hours-old <N>] \
  [--fetch-descriptions] \
  [--company-ids <id1,id2>] \
  [--job-type fulltime|parttime|contract|internship] \
  [--remote] \
  --output .tmp/<descriptive_filename>.csv

Note: --hours-old and --easy-apply cannot be used together (LinkedIn API constraint).

Step 3 — Run the script

Execute the command. The script will print a progress message and a summary of results found.

If the script is not found at tools/jobspy_scraper.py, check whether the file needs to be created

by reading skills/linkedin-job-scraper/scripts/jobspy_scraper.py and copying it to tools/.

Step 4 — Interpret and present results

After the run:

• Report how many jobs were found
• Show a brief table: Title | Company | Location | Salary | Posted
• Note the output file path so the user can open it
• If 0 results: suggest broadening the search term or removing the location filter

Parameters Reference

| Flag | Description | Default |

|------|-------------|---------|

| --search | Job title / keywords | required |

| --location | City, state, or country | none |

| --results | Number of results to fetch | 25 |

| --hours-old | Only jobs posted within N hours | none |

| --fetch-descriptions | Fetch full job descriptions (slower) | false |

| --company-ids | Comma-separated LinkedIn company IDs | none |

| --job-type | fulltime, parttime, contract, internship | any |

| --remote | Filter for remote jobs only | false |

| --output | Path for CSV output | .tmp/jobs.csv |

Output Columns

The CSV output includes:

| Column | Description |

|--------|-------------|

| TITLE | Job title |

| COMPANY | Employer name |

| LOCATION | City / State / Country |

| IS_REMOTE | True/False |

| JOB_TYPE | fulltime, contract, etc. |

| DATE_POSTED | When the listing was posted |

| MIN_AMOUNT | Minimum salary |

| MAX_AMOUNT | Maximum salary |

| CURRENCY | Currency code |

| JOB_URL | Direct link to the LinkedIn posting |

| DESCRIPTION | Full job description (if --fetch-descriptions used) |

| JOB_LEVEL | Seniority level (LinkedIn-specific) |

| COMPANY_INDUSTRY | Industry classification |

Common Use Cases

Find recent engineering roles at a startup:

python tools/jobspy_scraper.py --search "growth engineer" --location "New York" \
  --results 50 --hours-old 72 --output .tmp/growth_eng_nyc.csv

Monitor what a specific company is hiring for:

# First find the LinkedIn company ID from the company's LinkedIn URL
python tools/jobspy_scraper.py --search "engineer" --company-ids 1234567 \
  --results 100 --fetch-descriptions --output .tmp/company_hiring.csv

Find remote contract roles:

python tools/jobspy_scraper.py --search "data analyst" --remote \
  --job-type contract --results 30 --output .tmp/remote_contracts.csv

Error Handling

| Error | Fix |

|-------|-----|

| ModuleNotFoundError: jobspy | Run pip install -U python-jobspy |

| 0 results returned | Broaden search term, remove location, increase --results |

| Rate limited / blocked | Wait a few minutes; avoid running back-to-back large scrapes |

| hours_old and easy_apply cannot both be set | Remove one of those flags |

Script Location

The scraper script lives at tools/jobspy_scraper.py.

If it doesn't exist, copy it from skills/linkedin-scraper/scripts/jobspy_scraper.py to tools/:

cp skills/linkedin-job-scraper/scripts/jobspy_scraper.py tools/