Crawler information

PIX-JobArchive

A low-volume research crawler that archives publicly listed job postings. Operated by CHNOPS-X.

If you found this page from a User-Agent string in your server logs, this is the crawler that made the request. Everything it does is described below, including how to have your site excluded.

User-Agent string

PIX-JobArchive/1.0 (+https://crawler.chnopsx.com; contact: pix@chnopsx.com)

At a glance

Operator	CHNOPS-X — PIX research cell
Purpose	Building a longitudinal archive of public job postings for academic research into how job roles change over time. Not a job board, not a recruiting product, not resale of your data.
Schedule	Once per week, Mondays at 09:00 KST (00:00 UTC)
Rate	In normal operation, at most one job-listing request per company per week. During one-time setup — identifying which job-board system a company uses — up to three requests to a company in a single week. `robots.txt` is fetched before any request and is not counted toward these limits. Requests are serialized, not parallelized.
Scope	Public job-listing endpoints only — the same data your careers page shows to any visitor
Contact	pix@chnopsx.com

What it does not do

No accounts, no logins, no authentication. It never creates an account and never accepts terms of service on anyone's behalf.
No bypassing of protections. If it encounters a CAPTCHA, a bot challenge, or any access control, it stops immediately and records the site as unavailable. It does not attempt to work around it.
No robots.txt violations. Disallowed paths are checked before the request is made and are not fetched.
No high-volume or repeated crawling. One request per company per week is the hard ceiling.
No personal data. It collects job postings as published. It does not collect applicant data, recruiter contact details, or anything behind a login.

How to request exclusion

Either method works, and no justification is needed.

1. Email — write to pix@chnopsx.com with the domain you want excluded. Exclusions are applied before the next weekly run.

2. robots.txt — add the following to your robots.txt:

User-agent: PIX-JobArchive
Disallow: /

Once excluded, the company is permanently recorded as excluded rather than as having zero postings, so the exclusion is not silently undone by a later change.

Corrections

If the crawler behaved differently from what this page describes, we want to know — please write to pix@chnopsx.com with the timestamp and the path from your logs. Operational errors are corrected and logged rather than quietly removed.