Leads the team you would join
Owns the opening
On the team, can refer you
From your own Gmail and LinkedIn.
About the role
This is a remote contract role in the USA for a senior engineer who builds and runs a web scraping and compliance monitoring system on AWS. It suits a sole builder who can design cloud infrastructure, production Python services and browser automation, and who can work with little supervision. The employer is a digital media company that runs performance marketplaces and matching technology for brands and consumers.
What you’ll do
- Design and configure the production AWS environment with infrastructure as code using Terraform or CDK.
- Build a stateless, containerized scraping fleet that combines Playwright rendering, rule checks and Claude API analysis.
- Design token-cost controls across the LLM pipeline, such as prompt design, caching, model selection and batching, and measure the results.
- Define API contracts, job payloads and database write patterns with the internal team that owns the Laravel control panel.
- Build third-party data ingestion and field-level diff detection that adjusts monitoring rules.
- Handle modern web challenges such as single-page apps, consent overlays and full-page screenshot capture.
- Decide when LLM analysis is the right tool compared with a classifier or rules engine.
- Write unit tests covering all modules and APIs.
- Document architecture, configuration and procedures as the work progresses, then hand over knowledge at close.
- Report to the Senior Director and raise risks and trade-offs early.
What they’re looking for
- Production Python experience, including async patterns, type hints, packaging and testing.
- Direct production experience with ECS/Fargate, SQS, API Gateway, RDS PostgreSQL, S3, IAM and CloudWatch, using infrastructure as code.
- Shipped production use of the Claude API, including prompt design, structured output, error handling and cost trade-offs.
- A documented record of reducing LLM token spend, with before and after results.
- Working knowledge of other LLM providers to recommend cheaper or better options for specific tasks.
- Production Playwright experience at scale, including headless Chromium failure modes and screenshot strategy. Selenium or Puppeteer experience does not substitute.
- Machine learning fundamentals to judge LLM versus classifier approaches and reason about false-positive rates.
- Docker and containerization experience, including image optimization, ECR and stateless design.
- Ability to work fully independently while documenting and coordinating with an internal team.
Nice to have
- Experience with API ingestion and field-level diff detection.
- Laravel or PHP familiarity, enough to coordinate API contracts.
- SOC 2 Type II compliance experience.
- Third-party API integration experience.
- Regulated-industry experience in financial services, healthcare or insurance.
What’s on offer
- Expected hourly range of $80 to $100.
- The actual rate may vary based on the company's compensation practices and the applicant's location.
- Remote work.
Skills
Questions about this role
How much does it pay?
The expected range is $80 to $100 per hour, and the actual rate may vary.
Is this role remote?
Yes, it is a remote role in the USA.
What experience is needed?
Production Python, AWS infrastructure as code, production Claude API use and production Playwright experience at scale.
Is this an immediate start?
The listing is marked as an immediate start.