Leads the team this role joins
Decides on early hires
Runs hiring at the company
From your own Gmail and LinkedIn.
About the role
This is a senior data engineering role for people with four or more years building production data pipelines, at least two of them on AWS with Python. It suits engineers who will build the source connectors and ingestion pipeline that feed governed, permission-tagged content into Amazon S3 and Bedrock Knowledge Bases for a client. The work is delivered by Solvd, a consulting and technology services firm, and is paired with a retrieval engineer. The posting does not state a location.
What you’ll do
- Build an Oracle B2C Service connector that performs a full inventory extract and then incremental syncs.
- Build SharePoint, OneDrive and Teams connectors on Microsoft Graph, including delta queries and permission metadata.
- Build a Sitecore connector for in-scope public web content.
- Implement an ingestion pipeline that lands content in S3, converts and extracts text, deduplicates by hash and enriches metadata.
- Run Bedrock Knowledge Base data source syncs using chunking settings from the architect.
- Handle retirement so items removed at source are removed from the index on the next sync.
- Manage throttling, backoff, idempotent re-runs and failure isolation for each source.
- Instrument pipeline stages with CloudWatch metrics and write ingestion runbooks.
- Pair with the client's IT team during the transition so they can run and extend the pipelines.
What they’re looking for
- Four or more years building production data pipelines, at least two on AWS with Python.
- Hands-on experience with the Microsoft Graph API for SharePoint and Teams, including delta queries, permissions and throttling, or comparable enterprise content platforms.
- Experience landing unstructured content such as HTML, Office files, PDFs and chat transcripts in S3 for search or vector indexing.
- Working knowledge of Bedrock Knowledge Bases or a comparable vector pipeline on OpenSearch.
- Infrastructure-as-code experience with Terraform or AWS CDK, and CI for deployment into a client account.
- Comfort working from a shared backlog in client repositories and documenting as work progresses.
Nice to have
- AWS Certified Data Engineer Associate certification.
- Prior integration with Oracle B2C Service or another Oracle Service Cloud product.
- Prior integration with Sitecore XM or XP content APIs.
- Experience with AWS Glue, Step Functions or EventBridge.
- Experience with document parsing libraries for Office and PDF formats.
What’s on offer
- Work on AI-driven projects across several industries.
- Access to a global team with opportunities to collaborate across regions.
- An inclusive environment focused on learning and responsible AI.
Skills
Questions about this role
How many years of experience are required?
Four or more years building production data pipelines, at least two on AWS with Python.
Does the role require Microsoft Graph experience?
Hands-on Microsoft Graph experience is required, or equivalent experience with enterprise content platforms.
Is the location stated?
The posting does not state a location or work arrangement.