Senior Data Engineer is required with strong experience across AWS data platforms to join one of the world’s largest and most prestigious law firms as it goes through a major data and AI transformation.
This is a senior, hands-on data engineering role focused on building and evolving the enterprise data platform, ingesting data from complex enterprise business systems and creating high-quality datasets for analytics, reporting and AI/ML in a regulated environment. You’ll need to be comfortable working with ambiguity, shaping solutions and collaborating closely with internal teams, vendors and technology partners.
The role is primarily remote, but you must live within approximately one hour of Midtown Manhattan, NYC.
Candidates must already be eligible to work in the US. No H-1B transfers or new visa sponsorship.
Key skills required for the Senior Data Engineer
- Circa 10+ years of enterprise data engineering experience.
- Experience working through large-scale data transformation or cloud modernisation programmes.
- Strong hands-on experience with AWS data platforms and services.
- Experience building data lakes, data warehouses and lakehouse architectures.
- Strong experience with technologies like Amazon EMR, Databricks and Apache Spark.
- Amazon Kinesis experience is desirable, particularly for real-time or streaming data ingestion.
- Exposure to data pipelines supporting AI/ML, embeddings, vector databases and RAG.
- Strong ETL/ELT, SQL and Python skills.
- Experience with orchestration tools such as Airflow.
- Knowledge of Bronze / Silver / Gold data architectures.
- Experience with data quality, lineage, governance and metadata.
- Ability to work effectively with ambiguity and turn loosely defined requirements into scalable technical solutions.
- Strong experience collaborating with third-party vendors, consultancies and technology partners.
- Background in large enterprise, consulting, professional services or financial services environments is highly desirable.
What you’ll do as a Senior Data Engineer
- Design and build scalable AWS-based data platforms.
- Build distributed processing workloads using Amazon EMR, Spark and Databricks.
- Consolidate data from multiple enterprise applications into centralised data platforms.
- Build and optimise scalable ETL/ELT pipelines.
- Create curated, model-ready datasets for analytics, reporting and AI/ML.
- Implement data quality, lineage, metadata and governance standards.
- Work with internal stakeholders and external vendors to shape technical solutions and integrations.
- Navigate changing requirements and bring structure to complex, ambiguous problems.
- Help shape technical standards and mentor other data engineers.
Why this role?This is a chance to join a globally recognised organisation at a key stage in a major data and AI transformation.
You’ll work to modernise a complex enterprise data estate and build the data foundations for analytics, machine learning and generative AI.
The role is particularly suited to someone who combines strong hands-on engineering with the ability to operate in ambiguity, influence vendors and stakeholders, and help drive a large-scale transformation forward.
Location: Primarily remote – must be within approximately one hour of Midtown Manhattan, NYC.
Work authorisation: Must already be eligible to work in the US. No H-1B transfers or new visa sponsorship.
Opus Resourcing acts as an employment agency with respect to permanent employment.
📩 Apply now or message us for more details. Referrals always welcome!
#AWSJobs #DataEngineering #Databricks #DataTransformation #NYCTechJobs
