Staff Software Data Engineer

We are looking for an Engineer who succeed in solving complex, large-scale data challenges and bring creative, practical solutions shaped by their unique perspectives. Your work will directly allow Experian's next generation of data-driven marketing solutions.

We're open-minded about new technologies, passionate about what we do, and make time for everyone to grow as the industry changes. The team's 20+ engineers have an openness mindset, thinking outside the box and solving big problems together.

Are you up for the challenge?

1. Design and build a petabyte-scale data platform on AWS (Spark, Athena, Iceberg, Airflow), driving performance and reliability.

2. Build scalable data pipelines using Scala and Spark, and ensure code is optimized for performance and resiliency.

3. Be able to navigate through complex data challenges and provide cohesive and creative solutions.

You will report to the Senior Manager Software Engineering.

A day in the life as an Engineer:

• Build advanced software systems, while processing several petabytes of data.
• Use software engineering best practices and metrics.
• Deliver quality software collaboratively in value stream teams using Scrum methodology.
• Contribute to production projects that constitute our core offering.
• Work with cross-functional teams to provide production-ready data solutions that move business and product improvement. Always provide collaboration, mutual assistance, mutual respect, courtesy, and reliability.
• Ensure that the software you create is testable and tested.
• Peer review code and participate in proper code stewardship.
• Work with the Product Owner and Service Delivery Lead to explore detailed requirements, acceptance tests, and edge cases.
• Comply with corresponding protocols and procedures, such as coding conventions, use of version control, proper code testing, and alert/monitoring systems. Focus groups and leads will produce and share these protocols/procedures.
• Participate in code releases, following pre-defined standards.
• Help us adapt our GraphQL interfaces to modern Model Context Protocol services.
• Experience using modern artificial intelligence (AI) large language model (LLM) techniques to enhance software development, quality assurance, and data access.

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to accomplish their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

• 10+ years of experience making contributions in the form of tested production code in a big data platform environment.
• 7+ years working with big data processing technologies like:
  • Scala / Spark
  • AWS Services like Glue / S3 and Managed Airflow
  • AWS RDS
• 7+ years of working with Cloud Ecosystems and Tools. AWS experience is desired but Azure or GCP are accepted.
• Experience working with high-scale systems, with expertise around parallelized workloads, special emphasis on:
  • Query optimization
  • Data partitioning
  • Proper usage of stored procedures
• Passionate about helping your teammates grow by providing insightful code reviews and feedback
• Experience planning and executing complex technical projects using the Agile framework.
• Collaborate against multiple code bases using git, GitHub, or Bitbucket.

Bonus Experience

• Experience with DBT or other data transformation tools
• Understanding of concurrent and parallel programming
• Experience with AWS Database Migration Services or other Migration tools
• Experience with Angular and TypeScript is a bonus
• Experience using vector databases or using modern database technology vector search capabilities (pgvector, redis vectorfields, …) to accelerate large language model or retrieval augmented generation applications.
• Experience using modern artificial intelligence (AI) large language model (LLM) techniques to enhance software development, quality assurance, and data access.

Our benefits include: Medical, life and dental insurance, Asociación Solidarista, International Share Save Plan, Flex Work/Work from home, Paid time off, Annual Performance Bonus, Education Reimbursement, Family Bonding, Bereavement Leave, Referral Program, and more.

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward and recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

#LI-Hybrid