Senior Product Engineer (Data Engineer)

Job description

Job Summary:

We are seeking a skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines and backend services using cutting-edge technologies. You will work with AWS services, PySpark, Python, and Java to implement efficient data processing solutions and APIs. Collaborating with cross-functional teams, you will gather requirements, optimize data workflows, troubleshoot performance issues, and ensure data quality across platforms. As a mentor to junior engineers, you will provide technical guidance and contribute to the team’s success.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and systems using AWS services.
• Implement data processing solutions using PySpark and Python.
• Develop and maintain backend services and APIs using Java.
• Collaborate with cross-functional teams to gather requirements and deliver data solutions.
• Optimize and troubleshoot data workflows and performance issues.
• Ensure data quality and integrity across various data sources and platforms.
• Mentor junior engineers and provide technical guidance.

Required Skills:

• Extensive experience with AWS services such as EC2, S3, Lambda, Glue, and EMR.
• Proficiency in PySpark for large-scale data processing.
• Strong programming skills in Python.
• At least 2+ years of experience in Java.
• Experience with data warehousing solutions and ETL processes.
• Knowledge of both relational and NoSQL databases.
• Familiarity with CI/CD pipelines and version control systems like Git.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.

Preferred Qualifications:

• Experience with machine learning frameworks and tools.
• Knowledge of data security and compliance best practices.
• Certification in AWS or related technologies.

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Qualifications

• AWS: EC2, S3, Lambda, Glue, EMR. Proficiency in PySpark & Python for large-scale data processing, 2+years of Java experience
• Familiarity with ETL processes and data warehousing concepts, Understanding of relational databases and NoSQL databases
• Familiarity with CI/CD pipelines and version control systems like Git.

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here