Product Engineer (Python/pyspark)

Job description

Job Summary:

We are looking for a proactive and detail-oriented Product Engineer to support the development and maintenance of data pipelines and backend services. You will work with AWS, Python, and PySpark to build reliable data workflows and assist in API development using Java. This role offers an excellent opportunity to grow your skills in cloud technologies, big data processing, and backend development while collaborating with experienced engineers and cross-functional teams.

Key Responsibilities:

• Assist in designing and maintaining scalable data pipelines using AWS services.
• Support data processing tasks using PySpark and Python.
• Contribute to backend service and API development using Java.
• Collaborate with senior engineers and stakeholders to understand data requirements.
• Monitor and troubleshoot data workflows and performance issues.
• Ensure data accuracy and consistency across platforms.
• Learn and apply best practices in data engineering and software development.

Required Skills:

• Hands-on experience with AWS services like S3, Lambda, and Glue.
• Working knowledge of PySpark and Python for data processing.
• Basic experience with Java (at least 1 year).
• Familiarity with ETL processes and data warehousing concepts.
• Understanding of relational databases and NoSQL systems.
• Exposure to version control tools like Git.
• Good problem-solving and communication skills.
• Eagerness to learn and grow in a collaborative environment.

Preferred Qualifications:

• Exposure to CI/CD pipelines.
• Awareness of data security and compliance practices.

AWS foundational or associate-level certification is a plus.

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Qualifications

• AWS: S3, Lambda, Glue, Working knowledge of PySpark & Python for data processing, Basic Java experience (~1+ year)
• Familiarity with ETL processes and data warehousing concepts, Understanding of relational databases and NoSQL systems
• Exposure to version control tools like Git

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here