Data Developer

Job description

We have an exciting opportunity for a talented individual who is passionate about data analysis and development.  The ideal candidate will have strong problem-solving skills, in depth experience in programming using Python/Pyspark in a Hadoop environment with HDFS and preferably experience in running these Pyspark scripts using EMR Serverless service in an AWS environment. A broad experience in working with AWS and a keen appetite to learn new programs/tools, such as Snowflake and AI based technologies like OpenAI are desirable.

You will be working to develop data solutions which ensure the successful implementation of Experian’s marketing products to the end clients (internal and external), and you will be required to work both individually and as a member of the wider project team.

You will be actively involved in all stages of the creation of these data products from the initial specification to the final validation and quality checks. This includes the development of methodologies, data checking, processing of large datasets, validation, documenting, programming, and reporting.

Essential Duties and Responsibilities

·       Understanding the structure and relationships within data.

·       Designing and implementing robust processes for handling data.

·       Understanding the wider uses of data and the position with a larger Data Flow strategy.

·       Ensuring that projects are delivered on time, to budget and within specification.

·       Monitoring development work and producing solutions when problems are encountered. 

·       Devising robust checking procedures to be used during processing

·       Working as part of an agile team working in sprints to deliver increments of software using robust software development principles.

·       Producing clear documentation (support level documentation) geared to the technical understanding of the reader.

·       Maintaining and developing your own knowledge about technology, systems and approaches to data and software development.

·       Understanding and participating in performance management processes.

·       Ensuring Change processes are adhered to and improved where necessary.

·       Identifying new and promising tools and technology that may be of interest to the on-going development and support of the team.

·       Actively contributing to a culture where the fair treatment of customers is at the heart of the Experian business.  Taking personal responsibility to ensure that you adhere to all regulatory requirements and apply appropriate controls in the interests of our customers.

·       Providing support to the Business and Client base on existing data products and tools

Knowledge, Experience and Qualifications

Essential

·       Analysis and problem-solving capabilities.

·       Degree in Maths/Physics/Statistics/similar discipline or previous experience of a similar role.

·       Ability to interpret data, recognize problems as they arise, suggest and implement appropriate actions.

·       Ability to communicate clearly, both verbally and via detailed specifications and reports.

·       Excellent organizational skills and capability of working to tight deadlines.

·       Ability to work to a high level of accuracy.

·       Experience in designing, developing, and maintaining applications using Python and Pyspark in a Hadoop environment with HDFS.

·       Experience in AWS services S3, Lambdas, Managed Airflow (MWAA) and EMR Serverless.

 Desirable

·       Experience using data dashboarding/presentation tools like PowerBI.

·       Knowledge of data processing tools like Snowflake.

·       Experience in using databases like MongoDB and DynamoDB

·       Any experience in working with object-oriented languages like Java or .NET would be a plus.

·       Experian in AWS services like Kinesis, API Gateway etc

·       Awareness of CI/CD tools like Jenkins or Harness

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Qualifications

• Python
• Pyspark
• EMR Serverless
• MWAA
• Understanding of Data analysis, design, validation and processing
• AWS

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here