Software Engineer - Big Data,AWS
- Hyderabad
- Product Development
- Permanent
- Hybrid
- Full Time
We are looking for an experienced Software Engineer with experience in AWS cloud services and Distributed Systems. You should have a foundation in software development and experience using cloud and Big Data platforms to build scalable and efficient solutions. You will be reporting to a Senior Manager. You will WFO 2 days a week from Hyderabad.
Responsibilities:
- Collaborate with teams to understand requirements and design software solutions that use AWS cloud services and Big Data technologies.
- Develop and maintain scalable and reliable software applications using programming languages such as Java, Python, or Scala.
- Use AWS services including EC2, S3, Lambda, Athena, RDS, DynamoDB, EMR, and others to build cloud-native applications and microservices.
- Design and develop data processing pipelines using Big Data frameworks like Hadoop, Spark, Kafka, Presto and Hive.
- Implement monitoring, logging, and alerting solutions to ensure system reliability, availability, and performance.
- Collaborate with DevOps teams to automate deployment processes and ensure smooth integration of software components.
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.
We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.
We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Experience as a Software Engineer, with at least 2- 5 years of experience developing software applications.
- Proficiency in programming languages such as Java, Python, or Scala, and familiarity with software development methodologies and best practices.
- Hands-on experience building Big Data applications with AWS cloud services and infrastructure, including compute, storage, networking, and security.
- Develop custom operators and sensors to extend Airflow functionality and support specific use cases.
- Develop Batch applications using Spark & Scala or PySpark
- Familiarity with Big Data frameworks such as Hadoop, Spark, Kafka, and related tools like Hive, HBase, and Presto
Our uniqueness is that we truly celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what truly matters; DEI, work/life balance, development, authenticity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's strong people first approach is award winning; Great Place To Work™ in 24 countries, FORTUNE Best Companies to work and Glassdoor Best Places to Work (globally 4.4 Stars) to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is a critical part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, color, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.
Experian Careers - Creating a better tomorrow together
Benefits
Experian care for employee's work life balance, health, safety and wellbeing. In support of this endeavor, we offer best-in-class family well-being benefits, enhanced medical benefits and paid time off.
#LI-Onsite
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Explore Experian's award winning 'people first' culture.
Being part of Experian is exciting. Every day brings new challenges, new opportunities, new ways for us to do what we do best: using our innovative technologies and data to work in new and surprising ways. All brought together in a single thought: Discover the Unexpected.
Learn moreRecommended Jobs
Salary
Location
New York, United States
Experience Level
Not Applicable
Employment
Permanent
Location
New York
Role Type
Hybrid
Salary Range
$176,036 - $316,865
Schedule
Full Time
Department
Marketing and Communications
Brand
Experian
Remote working available
Yes
Description
Reporting into the Chief Marketing Officer of Experian Marketing Services, you will manage a high-performing team of marketers supporting Experian's platforms, data and identity products and services.
Reference
6aaff7c3-3263-434d-ab1b-1b146c2178f3
Expiry Date
01/01/0001
Salary
Location
Costa Mesa, United States
Experience Level
Not Applicable
Employment
Permanent
Location
Costa Mesa
Role Type
Hybrid
Salary Range
$71,640 - $124,176
Schedule
Full Time
Department
Marketing and Communications
Brand
Experian
Remote working available
Yes
Description
Experian's North America Corporate Social Media team is looking for a Sr. Social Content Designer to create eye-catching, platform-ready content that boosts engagement and supports our communications
Reference
ec69fa2a-8c71-413b-83f6-efc654155de2
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Product Development
Brand
Serasa Experian
Remote working available
No
Description
Estamos à procura de um(a) Engenheiro(a) de Software Especialista com vasta e comprovada experiência para liderar e inspirar equipes de desenvolvimento de software. O profissional será responsável por
Reference
5d4a8a7d-5477-4f0a-a357-ecfaf386e37e
Expiry Date
01/01/0001
Salary
Location
Hyderabad, India
Experience Level
Not Applicable
Employment
Permanent
Location
Hyderabad
Role Type
Hybrid
Schedule
Full Time
Department
Customer Service
Brand
Experian
Remote working available
No
Description
The Data Automation Team supports multiple processes in collaboration with the AR & Billing team in their goal of provisioning the Experian products to end clients right first time.The Data Automation
Reference
26db049e-78a5-47ca-bb7f-1d5b56dda673
Expiry Date
01/01/0001
Salary
Location
Heredia , Costa Rica
Experience Level
Not Applicable
Employment
Permanent
Location
Heredia
Role Type
Home
Schedule
Full Time
Department
Customer Service
Brand
Experian
Remote working available
Yes
Description
A successful candidate will:Provide customer careResolve moderate to complex problems related to credentialing, technical support, billing, account maintenance, data issues, file research, product de
Reference
5454efec-9fa1-40e5-9f39-28beaf2124b8
Expiry Date
01/01/0001
Salary
Location
Heredia , Costa Rica
Experience Level
Not Applicable
Employment
Permanent
Location
Heredia
Role Type
Hybrid
Schedule
Full Time
Department
Product Development
Brand
Experian
Remote working available
Yes
Description
Job description We are looking for an accomplished Technical Product Specialist to design web applications, microservices, REST APIs, and other software solutions using a variety of modern technologie
Reference
b61c857d-a420-46ec-b1e0-51967d80f85e
Expiry Date
01/01/0001
Salary
Location
Sofia , Bulgaria
Experience Level
Mid-Senior Level
Employment
Permanent
Location
Sofia
Role Type
Hybrid
Schedule
Full Time
Department
Project Management
Brand
Experian
Remote working available
No
Description
We are looking for a strategic Project Lead to lead projects within our Talent Acquisition (TA) and Inclusion & Belonging (I&B) functions. You will guide process improvements, operational efficiencies
Reference
c8433857-d3ad-4c4d-bc6d-c13a460358b4
Expiry Date
01/01/0001
Salary
Location
United States
Experience Level
Not Applicable
Employment
Permanent
Location
United States
Role Type
Home
Salary Range
$100,649 - $174,459
Schedule
Full Time
Department
Project Management
Brand
Experian
Remote working available
Yes
Description
Experian's Inclusion & Belonging External Partnerships Teams is dedicated to forging meaningful connections with nonprofit organizations to advance Experian's mission of Financial Power To All™. Centr
Reference
6cf36052-aec2-4ba0-8de1-24d52e7b58a4
Expiry Date
01/01/0001
Salary
Location
Blumenau, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Blumenau
Role Type
Hybrid
Schedule
Full Time
Department
Product Development
Brand
Serasa Experian
Remote working available
No
Description
Extrair, transformar, analisar e gerar insights utilizando dados de diferentes tipos (dados de uso do produto, Teste A/B, pesquisas e NPS)Desenvolvimento de análises e insights para otimizar as estrat
Reference
d82cfa90-2a2c-4fdf-9d10-54b9795a4721
Expiry Date
01/01/0001
Salary
Location
Hyderabad, India
Experience Level
Not Applicable
Employment
Permanent
Location
Hyderabad
Role Type
Hybrid
Schedule
Full Time
Department
Customer Service
Brand
Experian
Remote working available
No
Description
Role and Responsibilities:Manage the daily Services & Billing and TPP operations, to ensure execution, target and timelines are met.Monitor requests to ensure we are working to our SLAs and prioritise
Reference
e2562488-7780-42f6-bfed-bd101031d61f
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Product Development
Brand
Serasa Experian
Remote working available
No
Description
Estamos em busca de uma pessoa desenvolvedora frontend com experiência em desenvolvimento mobile, para atuar nodesenvolvimento de uma nova ferramenta de documentos digitais.Quais serão suas principais
Reference
015ff7eb-9cf2-46e3-9bd6-6507ef258362
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Analytics
Brand
Serasa Experian
Remote working available
No
Description
Estamos em busca de um(a) Diretor(a) de Modelagem de Crédito e Analytics visionário(a), com sólida experiência em estratégias quantitativas, ciência de dados e liderança de times de alta performance.
Reference
7cc539d0-7409-4923-b509-133e7aa52e98
Expiry Date
01/01/0001
Salary
Location
Hyderabad, India
Experience Level
Not Applicable
Employment
Permanent
Location
Hyderabad
Role Type
Hybrid
Schedule
Full Time
Department
Product Development
Brand
Experian
Remote working available
No
Description
Design, develop, and maintain high-quality software solutions.Collaborate with cross-functional teams to define, design, and ship new features.Implement and manage Kafka Streaming and containerised mi
Reference
a2f295f6-aad6-4c34-a92f-0a5dd02c83cc
Expiry Date
01/01/0001
Salary
Location
Sofia, Bulgaria
Experience Level
Mid-Senior Level
Employment
Permanent
Location
Sofia
Role Type
Hybrid
Schedule
Full Time
Department
Legal & Compliance
Brand
Experian
Remote working available
No
Description
The Commercial Management team, part of the Commercial Team, provides commercial management services to the UK B2B business to help reach its financial targets with an acceptable level of commercial a
Reference
06dcf48d-2f7e-411f-b69c-d780d84328b2
Expiry Date
01/01/0001
Salary
Location
Stellenbosch, South Africa
Experience Level
Not Applicable
Employment
Permanent
Location
Stellenbosch
Role Type
Hybrid
Schedule
Full Time
Department
Analytics
Brand
Experian
Remote working available
Yes
Description
The Experian Innovation and Strategy team in South Africa spearheads adjacent and unchartered innovation. A key component of this function is fulfilled by the Research and Development (R&D) team. Inno
Reference
8769bcb0-c6fe-48c9-90c1-49e546162981
Expiry Date
01/01/0001
Salary
Location
Hyderabad, India
Experience Level
Not Applicable
Employment
Permanent
Location
Hyderabad
Role Type
Hybrid
Schedule
Full Time
Department
Information Technology & Systems
Brand
Experian
Remote working available
No
Description
Lead technical development productivity priorities forward, for the organisation to meet their strategic goals.Work with performance management and reporting and vendor teams to ensure access to accur
Reference
3e4509bc-b8e3-44b5-9963-db34effd8523
Expiry Date
01/01/0001