Job Description:

  • Work with a team of skilled and experienced Data engineers to design and code large scale real-time and batch data pipelines on the Cloud
  • Accountable for individual tasks and assignments as well as your team’s overall productivity
  • Prototype creative solutions quickly by developing minimum viable products
  • Resolve problems and roadblocks as they occur with help from peers, follow through on details and drive issues to closure
  • Define, develop and maintain artifacts like technical design or user documentation and look for continuous improvement in software and development process within an agile mindset
  • You will dive deep into the platform architecture to understand current engineering gaps and opportunities to evolve our technology stack.
  • You will develop cloud-native solutions to continuously harden our platform and cloud infrastructures at scale

Skills/Criteria (Mandatory & Optional)

  • 3+ years of experience working on Data technologies and large data solutions
  • Hands-on technical experience with design, implementation and optimization of data pipelines
  • Experience working as a Data Engineer: performance tuning, troubleshooting, and debugging data pipelines
  • Sound knowledge of data and database fundamentals
  • Knowledge of working with any relational Database and SQL queries
  • Experience using and working on cloud infrastructure and services (preferably AWS)
  • Hands on basic programming knowledge object-oriented/object function scripting languages: Python, SQL, Scala, Spark-SQL, PySpark etc
  • Knowledge of working on messaging services Kafka, AWS kinesis, AWS Firehose etc
  • Experience of working with any ELT/ETL tool (AWS glue, Matillion, Nifi etc)

Nice to have skills:

  • Hands-on development experience in Data Product / Data Warehouse Solutions
  • Experience with NoSQL databases, file handlings and API integration
  • Development experience on products/frameworks in Data / ML / AI space
  • Exposure to Analytics & Querying services like Athena, Amazon QuickSight
  • Basic knowledge in Data Engineering and/or Data Science
  • Attitude to learn and work on new technologies and good communication skills

Location: Bangalore / Kolkata / Remote