Job Overview
We are looking for an experienced and highly skilled Big Data Lead to join our team and drive the design, implementation, and management of our big data infrastructure. The ideal candidate will have a deep understanding of data lake architectures, big data technologies, and data engineering processes. This role requires expertise in handling large-scale data processing and developing robust analytics solutions that provide actionable insights.
How You Will Make an Impact:
Data Lake Architecture and Management:
- Design and manage scalable and efficient data lake architectures to support the organization’s data storage and processing needs.
- Utilize data lake platforms such as Apache Hadoop, Amazon S3, Azure Data Lake Storage, or Google Cloud Storage to optimize data management.
Data Engineering:
- Lead the development and maintenance of ETL (Extract, Transform, Load) pipelines to ensure seamless data integration and transformation.
- Work with data integration tools like Apache NiFi, Apache Airflow, Talend, or Informatica to automate and optimize data workflows.
Big Data Technologies:
- Implement and manage big data processing frameworks such as Apache Spark, Apache Flink, or Hadoop MapReduce for large-scale data processing.
- Leverage distributed computing and parallel processing techniques to enhance data processing efficiency.
Data Modeling and Schema Design:
- Design efficient, scalable, and maintainable data models that align with business needs.
- Work with both relational and non-relational databases, including SQL and NoSQL databases, to create and manage data schemas.
Analytics and Business Intelligence (BI):
- Develop analytics solutions and interactive dashboards using tools like Tableau, Power BI, Looker, or Qlik to enable data-driven decision-making.
- Apply data visualization best practices to convey complex data insights in a clear and impactful manner.
Programming and Scripting:
- Utilize programming languages such as Python, Java, or Scala to develop data processing applications and automate tasks.
- Use scripting languages like Bash or PowerShell for automation of routine tasks and system management.
What You Bring to the Team:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- 3 – 5 years of total experience
- Extensive experience in designing and managing data lake architectures using platforms like Apache Hadoop, Amazon S3, Azure Data Lake Storage, or Google Cloud Storage.
- Strong proficiency in building and maintaining ETL pipelines using tools like Apache NiFi, Apache Airflow, Talend, or Informatica.
- Deep knowledge of big data processing frameworks like Apache Spark, Apache Flink, or Hadoop MapReduce.
- Expertise in distributed computing and parallel processing.
- Proven ability to design scalable data models and schemas for both SQL and NoSQL databases.
- Experience in developing analytics and BI solutions using tools like Tableau, Power BI, Looker, or Qlik.
- Proficiency in programming languages such as Python, Java, or Scala, and scripting languages like Bash or PowerShell.
- Experience leading teams in big data projects and managing large-scale data infrastructure.
- Strong analytical skills with the ability to translate complex data into actionable insights.
- Excellent communication skills and the ability to work collaboratively across teams.
What We Offer:
- A positive, open, and highly-innovative environment and team
- Entrepreneurial spirit with unlimited opportunity to grow
- Opportunity to work with leading global brands on exciting and impactful projects
- Competitive Base Pay
- Best of plan on Vacation & Paid Time Off.
- Provision of Medical Insurance for family – self, dependent, spouse, dependent children, parents/parent-in-laws
- Paid Maternity and Paternity leave
- Bi-annual reviews to ensure transparency and promoting high performance culture
- OKR Driven Performance Development Environment
- Learning & Development – access to wide range of e-Learning courses (technical, Product, Process, etc.,)
- A host of Interest Groups/Clubs for Book Reading, Toastmasters, Sports – Cricket, Volleyball, Throw-ball, Badminton, TT, Music
Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#CrossChannelJobs#JobSearch
#CareerOpportunities#HiringNow
#Employment#JobOpenings
#JobSeekers
