Senior Associate | Google Cloud Platform Data Engineering | Chennai | Engineering as a Service/ Oper

GCP Big Data Engineer

GCP Big data engineering - GCP expertise. Understanding of Data ingestion, data lake, data mesh, trade offs/ ons of different GCP services; data proc, cloud composer, Google Cloud Storage and Big Query; experienced candidate; Hands-on experience on Big Data platforms (Scala/Spark/Hive SQL) and Big Data Lake; knowledge of inductry/ external perspective; GCP; Big Data; Scala; Spark; Hive; ETL - Big Data / Data Warehousing; CI/CD; Maven; Jenkins; Git (GitHub, GitLab, BitBucket, SVN); SQL; RDBMS; PowerBI

Responsibilities:Provide thought leadership, engineering expertise and direction to the engineering teams; be versatile and be able to collaborate with business stakeholders, product teams and cross functional technology groups to drive continuous delivery.Drive user story analysis and elaboration, design and develop software applications, and test and build automation tools.Own all technical aspects of software development (architecture, design, and development of systems) for assigned applications.Perform hands-on software development, writing code, API specs, doing proof of concepts, conducting code reviews, and testing in ongoing sprints.Drive consistent development practices - tools and common components.Develop deep understanding of tie-ins with other systems and platforms within the supported domains.Work with technical product managers contributing to blueprints and assisting with annual planning of feature sets.Identify opportunities for adopting new technology to solve existing needs and predicting future challenges.Effectively communicate to internal and external business partners on solution design.Functional SkillsStrong analytical & strategic thinking skillsAbility to interpret technical /business objectives and challenges.Porting/Software ConfigurationAgile MethodologiesSoftware development/ testingObject oriented analysis and design across multiple platforms.Designing High Availability applicationsPreferred:·Product Engineering KnowledgeMinimum QualificationsBachelor’s Degree in Computer Science, Computer Science Engineering, or related field required; advanced degree is preferred.Preferred Qualifications4+ years of commercial software development experienceProficient in developing, hosting solutions on Google Cloud Platform- Google Cloud Storage and Big Query. ·Hands-on experience on Big Data platforms (Scala/Spark/Hive SQL) and Big Data Lake. ·Experience and proficiency in ETL (Extract, Transform, Load) processes and tools and data modelling in Big Data platform. ·Proficiency in Secure File Transfer (SFT) operations and its utilization in data management.Experience with Agile development, Continuous Integration, and Continuous Delivery, including working knowledge of various tools in the CI/CD pipeline.Experience with automated release management using Maven, Salt, Git, JenkinsExperience in Architecture design and modeling should possess strong skills in designing and modeling complex systems and architectures.Good understanding of web technologies (HTTP, Apache) and familiarity with Unix/LinuxGood understanding of data structures, algorithms, and design patternsGreat written communication and documentation abilitiesLooks proactively beyond the obvious for continuous improvement opportunities.Leadership and communication: lead teams and collaborate with stakeholders, so strong leadership and communication skills are essential.Excellent communication skills, with the ability to influence at all levels across functions, from both technical and non-technical perspectives alike.Secondary Skills:·Design and develop end-to-end business intelligence solutions using the Power BI stack.·Define and implement robust data models, metrics, and KPIs to support reporting and advanced analytics.·Design, develop, and optimize scalable multidimensional and tabular data models to enable interactive analytics and reporting.·Demonstrate strong proficiency in DAX, Power Query, and SQL, along with expertise in designing intuitive and visually compelling Power BI dashboards and reports to drive data-driven decision-making.·Troubleshoot, debug, and optimize BI solutions (reports, cubes, and semantic models) to ensure high performance, scalability, and reliability.·Develop and maintain BI frameworks, semantic layers, and metadata repositories to support data governance, standardization, and administration.