Snowflake Developer
Tata Consultancy Services
Atlanta, GA
Engineering, Information Technology
Snowflake Developer
Data Lake And Experience
- Guide team to migrate from on Prem Cloudera to Azure cloud environment.
- Designed and implemented scalable data lake solutions using Snowflake and Databricks, Developed and optimized data pipelines for ingestion, transformation, and storage.
- Managed data governance, quality, and security across cloud environments and Implemented performance tuning, automation, and CI/CD for data workflows.
- Collaborated with cross-functional teams to support cloud migration activities
- Install, configure, manage, and monitor Cloudera Hadoop clusters, ensuring high availability, performance, and security. This includes managing HDFS, YARN, and other ecosystem components.
- Tune Hadoop, Hive, and Spark jobs and configurations for optimal performance, efficiency, and resource utilization. This includes optimizing queries, managing partitions, and leveraging in-memory capabilities.
- Diagnose and resolve issues related to Linux servers, networks, cluster health, job failures, and performance bottlenecks. Provide on-call support and collaborate with other teams to ensure smooth operations.
- Implement and manage security measures within the Cloudera environment, including Kerberos, Apache Ranger, and Atlas, to ensure data governance and compliance.
- Setup and manage HashiCorp Vault for secure keys and secrets management.
- Utilize CyberArk for privileged access management and secure administrative tasks on the cluster.
- Migrate Hadoop, Hive, and Spark data and applications to Azure cloud services such as Azure Synapse Analytics, Azure Databricks, or Snowflake. Ensure data integrity, performance tuning, and validation.
- Develop scripts (e.g., shell, Ansible, Python) for automating administrative tasks, deployments, and monitoring. Work with users to develop, debug, optimize Hive/Spark/Python programs that connect to the Cloudera environment.
- Create and maintain documentation for system configurations, operational procedures, and troubleshooting knowledge bases.
- Work closely with the Cloudera vendor to stay current with the latest releases, perform upgrades, and address vulnerabilities.
About the company
Company website•IT Services and IT Consulting
Tata Consultancy Services (TCS) is the technology partner of choice for industry leading organizations worldwide. Since its inception in 1968, TCS has upheld the highest standards of innovation, engineering excellence, and customer service.
It has set an aspiration to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence.
Rooted in the heritage of the Tata Group, TCS is focused on creating long term value for its clients, its investors, its employees, and the community at large. With a highly skilled workforce spread across 55 countries and 202 service delivery centers across the world, the company has been recognized as a top employer in six continents. With the ability to rapidly apply and scale new technologies, the company has built long term partnerships with its clients – helping them emerge as perpetually adaptive enterprises. Many of these relationships have endured into decades and navigated every technology cycle, from mainframes in the 1970s to artificial intelligence today.
TCS sponsors 14 of the world’s most prestigious marathons and endurance events, including the TCS New York City Marathon, TCS London Marathon and TCS Sydney Marathon with a focus on promoting health, sustainability, and community empowerment.
Caution against fraudulent job offers: TCS doesn’t charge any fee throughout the recruitment process. Refer here: https://www.tcs.com/careers/india/recruitment-fraud-alert