Senior ETL Design Google Cloud Platform Certified Consultant

Responsibilities:

• Design, develop, and maintain robust ETL pipelines on Google Cloud Platform using tools like Dataflow, BigQuery, Cloud Composer (Apache Airflow), and Pub/Sub
• Optimize data ingestion, transformation, and loading processes for high-volume, real-time, and batch data processing
• Ensure data integrity, quality, and security throughout the ETL lifecycle
• Collaborate with data engineers, analysts, and business teams to understand data needs and translate them into efficient ETL solutions
• Implement best practices for performance tuning, error handling, and monitoring of ETL jobs
• Work with structured and unstructured data sources, integrating API-based, event-driven, and batch processing workflows
• Automate and document ETL processes to enhance maintainability and scalability
• Utilize Git for version control and deployment of ETL workflows, ensuring smooth CI/CD integration

Skills:

• 12+ years of experience in ETL design and development
• Proficiency in SQL, Python, and Apache Beam for data processing using dataflow, dataproc appliances.
• Strong experience in advance DML operations, query optimization
• Strong expertise in Google Cloud Platform services (BigQuery, Dataflow, Cloud Storage, Pub/Sub, Cloud Composer)
• Experience with data modeling, warehousing concepts, and data lakes
• Hands-on experience with orchestration tools like Apache Airflow or Cloud Composer on DAG design, Error handling and monitoring
• Knowledge of performance tuning, data partitioning, and optimization techniques
• Experience in real-time streaming ETL and event-driven architectures is a plus
• Familiarity with Git for version control and deployment of ETL pipelines
• Strong problem-solving skills and ability to work in an agile environment

Qualifications:

• Bachelor's or master's degree in computer science, Information Technology, or a related field.
• Proven experience in ETL design and implementation in DWH systems.
• Strong problem-solving skills and the ability to work in a fast-paced environment.
• Excellent communication and collaboration skills.

Preferred Qualifications:

• Experience with Google Cloud Platform Big Query and other cloud data warehousing solutions.
• Familiarity with modern data processing frameworks and tools.