Lead end-to-end data workflows-from requirement-to-delivery-including data product creation and secure data transfer from Google Cloud Platform to PostgreSQL.
1. Develop & Schedule SQL Views via DAGs
Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and efficiency.
Build and manage workflow orchestrations (e.g., Airflow DAGs) to automate those views, ensuring reliable execution on daily, weekly, or customized schedules.
2. Execute Cross Platform ETL with AWS Glue
Develop, deploy, and maintain AWS Glue jobs to extract data from GCP (such as BigQuery or GCS) and load it into PostgreSQL.
Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines are reliable and idempotent.
3. Monitor, Troubleshoot & Resolve Incidents
Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors.
Conduct root cause analysis for pipeline failures-whether due to schema mismatches or performance bottlenecks-and apply robust fixes. Document resolutions to strengthen system resilience.
4. Design, Build, & Govern Data Products
Architect, construct, and maintain reusable data products, embedding clean datasets, metadata, governance policies, and clearly defined data contracts.
Ensure compliance with FAIR principles-data being Findable, Accessible, Interoperable, and Reusable-and enforce robust access controls in collaboration with governance stakeholders.
5. Translate Requirements into Technical Designs
Accumulate and analyze requirements via stakeholder engagement, user stories, or use cases.
Convert these into detailed design artifacts, including architecture diagrams, data models, and specifications for development.
6. Optimize Performance Across the Stack
Continuously refine ETL pipelines, SQL logic, and data workflows to boost efficiency and scalability. Techniques may include indexing, partitioning, caching, or employing materialized views to improve query speed.
7. Lead Migration from hh360 to BigQuery
Architect and drive a seamless migration strategy to move data and pipelines from the legacy hh360 system into Google BigQuery.
Employ iterative migration patterns for safe data transfers, rigorous validation, and phased deprecation of legacy infrastructure.
...best, every day.**Job Overview**We are looking for a talented design leader to help drive fashion application across our portfolio.... ...our global Baby brands. Collaborating with soft goods designers, industrial designers, usability experts, and engineers, you will shape and...
...OFFICERS FOR SPECIAL EVENTS in Doral, Florida area. Pay Rate: $ 19.00/Hrs Shifts Available: All Shifts Start Date: Immediate Hire (Temporary Special Events) JOB SUMMARY: Observes and reports activities and incidents at an assigned client site, providing...
Job Description The Runner-Busser is responsible for keeping inventory of transporting, stocking, and cleaning/clearing products to ensure business and customer needs are met. Essential functions and responsibilities of the position may vary by Aramark location based...
Provide 24/7 live-in care for 90 Y/O female in Chalfont, PAOur mission is to enable our clients to remain in their own home safely... ...live-in. Weekly / monthly schedule will be shared with another caregiver. Must have weekend availability (in addition to weekday...
...Details: Monday-Saturday 2:00PM-6:30PM, Days off TBD/ Time Commitment Waived in Current Position. Click HERE to learn more about the Courier/DOT-3 position! Pay Transparency: The compensation listed reflects the pay range or rate of pay reasonably expected for...