Senior Data Engineer (1043) - DataSF - Office of City Administrator
San Francisco, CA, United States
USD 145K-159K (estimate) Entry-level Full Time
Tasks
- Administer Snowflake data warehouse
- Build and maintain data infrastructure
- Collaborate with data scientists analysts and engineers
- Create data models and SQL optimization
- Design data pipelines
- Develop Infrastructure as Code with Terraform
- Ensure data quality and availability
- Implement access control and security policies
- Ingest and structure batch and streaming data
- Manage data monitoring and troubleshooting
- Perform performance tuning and cost optimization
- Use dbt for data transformation
- Write tests and maintain documentation
Perks/Benefits
Skills/Tech-stack
Airflow | Azure Data | Azure Data Factory | Batch Processing | BigQuery | DBT | Dagster | Data Factory | Data Governance | Data Modeling | Data Privacy | Data Security | Databricks | ELT | Infrastructure as Code | Kafka | Kinesis | Pandas | PySpark | Python | SQL | Snowflake | Snowpipe | Streaming Data | Terraform | “as-code”
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Staff Cloud Security Engineer USD 225K-275KAWS | AWS Secrets | AWS Secrets Manager | Admission control | Azure12 Holidays + 2 Floating Holidays | 12 holidays | 401k plan | In-home office setup | Internet stipendSenior-level Full TimeUnited States - Remote Opportunity R7h ago
-
DevSecOps Project Lead (Sr DevSecOps Engineer) USD 175K-215KACAS | AWS GovCloud | Azure Gov | CI/CD | Cloud ComputingCareer advancement opportunities | Dental insurance | Employer paid health care | Flexible work environment | Health insuranceSenior-level Full TimeRemote, USA R7h ago
-
DevSecOps Project Lead (Sr DevSecOps Engineer) USD 175K-215KACAS | AWS GovCloud | Azure Gov | CI/CD | Compliance validationParental leave | Remote work | Unlimited PTOSenior-level Full TimeRemote, USA R7h ago
-
Security Engineer - Detection & Response USD 180K-440KCloud Security | Digital forensics | Elastic | Linux | MacOS24/7 on-call rotation | 401k retirement plan | Dental insurance | Disability insurance | Discounts and perksMid-level Full TimeNew York, NY; Palo Alto, CA11h ago
-
Application Security Engineer (Remote in the U.S.) USD 85K-141KApplication Security | Azure DevOps | Bamboo | Burp Suite | C SharpCorporate holidays | Flexible time off | Group dental insurance | Group medical insurance | Home internet allowanceMid-level Full TimeRemote R11h ago
-
Senior Network Automation Engineer USD 146K-194KAnsible | BGP | Bash | CI/CD | Configuration Management401k matching | Health insurance | Paid time off | Relocation supportSenior-level Full TimeCosta Mesa, California, United States11h ago
-
Mid-level Full TimeCosta Mesa, California, United States11h ago
-
Systems Engineer, Battlespace USD 98K-129KAFSIM | AI machine learning | C# | C++ | CameoSecurity clearance support | Travel opportunityMid-level Full TimeBroomfield, Colorado, United States11h ago
-
Systems Engineer, Battlespace USD 113K-149KAFSIM | Artificial Intelligence | Cameo | Command Line | Critical softwareMid-level Full TimeWaltham, Massachusetts, United States11h ago
-
Lead Systems Engineer, Battlespace USD 166K-220KArtificial Intelligence | C++ | Cameo | Jama | LinuxSenior-level Full TimeWaltham, Massachusetts, United States11h ago
-
Lead Systems Engineer, Battlespace USD 144K-191KAFSIM | Artificial Intelligence | C# | C++ | CameoCompetitive benefits | Health benefits | People Management | Recovery Benefits | Travel opportunitiesSenior-level Full TimeBroomfield, Colorado, United States11h ago
-
Senior Systems Engineer, Battlespace USD 126K-167KAFSIM | Artificial Intelligence | C# | C++ | CameoSenior-level Full TimeBroomfield, Colorado, United States11h ago
-
Senior Systems Engineer, Battlespace USD 146K-194KAFSIM | Artificial Intelligence | C# | C++ | CameoActive US Secret security clearance eligibility | Travel up to 25 percent to customer sitesSenior-level Full TimeWaltham, Massachusetts, United States11h ago
-
Solution Engineer - Remote USD 123K-165KAI-enabled | AI-enabled workflows | APIs | Access Management | Cloud ComputingSenior-level Full TimeUnited States, UNITED STATES, United States R11h ago
-
Software Engineer USD 130K-260KAmazon Web Services | AngularJS | Ansible | CI/CD | CSS401k match | Employer Covered Dental Insurance | Employer Covered Disability Insurance | Employer Covered Vision Insurance | Employer-covered health insuranceMid-level Full TimeChantilly, VA13h ago
-
Cloud Security and Zero Trust Lead USD 146K-184K800-53 | AWS | Access Management | Authorization and Compliance | Continuous MonitoringRemote workSenior-level Full TimeLanham, Maryland, United States14h ago
-
Lead DevSecOps and Automation Engineer USD 128K-184KAWS | AWS Native | AWS native automation services | Amazon EKS | Amazon Web ServicesSenior-level Full TimeLanham, Maryland, United States14h ago
-
Partner 20, Senior Incident Response Engineer USD 243K-284KAI Security | AWS | Automation | Cloud Security | Cloud platformSenior-level Full TimeSan Francisco, California, United States14h ago
-
Partner 20, Senior Security Engineer USD 243K-284KAI Security | AWS | Agent governance | Cloud Security | Cloud platformSenior-level Full TimeSan Francisco, California, United States14h ago
-
Mid-level Full TimeLaurel, Maryland14h ago
-
Mid-level Full TimeLaurel, Maryland14h ago
-
Mid-level Full TimeLaurel, Maryland14h ago
-
Associate Application Security Engineer USD 80K-100KAPI Design | Container Scanning | DAST | IPS | Infrastructure as CodeDiversity and inclusion | Remote workMid-level Full TimeUS- Remote R14h ago
-
Staff Cloud Platform Engineer USD 166K-203KARM Templates | Access Management | Active Directory | Azure | Azure Active DirectoryFlexible work schedule | Occasional travel up to 20 percentSenior-level Full TimeMountain View, CA14h ago
-
Sr Product Security Engineer USD 135K-191KAI | AWS | Advanced Security | Application Security | AzureSenior-level Full TimeRemote Canada | Remote United States R15h ago